python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1571853 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2723665'] with mtr_portfolio_ids : ['22051913'] and first list_photo_ids : [] new path : /proc/1571853/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 1.5455474853515625 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Apr 15 22:30:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6812 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-04-15 22:30:32.960185: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-15 22:30:32.991329: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-15 22:30:32.993754: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f4608000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-15 22:30:32.993836: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-04-15 22:30:32.998332: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-04-15 22:30:33.241562: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2ae95b50 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-04-15 22:30:33.241649: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-04-15 22:30:33.243035: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-15 22:30:33.243531: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-15 22:30:33.246612: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-15 22:30:33.249665: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-15 22:30:33.250199: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-15 22:30:33.253538: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-15 22:30:33.255393: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-15 22:30:33.262231: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-15 22:30:33.263767: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-15 22:30:33.263903: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-15 22:30:33.264607: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-15 22:30:33.264625: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-15 22:30:33.264635: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-15 22:30:33.265800: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6117 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-04-15 22:30:33.583240: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-15 22:30:33.583396: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-15 22:30:33.583422: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-15 22:30:33.583442: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-15 22:30:33.583465: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-15 22:30:33.583486: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-15 22:30:33.583515: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-15 22:30:33.583547: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-15 22:30:33.584956: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-15 22:30:33.586722: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-15 22:30:33.586844: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-15 22:30:33.586867: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-15 22:30:33.586889: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-15 22:30:33.586933: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-15 22:30:33.586959: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-15 22:30:33.586988: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-15 22:30:33.587012: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-15 22:30:33.588440: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-15 22:30:33.588500: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-15 22:30:33.588516: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-15 22:30:33.588528: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-15 22:30:33.590004: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6117 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-04-15 22:30:45.348210: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-15 22:30:45.641042: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-15 22:30:47.697756: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.698699: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.699317: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.699869: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.700616: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.701181: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.701737: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.701782: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-15 22:30:47.702553: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.702576: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-15 22:30:47.709270: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.709334: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-15 22:30:47.709920: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.709942: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-15 22:30:47.716576: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.716677: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-15 22:30:47.717486: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.717523: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-15 22:30:47.748654: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.748724: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-15 22:30:47.749292: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.749312: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-15 22:30:47.755981: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.756032: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-15 22:30:47.756588: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.756607: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-15 22:30:47.787163: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.787772: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.790287: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.790856: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.829978: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.830576: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.833455: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.834012: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.859824: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.860413: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.861974: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.862540: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.868194: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.868767: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.870469: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.871044: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.877379: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.877949: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.879492: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.880049: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.907678: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.908261: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.908812: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.909357: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.912940: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.913502: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.929193: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.929777: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.930340: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.930909: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.944268: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.944859: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.945408: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.945956: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.950339: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.950921: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.955822: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.956391: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.969508: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.970238: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.975128: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.975798: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.976397: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.977018: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.978306: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.978974: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.989930: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.990561: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.991183: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.991764: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.992330: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.992897: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.993864: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:47.994445: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.004306: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.004907: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.011445: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.012021: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.049107: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.049178: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-04-15 22:30:48.050569: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.051637: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.059763: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.060351: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.060908: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.061451: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.079390: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.080116: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.105313: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.105908: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.106592: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.107172: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.112254: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.112991: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.113684: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.114378: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.117031: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.126339: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.126971: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.138373: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.139017: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.139589: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.140136: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.140709: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-15 22:30:48.141261: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 9 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 55 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 50 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 65 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 72 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 37 Detection mask done ! Trying to reset tf kernel 1572707 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 963 tf kernel not reseted sub process len(results) : 9 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 9 len(list_Values) 0 process is alive process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5619 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0018451213836669922 nb_pixel_total : 46935 time to create 1 rle with old method : 0.05877089500427246 length of segment : 268 time for calcul the mask position with numpy : 0.0006101131439208984 nb_pixel_total : 29269 time to create 1 rle with old method : 0.03510642051696777 length of segment : 288 time for calcul the mask position with numpy : 0.00034046173095703125 nb_pixel_total : 12986 time to create 1 rle with old method : 0.01596379280090332 length of segment : 142 time for calcul the mask position with numpy : 0.00029087066650390625 nb_pixel_total : 11188 time to create 1 rle with old method : 0.014068365097045898 length of segment : 131 time for calcul the mask position with numpy : 0.0035943984985351562 nb_pixel_total : 107626 time to create 1 rle with old method : 0.1272871494293213 length of segment : 231 time for calcul the mask position with numpy : 0.0005631446838378906 nb_pixel_total : 27222 time to create 1 rle with old method : 0.03024005889892578 length of segment : 252 time for calcul the mask position with numpy : 0.00015592575073242188 nb_pixel_total : 4585 time to create 1 rle with old method : 0.0053751468658447266 length of segment : 111 time for calcul the mask position with numpy : 0.0005974769592285156 nb_pixel_total : 32337 time to create 1 rle with old method : 0.037519216537475586 length of segment : 240 time for calcul the mask position with numpy : 0.000255584716796875 nb_pixel_total : 9904 time to create 1 rle with old method : 0.011674165725708008 length of segment : 103 time for calcul the mask position with numpy : 0.0015223026275634766 nb_pixel_total : 78336 time to create 1 rle with old method : 0.08954834938049316 length of segment : 374 time for calcul the mask position with numpy : 0.0003654956817626953 nb_pixel_total : 10130 time to create 1 rle with old method : 0.012384176254272461 length of segment : 87 time for calcul the mask position with numpy : 0.0006973743438720703 nb_pixel_total : 26050 time to create 1 rle with old method : 0.03041672706604004 length of segment : 205 time for calcul the mask position with numpy : 0.0013861656188964844 nb_pixel_total : 39015 time to create 1 rle with old method : 0.045121192932128906 length of segment : 277 time for calcul the mask position with numpy : 0.00041103363037109375 nb_pixel_total : 15085 time to create 1 rle with old method : 0.018207073211669922 length of segment : 143 time for calcul the mask position with numpy : 0.0008182525634765625 nb_pixel_total : 26835 time to create 1 rle with old method : 0.031153440475463867 length of segment : 220 time for calcul the mask position with numpy : 0.029535293579101562 nb_pixel_total : 313764 time to create 1 rle with new method : 0.03203320503234863 length of segment : 908 time for calcul the mask position with numpy : 0.000240325927734375 nb_pixel_total : 5512 time to create 1 rle with old method : 0.006483793258666992 length of segment : 120 time for calcul the mask position with numpy : 0.00022721290588378906 nb_pixel_total : 6557 time to create 1 rle with old method : 0.0077245235443115234 length of segment : 134 time for calcul the mask position with numpy : 0.0005857944488525391 nb_pixel_total : 14659 time to create 1 rle with old method : 0.01824808120727539 length of segment : 169 time for calcul the mask position with numpy : 0.0033326148986816406 nb_pixel_total : 128095 time to create 1 rle with old method : 0.14515948295593262 length of segment : 573 time for calcul the mask position with numpy : 0.0012664794921875 nb_pixel_total : 46865 time to create 1 rle with old method : 0.05757761001586914 length of segment : 261 time for calcul the mask position with numpy : 0.0009331703186035156 nb_pixel_total : 27464 time to create 1 rle with old method : 0.04318737983703613 length of segment : 257 time for calcul the mask position with numpy : 0.0009663105010986328 nb_pixel_total : 29198 time to create 1 rle with old method : 0.03339552879333496 length of segment : 292 time for calcul the mask position with numpy : 0.0007698535919189453 nb_pixel_total : 32538 time to create 1 rle with old method : 0.037134647369384766 length of segment : 251 time for calcul the mask position with numpy : 0.002066373825073242 nb_pixel_total : 102267 time to create 1 rle with old method : 0.11653542518615723 length of segment : 235 time for calcul the mask position with numpy : 0.0005297660827636719 nb_pixel_total : 13244 time to create 1 rle with old method : 0.016101598739624023 length of segment : 145 time for calcul the mask position with numpy : 0.0018477439880371094 nb_pixel_total : 77004 time to create 1 rle with old method : 0.08969807624816895 length of segment : 442 time for calcul the mask position with numpy : 0.0008649826049804688 nb_pixel_total : 29992 time to create 1 rle with old method : 0.03692197799682617 length of segment : 319 time for calcul the mask position with numpy : 0.00016689300537109375 nb_pixel_total : 4981 time to create 1 rle with old method : 0.005956172943115234 length of segment : 112 time for calcul the mask position with numpy : 0.0009949207305908203 nb_pixel_total : 35265 time to create 1 rle with old method : 0.04465508460998535 length of segment : 212 time for calcul the mask position with numpy : 0.0032014846801757812 nb_pixel_total : 145568 time to create 1 rle with old method : 0.1714637279510498 length of segment : 610 time for calcul the mask position with numpy : 0.00022125244140625 nb_pixel_total : 6106 time to create 1 rle with old method : 0.007244586944580078 length of segment : 131 time for calcul the mask position with numpy : 0.00023484230041503906 nb_pixel_total : 9587 time to create 1 rle with old method : 0.011588096618652344 length of segment : 105 time for calcul the mask position with numpy : 0.00819706916809082 nb_pixel_total : 319160 time to create 1 rle with new method : 0.026373624801635742 length of segment : 903 time for calcul the mask position with numpy : 0.0005731582641601562 nb_pixel_total : 15067 time to create 1 rle with old method : 0.019851207733154297 length of segment : 162 time for calcul the mask position with numpy : 0.0012123584747314453 nb_pixel_total : 27594 time to create 1 rle with old method : 0.036477088928222656 length of segment : 231 time for calcul the mask position with numpy : 0.0008385181427001953 nb_pixel_total : 27962 time to create 1 rle with old method : 0.04628491401672363 length of segment : 233 time for calcul the mask position with numpy : 0.0017364025115966797 nb_pixel_total : 57800 time to create 1 rle with old method : 0.08334040641784668 length of segment : 417 time for calcul the mask position with numpy : 0.0011737346649169922 nb_pixel_total : 36568 time to create 1 rle with old method : 0.042440176010131836 length of segment : 274 time for calcul the mask position with numpy : 0.0001728534698486328 nb_pixel_total : 1490 time to create 1 rle with old method : 0.002839326858520508 length of segment : 109 time for calcul the mask position with numpy : 0.0004038810729980469 nb_pixel_total : 11046 time to create 1 rle with old method : 0.018886804580688477 length of segment : 149 time for calcul the mask position with numpy : 0.0011029243469238281 nb_pixel_total : 48160 time to create 1 rle with old method : 0.056516170501708984 length of segment : 443 time for calcul the mask position with numpy : 0.00019288063049316406 nb_pixel_total : 9242 time to create 1 rle with old method : 0.01095724105834961 length of segment : 113 time for calcul the mask position with numpy : 0.0005333423614501953 nb_pixel_total : 18075 time to create 1 rle with old method : 0.022188663482666016 length of segment : 188 time for calcul the mask position with numpy : 0.007872819900512695 nb_pixel_total : 273918 time to create 1 rle with new method : 0.45072126388549805 length of segment : 542 time for calcul the mask position with numpy : 0.008220434188842773 nb_pixel_total : 218260 time to create 1 rle with new method : 0.013891458511352539 length of segment : 600 time for calcul the mask position with numpy : 0.00035762786865234375 nb_pixel_total : 10894 time to create 1 rle with old method : 0.012870550155639648 length of segment : 97 time for calcul the mask position with numpy : 0.0004296302795410156 nb_pixel_total : 12919 time to create 1 rle with old method : 0.0153350830078125 length of segment : 157 time for calcul the mask position with numpy : 0.0012764930725097656 nb_pixel_total : 36732 time to create 1 rle with old method : 0.04494142532348633 length of segment : 197 time for calcul the mask position with numpy : 0.0003650188446044922 nb_pixel_total : 6893 time to create 1 rle with old method : 0.010197639465332031 length of segment : 110 time for calcul the mask position with numpy : 0.004843950271606445 nb_pixel_total : 128161 time to create 1 rle with old method : 0.16866040229797363 length of segment : 337 time for calcul the mask position with numpy : 0.00039768218994140625 nb_pixel_total : 5710 time to create 1 rle with old method : 0.006827831268310547 length of segment : 115 time for calcul the mask position with numpy : 0.000934600830078125 nb_pixel_total : 34425 time to create 1 rle with old method : 0.041452646255493164 length of segment : 258 time for calcul the mask position with numpy : 0.0007259845733642578 nb_pixel_total : 18629 time to create 1 rle with old method : 0.024657487869262695 length of segment : 335 time for calcul the mask position with numpy : 0.00046706199645996094 nb_pixel_total : 12240 time to create 1 rle with old method : 0.015742063522338867 length of segment : 152 time for calcul the mask position with numpy : 0.0008852481842041016 nb_pixel_total : 20020 time to create 1 rle with old method : 0.027470827102661133 length of segment : 208 time for calcul the mask position with numpy : 0.0016291141510009766 nb_pixel_total : 18913 time to create 1 rle with old method : 0.023054838180541992 length of segment : 336 time for calcul the mask position with numpy : 0.0013968944549560547 nb_pixel_total : 39023 time to create 1 rle with old method : 0.0690317153930664 length of segment : 428 time for calcul the mask position with numpy : 0.0009605884552001953 nb_pixel_total : 27867 time to create 1 rle with old method : 0.04419064521789551 length of segment : 234 time for calcul the mask position with numpy : 0.0017032623291015625 nb_pixel_total : 36619 time to create 1 rle with old method : 0.059044837951660156 length of segment : 251 time for calcul the mask position with numpy : 0.0008392333984375 nb_pixel_total : 17601 time to create 1 rle with old method : 0.02904820442199707 length of segment : 151 time for calcul the mask position with numpy : 0.0013697147369384766 nb_pixel_total : 34697 time to create 1 rle with old method : 0.055643558502197266 length of segment : 202 time for calcul the mask position with numpy : 0.0010035037994384766 nb_pixel_total : 20932 time to create 1 rle with old method : 0.034507036209106445 length of segment : 170 time for calcul the mask position with numpy : 0.0003597736358642578 nb_pixel_total : 8324 time to create 1 rle with old method : 0.013727188110351562 length of segment : 121 time for calcul the mask position with numpy : 0.0006852149963378906 nb_pixel_total : 20933 time to create 1 rle with old method : 0.0339510440826416 length of segment : 163 time for calcul the mask position with numpy : 0.0010135173797607422 nb_pixel_total : 28365 time to create 1 rle with old method : 0.032820701599121094 length of segment : 302 time for calcul the mask position with numpy : 0.0007243156433105469 nb_pixel_total : 21340 time to create 1 rle with old method : 0.034824371337890625 length of segment : 235 time for calcul the mask position with numpy : 0.00121307373046875 nb_pixel_total : 32772 time to create 1 rle with old method : 0.03797459602355957 length of segment : 202 time for calcul the mask position with numpy : 0.0016467571258544922 nb_pixel_total : 27323 time to create 1 rle with old method : 0.03182649612426758 length of segment : 561 time for calcul the mask position with numpy : 0.0007488727569580078 nb_pixel_total : 21024 time to create 1 rle with old method : 0.024376869201660156 length of segment : 155 time for calcul the mask position with numpy : 0.0004909038543701172 nb_pixel_total : 19669 time to create 1 rle with old method : 0.023072004318237305 length of segment : 128 time for calcul the mask position with numpy : 0.0005609989166259766 nb_pixel_total : 17493 time to create 1 rle with old method : 0.020540714263916016 length of segment : 165 time for calcul the mask position with numpy : 0.00029969215393066406 nb_pixel_total : 10916 time to create 1 rle with old method : 0.016693592071533203 length of segment : 136 time for calcul the mask position with numpy : 0.0001862049102783203 nb_pixel_total : 4239 time to create 1 rle with old method : 0.00516819953918457 length of segment : 96 time for calcul the mask position with numpy : 0.003324270248413086 nb_pixel_total : 139034 time to create 1 rle with old method : 0.158294677734375 length of segment : 357 time for calcul the mask position with numpy : 0.0019941329956054688 nb_pixel_total : 62296 time to create 1 rle with old method : 0.10600590705871582 length of segment : 275 time for calcul the mask position with numpy : 0.0007138252258300781 nb_pixel_total : 16827 time to create 1 rle with old method : 0.021234512329101562 length of segment : 163 time for calcul the mask position with numpy : 0.00026035308837890625 nb_pixel_total : 9524 time to create 1 rle with old method : 0.01573634147644043 length of segment : 96 time for calcul the mask position with numpy : 0.0014374256134033203 nb_pixel_total : 26583 time to create 1 rle with old method : 0.03151655197143555 length of segment : 312 time for calcul the mask position with numpy : 0.0003116130828857422 nb_pixel_total : 11331 time to create 1 rle with old method : 0.012968778610229492 length of segment : 138 time for calcul the mask position with numpy : 0.0006806850433349609 nb_pixel_total : 28235 time to create 1 rle with old method : 0.03239297866821289 length of segment : 195 time for calcul the mask position with numpy : 0.000492095947265625 nb_pixel_total : 19204 time to create 1 rle with old method : 0.03060293197631836 length of segment : 162 time for calcul the mask position with numpy : 0.00171661376953125 nb_pixel_total : 65892 time to create 1 rle with old method : 0.07705354690551758 length of segment : 298 time for calcul the mask position with numpy : 0.00041604042053222656 nb_pixel_total : 15195 time to create 1 rle with old method : 0.020015239715576172 length of segment : 151 time for calcul the mask position with numpy : 0.00029659271240234375 nb_pixel_total : 9774 time to create 1 rle with old method : 0.013350963592529297 length of segment : 114 time for calcul the mask position with numpy : 0.0005795955657958984 nb_pixel_total : 22457 time to create 1 rle with old method : 0.03146767616271973 length of segment : 252 time for calcul the mask position with numpy : 0.001096487045288086 nb_pixel_total : 42614 time to create 1 rle with old method : 0.050998687744140625 length of segment : 311 time for calcul the mask position with numpy : 0.0002765655517578125 nb_pixel_total : 5674 time to create 1 rle with old method : 0.0067844390869140625 length of segment : 105 time for calcul the mask position with numpy : 0.0005035400390625 nb_pixel_total : 13043 time to create 1 rle with old method : 0.015890121459960938 length of segment : 116 time for calcul the mask position with numpy : 0.00031948089599609375 nb_pixel_total : 4452 time to create 1 rle with old method : 0.005298137664794922 length of segment : 95 time for calcul the mask position with numpy : 0.001527547836303711 nb_pixel_total : 42528 time to create 1 rle with old method : 0.04934239387512207 length of segment : 232 time for calcul the mask position with numpy : 0.0006754398345947266 nb_pixel_total : 29293 time to create 1 rle with old method : 0.03307819366455078 length of segment : 217 time for calcul the mask position with numpy : 0.0006635189056396484 nb_pixel_total : 16887 time to create 1 rle with old method : 0.019668102264404297 length of segment : 169 time for calcul the mask position with numpy : 0.0006997585296630859 nb_pixel_total : 28529 time to create 1 rle with old method : 0.03279280662536621 length of segment : 180 time for calcul the mask position with numpy : 0.0028548240661621094 nb_pixel_total : 84008 time to create 1 rle with old method : 0.09471821784973145 length of segment : 318 time for calcul the mask position with numpy : 0.001573801040649414 nb_pixel_total : 52644 time to create 1 rle with old method : 0.05871701240539551 length of segment : 350 time for calcul the mask position with numpy : 0.0004050731658935547 nb_pixel_total : 9145 time to create 1 rle with old method : 0.0110015869140625 length of segment : 118 time for calcul the mask position with numpy : 0.0008423328399658203 nb_pixel_total : 21222 time to create 1 rle with old method : 0.02455759048461914 length of segment : 174 time for calcul the mask position with numpy : 0.00023031234741210938 nb_pixel_total : 4758 time to create 1 rle with old method : 0.005792856216430664 length of segment : 63 time for calcul the mask position with numpy : 0.0021381378173828125 nb_pixel_total : 72974 time to create 1 rle with old method : 0.0824885368347168 length of segment : 336 time for calcul the mask position with numpy : 0.0030188560485839844 nb_pixel_total : 108769 time to create 1 rle with old method : 0.15012669563293457 length of segment : 427 time for calcul the mask position with numpy : 0.0008120536804199219 nb_pixel_total : 21474 time to create 1 rle with old method : 0.02716374397277832 length of segment : 225 time for calcul the mask position with numpy : 0.0003643035888671875 nb_pixel_total : 7835 time to create 1 rle with old method : 0.00949549674987793 length of segment : 93 time for calcul the mask position with numpy : 0.001529693603515625 nb_pixel_total : 35460 time to create 1 rle with old method : 0.0413362979888916 length of segment : 288 time for calcul the mask position with numpy : 0.00128173828125 nb_pixel_total : 38017 time to create 1 rle with old method : 0.04361391067504883 length of segment : 231 time for calcul the mask position with numpy : 0.0012650489807128906 nb_pixel_total : 43691 time to create 1 rle with old method : 0.04985976219177246 length of segment : 397 time for calcul the mask position with numpy : 0.0007102489471435547 nb_pixel_total : 25446 time to create 1 rle with old method : 0.028744935989379883 length of segment : 208 time for calcul the mask position with numpy : 0.00018715858459472656 nb_pixel_total : 3637 time to create 1 rle with old method : 0.004277944564819336 length of segment : 91 time for calcul the mask position with numpy : 0.0015528202056884766 nb_pixel_total : 42365 time to create 1 rle with old method : 0.04959559440612793 length of segment : 252 time for calcul the mask position with numpy : 0.0002028942108154297 nb_pixel_total : 6457 time to create 1 rle with old method : 0.008069753646850586 length of segment : 94 time for calcul the mask position with numpy : 0.000640869140625 nb_pixel_total : 23022 time to create 1 rle with old method : 0.02652907371520996 length of segment : 263 time for calcul the mask position with numpy : 0.00041675567626953125 nb_pixel_total : 10455 time to create 1 rle with old method : 0.011675834655761719 length of segment : 157 time for calcul the mask position with numpy : 0.0005381107330322266 nb_pixel_total : 15197 time to create 1 rle with old method : 0.019004344940185547 length of segment : 195 time for calcul the mask position with numpy : 0.00048470497131347656 nb_pixel_total : 16743 time to create 1 rle with old method : 0.020718097686767578 length of segment : 173 time for calcul the mask position with numpy : 0.000213623046875 nb_pixel_total : 8982 time to create 1 rle with old method : 0.010787725448608398 length of segment : 83 time for calcul the mask position with numpy : 0.00023484230041503906 nb_pixel_total : 7649 time to create 1 rle with old method : 0.00906991958618164 length of segment : 94 time for calcul the mask position with numpy : 0.001237630844116211 nb_pixel_total : 67189 time to create 1 rle with old method : 0.07729101181030273 length of segment : 333 time for calcul the mask position with numpy : 0.0008683204650878906 nb_pixel_total : 17946 time to create 1 rle with old method : 0.020581483840942383 length of segment : 213 time for calcul the mask position with numpy : 0.001153707504272461 nb_pixel_total : 46336 time to create 1 rle with old method : 0.05447101593017578 length of segment : 272 time for calcul the mask position with numpy : 0.0009365081787109375 nb_pixel_total : 39132 time to create 1 rle with old method : 0.04648327827453613 length of segment : 302 time for calcul the mask position with numpy : 0.0024797916412353516 nb_pixel_total : 48543 time to create 1 rle with old method : 0.07466316223144531 length of segment : 472 time for calcul the mask position with numpy : 0.0010318756103515625 nb_pixel_total : 20395 time to create 1 rle with old method : 0.023693561553955078 length of segment : 269 time for calcul the mask position with numpy : 0.00011944770812988281 nb_pixel_total : 2296 time to create 1 rle with old method : 0.002851724624633789 length of segment : 45 time for calcul the mask position with numpy : 0.0003871917724609375 nb_pixel_total : 13119 time to create 1 rle with old method : 0.015604019165039062 length of segment : 104 time for calcul the mask position with numpy : 0.0012509822845458984 nb_pixel_total : 48039 time to create 1 rle with old method : 0.05547165870666504 length of segment : 255 time for calcul the mask position with numpy : 0.0003554821014404297 nb_pixel_total : 8018 time to create 1 rle with old method : 0.009662866592407227 length of segment : 162 time for calcul the mask position with numpy : 0.00015163421630859375 nb_pixel_total : 4262 time to create 1 rle with old method : 0.005074262619018555 length of segment : 93 time for calcul the mask position with numpy : 0.0008897781372070312 nb_pixel_total : 31977 time to create 1 rle with old method : 0.03701448440551758 length of segment : 293 time for calcul the mask position with numpy : 0.0012552738189697266 nb_pixel_total : 49850 time to create 1 rle with old method : 0.05635881423950195 length of segment : 384 time for calcul the mask position with numpy : 0.0012667179107666016 nb_pixel_total : 40774 time to create 1 rle with old method : 0.04686141014099121 length of segment : 385 time for calcul the mask position with numpy : 0.00030612945556640625 nb_pixel_total : 8573 time to create 1 rle with old method : 0.009939432144165039 length of segment : 123 time for calcul the mask position with numpy : 0.0008025169372558594 nb_pixel_total : 30147 time to create 1 rle with old method : 0.03481245040893555 length of segment : 230 time for calcul the mask position with numpy : 0.002337217330932617 nb_pixel_total : 113729 time to create 1 rle with old method : 0.13405656814575195 length of segment : 420 time for calcul the mask position with numpy : 0.0008950233459472656 nb_pixel_total : 14920 time to create 1 rle with old method : 0.017345905303955078 length of segment : 204 time for calcul the mask position with numpy : 0.00026679039001464844 nb_pixel_total : 8356 time to create 1 rle with old method : 0.009919166564941406 length of segment : 120 time for calcul the mask position with numpy : 0.00069427490234375 nb_pixel_total : 21949 time to create 1 rle with old method : 0.025569677352905273 length of segment : 217 time for calcul the mask position with numpy : 0.0009605884552001953 nb_pixel_total : 43061 time to create 1 rle with old method : 0.049970149993896484 length of segment : 214 time for calcul the mask position with numpy : 0.0019600391387939453 nb_pixel_total : 79771 time to create 1 rle with old method : 0.1070261001586914 length of segment : 436 time for calcul the mask position with numpy : 0.0007088184356689453 nb_pixel_total : 16294 time to create 1 rle with old method : 0.019107580184936523 length of segment : 147 time for calcul the mask position with numpy : 0.0004897117614746094 nb_pixel_total : 14492 time to create 1 rle with old method : 0.01712775230407715 length of segment : 135 time for calcul the mask position with numpy : 0.0003268718719482422 nb_pixel_total : 10237 time to create 1 rle with old method : 0.012222766876220703 length of segment : 105 time for calcul the mask position with numpy : 0.0009717941284179688 nb_pixel_total : 28716 time to create 1 rle with old method : 0.041388750076293945 length of segment : 215 time for calcul the mask position with numpy : 0.0018620491027832031 nb_pixel_total : 41796 time to create 1 rle with old method : 0.04774117469787598 length of segment : 381 time for calcul the mask position with numpy : 0.0006566047668457031 nb_pixel_total : 9836 time to create 1 rle with old method : 0.011502981185913086 length of segment : 212 time for calcul the mask position with numpy : 0.0007131099700927734 nb_pixel_total : 30209 time to create 1 rle with old method : 0.03831934928894043 length of segment : 231 time for calcul the mask position with numpy : 0.0007033348083496094 nb_pixel_total : 22694 time to create 1 rle with old method : 0.026292085647583008 length of segment : 169 time for calcul the mask position with numpy : 0.00048804283142089844 nb_pixel_total : 17568 time to create 1 rle with old method : 0.021944761276245117 length of segment : 143 time for calcul the mask position with numpy : 0.000347137451171875 nb_pixel_total : 11816 time to create 1 rle with old method : 0.013868331909179688 length of segment : 139 time for calcul the mask position with numpy : 0.00047469139099121094 nb_pixel_total : 16652 time to create 1 rle with old method : 0.019432544708251953 length of segment : 104 time for calcul the mask position with numpy : 0.0007669925689697266 nb_pixel_total : 24475 time to create 1 rle with old method : 0.04174208641052246 length of segment : 135 time for calcul the mask position with numpy : 0.0011744499206542969 nb_pixel_total : 36489 time to create 1 rle with old method : 0.06529569625854492 length of segment : 307 time for calcul the mask position with numpy : 0.001216888427734375 nb_pixel_total : 20545 time to create 1 rle with old method : 0.02364826202392578 length of segment : 277 time for calcul the mask position with numpy : 0.0010876655578613281 nb_pixel_total : 50418 time to create 1 rle with old method : 0.060175418853759766 length of segment : 192 time for calcul the mask position with numpy : 0.00102996826171875 nb_pixel_total : 36581 time to create 1 rle with old method : 0.05268979072570801 length of segment : 229 time for calcul the mask position with numpy : 0.00036835670471191406 nb_pixel_total : 11526 time to create 1 rle with old method : 0.013550519943237305 length of segment : 93 time for calcul the mask position with numpy : 0.0006344318389892578 nb_pixel_total : 17279 time to create 1 rle with old method : 0.02042675018310547 length of segment : 170 time for calcul the mask position with numpy : 0.0010623931884765625 nb_pixel_total : 33602 time to create 1 rle with old method : 0.039673805236816406 length of segment : 309 time for calcul the mask position with numpy : 0.0010695457458496094 nb_pixel_total : 25643 time to create 1 rle with old method : 0.04178905487060547 length of segment : 194 time for calcul the mask position with numpy : 0.0011425018310546875 nb_pixel_total : 34973 time to create 1 rle with old method : 0.05473041534423828 length of segment : 259 time for calcul the mask position with numpy : 0.0003070831298828125 nb_pixel_total : 9579 time to create 1 rle with old method : 0.01329183578491211 length of segment : 71 time for calcul the mask position with numpy : 0.0026001930236816406 nb_pixel_total : 118241 time to create 1 rle with old method : 0.14071083068847656 length of segment : 463 time for calcul the mask position with numpy : 0.0046923160552978516 nb_pixel_total : 135752 time to create 1 rle with old method : 0.16066670417785645 length of segment : 610 time for calcul the mask position with numpy : 0.0008366107940673828 nb_pixel_total : 26060 time to create 1 rle with old method : 0.030253171920776367 length of segment : 214 time for calcul the mask position with numpy : 0.001142263412475586 nb_pixel_total : 40321 time to create 1 rle with old method : 0.0494844913482666 length of segment : 243 time for calcul the mask position with numpy : 0.00046133995056152344 nb_pixel_total : 17167 time to create 1 rle with old method : 0.020000696182250977 length of segment : 155 time for calcul the mask position with numpy : 0.0002799034118652344 nb_pixel_total : 8383 time to create 1 rle with old method : 0.009813070297241211 length of segment : 147 time for calcul the mask position with numpy : 0.0005171298980712891 nb_pixel_total : 17367 time to create 1 rle with old method : 0.02185678482055664 length of segment : 112 time for calcul the mask position with numpy : 0.001336812973022461 nb_pixel_total : 9483 time to create 1 rle with old method : 0.01624917984008789 length of segment : 222 time for calcul the mask position with numpy : 0.000835418701171875 nb_pixel_total : 18347 time to create 1 rle with old method : 0.025431156158447266 length of segment : 206 time for calcul the mask position with numpy : 0.0015320777893066406 nb_pixel_total : 29638 time to create 1 rle with old method : 0.034644126892089844 length of segment : 212 time for calcul the mask position with numpy : 0.0005218982696533203 nb_pixel_total : 27518 time to create 1 rle with old method : 0.0326390266418457 length of segment : 114 time for calcul the mask position with numpy : 0.0037665367126464844 nb_pixel_total : 144644 time to create 1 rle with old method : 0.18598437309265137 length of segment : 553 time for calcul the mask position with numpy : 0.004262208938598633 nb_pixel_total : 153104 time to create 1 rle with new method : 0.019241809844970703 length of segment : 906 time for calcul the mask position with numpy : 0.01974797248840332 nb_pixel_total : 362759 time to create 1 rle with new method : 0.1891160011291504 length of segment : 2242 time for calcul the mask position with numpy : 0.0029973983764648438 nb_pixel_total : 102776 time to create 1 rle with old method : 0.11770987510681152 length of segment : 507 time for calcul the mask position with numpy : 0.000606536865234375 nb_pixel_total : 19655 time to create 1 rle with old method : 0.02290034294128418 length of segment : 138 time for calcul the mask position with numpy : 0.0022983551025390625 nb_pixel_total : 115719 time to create 1 rle with old method : 0.1301865577697754 length of segment : 305 time for calcul the mask position with numpy : 0.003362894058227539 nb_pixel_total : 157658 time to create 1 rle with new method : 0.009793758392333984 length of segment : 614 time for calcul the mask position with numpy : 0.0006411075592041016 nb_pixel_total : 25557 time to create 1 rle with old method : 0.029701709747314453 length of segment : 208 time for calcul the mask position with numpy : 0.004975795745849609 nb_pixel_total : 171068 time to create 1 rle with new method : 0.016450166702270508 length of segment : 713 time for calcul the mask position with numpy : 0.000720977783203125 nb_pixel_total : 23285 time to create 1 rle with old method : 0.026751279830932617 length of segment : 187 time for calcul the mask position with numpy : 0.00034356117248535156 nb_pixel_total : 11160 time to create 1 rle with old method : 0.013733625411987305 length of segment : 80 time for calcul the mask position with numpy : 0.0025696754455566406 nb_pixel_total : 84156 time to create 1 rle with old method : 0.09763455390930176 length of segment : 358 time for calcul the mask position with numpy : 0.0007431507110595703 nb_pixel_total : 31903 time to create 1 rle with old method : 0.036501407623291016 length of segment : 162 time for calcul the mask position with numpy : 0.05611777305603027 nb_pixel_total : 789969 time to create 1 rle with new method : 0.08771181106567383 length of segment : 1426 time for calcul the mask position with numpy : 0.0007026195526123047 nb_pixel_total : 19604 time to create 1 rle with old method : 0.022580623626708984 length of segment : 231 time for calcul the mask position with numpy : 0.0067632198333740234 nb_pixel_total : 93023 time to create 1 rle with old method : 0.11560678482055664 length of segment : 354 time for calcul the mask position with numpy : 0.013039827346801758 nb_pixel_total : 321551 time to create 1 rle with new method : 0.06840300559997559 length of segment : 1127 time for calcul the mask position with numpy : 0.0004425048828125 nb_pixel_total : 18790 time to create 1 rle with old method : 0.023185253143310547 length of segment : 146 time for calcul the mask position with numpy : 0.0008730888366699219 nb_pixel_total : 49791 time to create 1 rle with old method : 0.06066393852233887 length of segment : 268 time for calcul the mask position with numpy : 0.0024137496948242188 nb_pixel_total : 78885 time to create 1 rle with old method : 0.08922767639160156 length of segment : 449 time for calcul the mask position with numpy : 0.000690460205078125 nb_pixel_total : 32400 time to create 1 rle with old method : 0.036969661712646484 length of segment : 254 time for calcul the mask position with numpy : 0.0010471343994140625 nb_pixel_total : 34311 time to create 1 rle with old method : 0.0395512580871582 length of segment : 501 time for calcul the mask position with numpy : 0.017058372497558594 nb_pixel_total : 339488 time to create 1 rle with new method : 0.5322935581207275 length of segment : 1307 time for calcul the mask position with numpy : 0.014143705368041992 nb_pixel_total : 719005 time to create 1 rle with new method : 0.07180428504943848 length of segment : 1036 time for calcul the mask position with numpy : 0.004516124725341797 nb_pixel_total : 61623 time to create 1 rle with old method : 0.06928658485412598 length of segment : 379 time for calcul the mask position with numpy : 0.0012679100036621094 nb_pixel_total : 23729 time to create 1 rle with old method : 0.028905153274536133 length of segment : 193 time for calcul the mask position with numpy : 0.0010371208190917969 nb_pixel_total : 31747 time to create 1 rle with old method : 0.03718852996826172 length of segment : 282 time for calcul the mask position with numpy : 0.006983280181884766 nb_pixel_total : 189419 time to create 1 rle with new method : 0.011720418930053711 length of segment : 907 time for calcul the mask position with numpy : 0.004297971725463867 nb_pixel_total : 135527 time to create 1 rle with old method : 0.15058326721191406 length of segment : 290 time for calcul the mask position with numpy : 0.002627134323120117 nb_pixel_total : 57079 time to create 1 rle with old method : 0.06298637390136719 length of segment : 318 time for calcul the mask position with numpy : 0.00020051002502441406 nb_pixel_total : 3193 time to create 1 rle with old method : 0.003889799118041992 length of segment : 63 time for calcul the mask position with numpy : 0.0018820762634277344 nb_pixel_total : 45914 time to create 1 rle with old method : 0.052423954010009766 length of segment : 347 time for calcul the mask position with numpy : 0.02972722053527832 nb_pixel_total : 484931 time to create 1 rle with new method : 0.0712428092956543 length of segment : 1030 time spent for convertir_results : 20.66415500640869 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 204 chid ids of type : 3594 Number RLEs to save : 57624 save missing photos in datou_result : time spend for datou_step_exec : 131.8087043762207 time spend to save output : 3.3516125679016113 total time spend for step 1 : 135.16031694412231 step2:crop_condition Tue Apr 15 22:32:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 204 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 161 About to insert : list_path_to_insert length 161 new photo from crops ! About to upload 161 photos upload in portfolio : 3736932 init cache_photo without model_param we have 161 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744749209_1571853 we have uploaded 161 photos in the portfolio 3736932 time of upload the photos Elapsed time : 41.188279151916504 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 32 About to insert : list_path_to_insert length 32 new photo from crops ! About to upload 32 photos upload in portfolio : 3736932 init cache_photo without model_param we have 32 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744749258_1571853 we have uploaded 32 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.769243240356445 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744749270_1571853 we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.657757759094238 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744749277_1571853 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8057494163513184 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744749279_1571853 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7892751693725586 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1350010093, 1350009993, 1350009959, 1350009930, 1350009729, 1350009703, 1350009682, 1350009675, 1350009123] Looping around the photos to save general results len do output : 204 /1350044954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350044997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350045749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350010093', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009993', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009959', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009930', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009729', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009703', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009682', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009675', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009123', None, None, None, None, None, '2723665') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 621 time used for this insertion : 0.034888267517089844 save_final save missing photos in datou_result : time spend for datou_step_exec : 114.92334794998169 time spend to save output : 0.13237881660461426 total time spend for step 2 : 115.0557267665863 step3:rle_unique_nms_with_priority Tue Apr 15 22:34:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 204 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 10.158177852630615 time for calcul the mask position with numpy : 0.781477689743042 nb_pixel_total : 6127403 time to create 1 rle with new method : 0.4874844551086426 time for calcul the mask position with numpy : 0.02765488624572754 nb_pixel_total : 119930 time to create 1 rle with old method : 0.13901019096374512 time for calcul the mask position with numpy : 0.02621150016784668 nb_pixel_total : 14659 time to create 1 rle with old method : 0.018113374710083008 time for calcul the mask position with numpy : 0.025414466857910156 nb_pixel_total : 5715 time to create 1 rle with old method : 0.007086992263793945 time for calcul the mask position with numpy : 0.025314807891845703 nb_pixel_total : 313764 time to create 1 rle with new method : 0.918689489364624 time for calcul the mask position with numpy : 0.029353618621826172 nb_pixel_total : 26835 time to create 1 rle with old method : 0.03131866455078125 time for calcul the mask position with numpy : 0.026206016540527344 nb_pixel_total : 15085 time to create 1 rle with old method : 0.01689910888671875 time for calcul the mask position with numpy : 0.03464961051940918 nb_pixel_total : 30281 time to create 1 rle with old method : 0.035152435302734375 time for calcul the mask position with numpy : 0.03566241264343262 nb_pixel_total : 26050 time to create 1 rle with old method : 0.03743124008178711 time for calcul the mask position with numpy : 0.024595975875854492 nb_pixel_total : 10130 time to create 1 rle with old method : 0.016651391983032227 time for calcul the mask position with numpy : 0.02353501319885254 nb_pixel_total : 78336 time to create 1 rle with old method : 0.0940713882446289 time for calcul the mask position with numpy : 0.02305293083190918 nb_pixel_total : 9904 time to create 1 rle with old method : 0.012939929962158203 time for calcul the mask position with numpy : 0.02650761604309082 nb_pixel_total : 32337 time to create 1 rle with old method : 0.03946423530578613 time for calcul the mask position with numpy : 0.02345728874206543 nb_pixel_total : 4585 time to create 1 rle with old method : 0.005150794982910156 time for calcul the mask position with numpy : 0.023091793060302734 nb_pixel_total : 27222 time to create 1 rle with old method : 0.03390359878540039 time for calcul the mask position with numpy : 0.023893117904663086 nb_pixel_total : 107626 time to create 1 rle with old method : 0.12076020240783691 time for calcul the mask position with numpy : 0.022315025329589844 nb_pixel_total : 11188 time to create 1 rle with old method : 0.01261448860168457 time for calcul the mask position with numpy : 0.022794246673583984 nb_pixel_total : 12986 time to create 1 rle with old method : 0.014525890350341797 time for calcul the mask position with numpy : 0.022922754287719727 nb_pixel_total : 29269 time to create 1 rle with old method : 0.032483816146850586 time for calcul the mask position with numpy : 0.024283170700073242 nb_pixel_total : 46935 time to create 1 rle with old method : 0.06053471565246582 create new chi : 3.4781134128570557 time to delete rle : 0.024848222732543945 batch 1 Loaded 40 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 11497 TO DO : save crop sub photo not yet done ! save time : 0.7051393985748291 nb_obj : 20 nb_hashtags : 2 time to prepare the origin masks : 7.2365806102752686 time for calcul the mask position with numpy : 0.5956578254699707 nb_pixel_total : 6099487 time to create 1 rle with new method : 0.668942928314209 time for calcul the mask position with numpy : 0.03980875015258789 nb_pixel_total : 1490 time to create 1 rle with old method : 0.002142667770385742 time for calcul the mask position with numpy : 0.04274296760559082 nb_pixel_total : 24904 time to create 1 rle with old method : 0.028104066848754883 time for calcul the mask position with numpy : 0.03855633735656738 nb_pixel_total : 57800 time to create 1 rle with old method : 0.06500601768493652 time for calcul the mask position with numpy : 0.0364842414855957 nb_pixel_total : 575 time to create 1 rle with old method : 0.0009236335754394531 time for calcul the mask position with numpy : 0.03645777702331543 nb_pixel_total : 27594 time to create 1 rle with old method : 0.031239032745361328 time for calcul the mask position with numpy : 0.037509918212890625 nb_pixel_total : 15067 time to create 1 rle with old method : 0.01711559295654297 time for calcul the mask position with numpy : 0.040935516357421875 nb_pixel_total : 287735 time to create 1 rle with new method : 1.2753198146820068 time for calcul the mask position with numpy : 0.04008293151855469 nb_pixel_total : 9587 time to create 1 rle with old method : 0.010943174362182617 time for calcul the mask position with numpy : 0.0377194881439209 nb_pixel_total : 4126 time to create 1 rle with old method : 0.004724740982055664 time for calcul the mask position with numpy : 0.03668475151062012 nb_pixel_total : 124194 time to create 1 rle with old method : 0.13889193534851074 time for calcul the mask position with numpy : 0.04331207275390625 nb_pixel_total : 35265 time to create 1 rle with old method : 0.03995251655578613 time for calcul the mask position with numpy : 0.03649640083312988 nb_pixel_total : 4981 time to create 1 rle with old method : 0.005654573440551758 time for calcul the mask position with numpy : 0.02513718605041504 nb_pixel_total : 29992 time to create 1 rle with old method : 0.03576207160949707 time for calcul the mask position with numpy : 0.024344444274902344 nb_pixel_total : 75867 time to create 1 rle with old method : 0.0946190357208252 time for calcul the mask position with numpy : 0.026758670806884766 nb_pixel_total : 13244 time to create 1 rle with old method : 0.017679452896118164 time for calcul the mask position with numpy : 0.027886152267456055 nb_pixel_total : 102267 time to create 1 rle with old method : 0.13611197471618652 time for calcul the mask position with numpy : 0.026221752166748047 nb_pixel_total : 32538 time to create 1 rle with old method : 0.0394740104675293 time for calcul the mask position with numpy : 0.029129505157470703 nb_pixel_total : 29198 time to create 1 rle with old method : 0.033889055252075195 time for calcul the mask position with numpy : 0.024391651153564453 nb_pixel_total : 27464 time to create 1 rle with old method : 0.031334877014160156 time for calcul the mask position with numpy : 0.02311849594116211 nb_pixel_total : 46865 time to create 1 rle with old method : 0.059682369232177734 create new chi : 4.081307649612427 time to delete rle : 0.0036840438842773438 batch 1 Loaded 41 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 12598 TO DO : save crop sub photo not yet done ! save time : 0.8087921142578125 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 3.689692497253418 time for calcul the mask position with numpy : 0.6021652221679688 nb_pixel_total : 6981792 time to create 1 rle with new method : 0.9966096878051758 time for calcul the mask position with numpy : 0.021983861923217773 nb_pixel_total : 9242 time to create 1 rle with old method : 0.010542154312133789 time for calcul the mask position with numpy : 0.02257061004638672 nb_pixel_total : 48160 time to create 1 rle with old method : 0.0536651611328125 time for calcul the mask position with numpy : 0.02266550064086914 nb_pixel_total : 11046 time to create 1 rle with old method : 0.01299285888671875 create new chi : 1.784045696258545 time to delete rle : 0.0006570816040039062 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3570 TO DO : save crop sub photo not yet done ! save time : 0.25817108154296875 nb_obj : 29 nb_hashtags : 3 time to prepare the origin masks : 4.000613451004028 time for calcul the mask position with numpy : 0.24592852592468262 nb_pixel_total : 5883701 time to create 1 rle with new method : 1.1978044509887695 time for calcul the mask position with numpy : 0.032876014709472656 nb_pixel_total : 27323 time to create 1 rle with old method : 0.03127551078796387 time for calcul the mask position with numpy : 0.02915811538696289 nb_pixel_total : 21340 time to create 1 rle with old method : 0.02393937110900879 time for calcul the mask position with numpy : 0.029651641845703125 nb_pixel_total : 18075 time to create 1 rle with old method : 0.02023601531982422 time for calcul the mask position with numpy : 0.03312253952026367 nb_pixel_total : 18913 time to create 1 rle with old method : 0.03060317039489746 time for calcul the mask position with numpy : 0.03322863578796387 nb_pixel_total : 10894 time to create 1 rle with old method : 0.012477636337280273 time for calcul the mask position with numpy : 0.02920675277709961 nb_pixel_total : 20020 time to create 1 rle with old method : 0.022708654403686523 time for calcul the mask position with numpy : 0.02962946891784668 nb_pixel_total : 34425 time to create 1 rle with old method : 0.04029226303100586 time for calcul the mask position with numpy : 0.029136180877685547 nb_pixel_total : 5710 time to create 1 rle with old method : 0.0064449310302734375 time for calcul the mask position with numpy : 0.02892279624938965 nb_pixel_total : 36732 time to create 1 rle with old method : 0.041550397872924805 time for calcul the mask position with numpy : 0.030072689056396484 nb_pixel_total : 12240 time to create 1 rle with old method : 0.013902902603149414 time for calcul the mask position with numpy : 0.03013014793395996 nb_pixel_total : 36619 time to create 1 rle with old method : 0.04258847236633301 time for calcul the mask position with numpy : 0.03066539764404297 nb_pixel_total : 17601 time to create 1 rle with old method : 0.01992654800415039 time for calcul the mask position with numpy : 0.02959465980529785 nb_pixel_total : 32772 time to create 1 rle with old method : 0.05338144302368164 time for calcul the mask position with numpy : 0.033745765686035156 nb_pixel_total : 218260 time to create 1 rle with new method : 1.0165421962738037 time for calcul the mask position with numpy : 0.031828880310058594 nb_pixel_total : 19669 time to create 1 rle with old method : 0.02519392967224121 time for calcul the mask position with numpy : 0.030257463455200195 nb_pixel_total : 21024 time to create 1 rle with old method : 0.024539709091186523 time for calcul the mask position with numpy : 0.03233957290649414 nb_pixel_total : 28365 time to create 1 rle with old method : 0.033553123474121094 time for calcul the mask position with numpy : 0.02920222282409668 nb_pixel_total : 6893 time to create 1 rle with old method : 0.007816076278686523 time for calcul the mask position with numpy : 0.029484033584594727 nb_pixel_total : 27867 time to create 1 rle with old method : 0.031044721603393555 time for calcul the mask position with numpy : 0.029065370559692383 nb_pixel_total : 8324 time to create 1 rle with old method : 0.009411334991455078 time for calcul the mask position with numpy : 0.029241323471069336 nb_pixel_total : 12919 time to create 1 rle with old method : 0.014595270156860352 time for calcul the mask position with numpy : 0.031710147857666016 nb_pixel_total : 273918 time to create 1 rle with new method : 0.6299638748168945 time for calcul the mask position with numpy : 0.028601884841918945 nb_pixel_total : 15578 time to create 1 rle with old method : 0.01711297035217285 time for calcul the mask position with numpy : 0.029088497161865234 nb_pixel_total : 39023 time to create 1 rle with old method : 0.042137861251831055 time for calcul the mask position with numpy : 0.032553911209106445 nb_pixel_total : 128161 time to create 1 rle with old method : 0.16554880142211914 time for calcul the mask position with numpy : 0.0308077335357666 nb_pixel_total : 34697 time to create 1 rle with old method : 0.038469791412353516 time for calcul the mask position with numpy : 0.028133869171142578 nb_pixel_total : 752 time to create 1 rle with old method : 0.0010170936584472656 time for calcul the mask position with numpy : 0.030762910842895508 nb_pixel_total : 20932 time to create 1 rle with old method : 0.02368307113647461 time for calcul the mask position with numpy : 0.030520200729370117 nb_pixel_total : 17493 time to create 1 rle with old method : 0.020154953002929688 create new chi : 4.881727457046509 time to delete rle : 0.002594470977783203 batch 1 Loaded 59 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 15926 TO DO : save crop sub photo not yet done ! save time : 0.9738724231719971 nb_obj : 27 nb_hashtags : 4 time to prepare the origin masks : 4.066960573196411 time for calcul the mask position with numpy : 1.1766915321350098 nb_pixel_total : 6263732 time to create 1 rle with new method : 1.0489888191223145 time for calcul the mask position with numpy : 0.03142714500427246 nb_pixel_total : 11331 time to create 1 rle with old method : 0.013536691665649414 time for calcul the mask position with numpy : 0.03157806396484375 nb_pixel_total : 42528 time to create 1 rle with old method : 0.061347007751464844 time for calcul the mask position with numpy : 0.03388714790344238 nb_pixel_total : 105 time to create 1 rle with old method : 0.0006890296936035156 time for calcul the mask position with numpy : 0.03159284591674805 nb_pixel_total : 9774 time to create 1 rle with old method : 0.011011838912963867 time for calcul the mask position with numpy : 0.0295107364654541 nb_pixel_total : 16827 time to create 1 rle with old method : 0.0188906192779541 time for calcul the mask position with numpy : 0.02971363067626953 nb_pixel_total : 9524 time to create 1 rle with old method : 0.010915279388427734 time for calcul the mask position with numpy : 0.030193328857421875 nb_pixel_total : 28529 time to create 1 rle with old method : 0.032732248306274414 time for calcul the mask position with numpy : 0.029964923858642578 nb_pixel_total : 13043 time to create 1 rle with old method : 0.01498723030090332 time for calcul the mask position with numpy : 0.02951192855834961 nb_pixel_total : 29293 time to create 1 rle with old method : 0.03284788131713867 time for calcul the mask position with numpy : 0.02983403205871582 nb_pixel_total : 65892 time to create 1 rle with old method : 0.0740501880645752 time for calcul the mask position with numpy : 0.030692338943481445 nb_pixel_total : 4239 time to create 1 rle with old method : 0.004877567291259766 time for calcul the mask position with numpy : 0.029619932174682617 nb_pixel_total : 5674 time to create 1 rle with old method : 0.006479740142822266 time for calcul the mask position with numpy : 0.029933691024780273 nb_pixel_total : 22457 time to create 1 rle with old method : 0.025236129760742188 time for calcul the mask position with numpy : 0.029438257217407227 nb_pixel_total : 4452 time to create 1 rle with old method : 0.0049936771392822266 time for calcul the mask position with numpy : 0.029740333557128906 nb_pixel_total : 21216 time to create 1 rle with old method : 0.023451566696166992 time for calcul the mask position with numpy : 0.029727935791015625 nb_pixel_total : 52644 time to create 1 rle with old method : 0.05831027030944824 time for calcul the mask position with numpy : 0.029842138290405273 nb_pixel_total : 62296 time to create 1 rle with old method : 0.0688474178314209 time for calcul the mask position with numpy : 0.0294802188873291 nb_pixel_total : 26583 time to create 1 rle with old method : 0.02967381477355957 time for calcul the mask position with numpy : 0.028546810150146484 nb_pixel_total : 16887 time to create 1 rle with old method : 0.01864147186279297 time for calcul the mask position with numpy : 0.028717517852783203 nb_pixel_total : 4758 time to create 1 rle with old method : 0.005273580551147461 time for calcul the mask position with numpy : 0.028834819793701172 nb_pixel_total : 28235 time to create 1 rle with old method : 0.0312504768371582 time for calcul the mask position with numpy : 0.028446197509765625 nb_pixel_total : 10916 time to create 1 rle with old method : 0.012288331985473633 time for calcul the mask position with numpy : 0.030821561813354492 nb_pixel_total : 15195 time to create 1 rle with old method : 0.01771855354309082 time for calcul the mask position with numpy : 0.03293752670288086 nb_pixel_total : 139034 time to create 1 rle with old method : 0.17211580276489258 time for calcul the mask position with numpy : 0.028611421585083008 nb_pixel_total : 19204 time to create 1 rle with old method : 0.02089238166809082 time for calcul the mask position with numpy : 0.028433561325073242 nb_pixel_total : 42614 time to create 1 rle with old method : 0.04661130905151367 time for calcul the mask position with numpy : 0.02939605712890625 nb_pixel_total : 83258 time to create 1 rle with old method : 0.09835934638977051 create new chi : 4.001424074172974 time to delete rle : 0.0022225379943847656 batch 1 Loaded 55 chid ids of type : 3594 +++++++++++++++++++++++++++++++++Number RLEs to save : 12353 TO DO : save crop sub photo not yet done ! save time : 0.7398412227630615 nb_obj : 36 nb_hashtags : 3 time to prepare the origin masks : 4.023360967636108 time for calcul the mask position with numpy : 0.6985714435577393 nb_pixel_total : 6056590 time to create 1 rle with new method : 0.4934718608856201 time for calcul the mask position with numpy : 0.029251575469970703 nb_pixel_total : 43778 time to create 1 rle with old method : 0.048010826110839844 time for calcul the mask position with numpy : 0.028560400009155273 nb_pixel_total : 7603 time to create 1 rle with old method : 0.008281946182250977 time for calcul the mask position with numpy : 0.029374361038208008 nb_pixel_total : 25446 time to create 1 rle with old method : 0.028487443923950195 time for calcul the mask position with numpy : 0.02842545509338379 nb_pixel_total : 1315 time to create 1 rle with old method : 0.001432180404663086 time for calcul the mask position with numpy : 0.02812933921813965 nb_pixel_total : 10455 time to create 1 rle with old method : 0.011550426483154297 time for calcul the mask position with numpy : 0.0281374454498291 nb_pixel_total : 43691 time to create 1 rle with old method : 0.04767870903015137 time for calcul the mask position with numpy : 0.028688669204711914 nb_pixel_total : 48039 time to create 1 rle with old method : 0.053931474685668945 time for calcul the mask position with numpy : 0.02886652946472168 nb_pixel_total : 13119 time to create 1 rle with old method : 0.014759540557861328 time for calcul the mask position with numpy : 0.029523849487304688 nb_pixel_total : 38017 time to create 1 rle with old method : 0.042467594146728516 time for calcul the mask position with numpy : 0.029163837432861328 nb_pixel_total : 40774 time to create 1 rle with old method : 0.04554867744445801 time for calcul the mask position with numpy : 0.029207229614257812 nb_pixel_total : 20395 time to create 1 rle with old method : 0.02272510528564453 time for calcul the mask position with numpy : 0.029240131378173828 nb_pixel_total : 31977 time to create 1 rle with old method : 0.035566091537475586 time for calcul the mask position with numpy : 0.02915215492248535 nb_pixel_total : 8573 time to create 1 rle with old method : 0.009635686874389648 time for calcul the mask position with numpy : 0.029347896575927734 nb_pixel_total : 46336 time to create 1 rle with old method : 0.05167746543884277 time for calcul the mask position with numpy : 0.028775453567504883 nb_pixel_total : 17946 time to create 1 rle with old method : 0.0201416015625 time for calcul the mask position with numpy : 0.02888774871826172 nb_pixel_total : 8356 time to create 1 rle with old method : 0.00928044319152832 time for calcul the mask position with numpy : 0.028925418853759766 nb_pixel_total : 21474 time to create 1 rle with old method : 0.02394390106201172 time for calcul the mask position with numpy : 0.029067277908325195 nb_pixel_total : 15197 time to create 1 rle with old method : 0.0179746150970459 time for calcul the mask position with numpy : 0.0289306640625 nb_pixel_total : 39132 time to create 1 rle with old method : 0.04259085655212402 time for calcul the mask position with numpy : 0.0289461612701416 nb_pixel_total : 16743 time to create 1 rle with old method : 0.01858973503112793 time for calcul the mask position with numpy : 0.029247283935546875 nb_pixel_total : 14920 time to create 1 rle with old method : 0.016588449478149414 time for calcul the mask position with numpy : 0.028738737106323242 nb_pixel_total : 23022 time to create 1 rle with old method : 0.025665760040283203 time for calcul the mask position with numpy : 0.03488755226135254 nb_pixel_total : 6457 time to create 1 rle with old method : 0.0072286128997802734 time for calcul the mask position with numpy : 0.029171228408813477 nb_pixel_total : 42365 time to create 1 rle with old method : 0.04750704765319824 time for calcul the mask position with numpy : 0.03000187873840332 nb_pixel_total : 49850 time to create 1 rle with old method : 0.05589485168457031 time for calcul the mask position with numpy : 0.02932596206665039 nb_pixel_total : 35460 time to create 1 rle with old method : 0.0396573543548584 time for calcul the mask position with numpy : 0.029085397720336914 nb_pixel_total : 3637 time to create 1 rle with old method : 0.00411224365234375 time for calcul the mask position with numpy : 0.029245853424072266 nb_pixel_total : 8982 time to create 1 rle with old method : 0.010139226913452148 time for calcul the mask position with numpy : 0.02933955192565918 nb_pixel_total : 67189 time to create 1 rle with old method : 0.07528352737426758 time for calcul the mask position with numpy : 0.02975606918334961 nb_pixel_total : 108769 time to create 1 rle with old method : 0.1204521656036377 time for calcul the mask position with numpy : 0.029276371002197266 nb_pixel_total : 8018 time to create 1 rle with old method : 0.009168624877929688 time for calcul the mask position with numpy : 0.029762744903564453 nb_pixel_total : 11397 time to create 1 rle with old method : 0.013591527938842773 time for calcul the mask position with numpy : 0.030499935150146484 nb_pixel_total : 72974 time to create 1 rle with old method : 0.10101675987243652 time for calcul the mask position with numpy : 0.03238105773925781 nb_pixel_total : 4262 time to create 1 rle with old method : 0.004878997802734375 time for calcul the mask position with numpy : 0.028908491134643555 nb_pixel_total : 7835 time to create 1 rle with old method : 0.00889897346496582 time for calcul the mask position with numpy : 0.0292510986328125 nb_pixel_total : 30147 time to create 1 rle with old method : 0.04828929901123047 create new chi : 3.4309966564178467 time to delete rle : 0.003825664520263672 batch 1 Loaded 73 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 18223 TO DO : save crop sub photo not yet done ! save time : 1.0590386390686035 nb_obj : 35 nb_hashtags : 3 time to prepare the origin masks : 3.8976821899414062 time for calcul the mask position with numpy : 0.684025764465332 nb_pixel_total : 5964727 time to create 1 rle with new method : 1.1766695976257324 time for calcul the mask position with numpy : 0.02854132652282715 nb_pixel_total : 9836 time to create 1 rle with old method : 0.010917425155639648 time for calcul the mask position with numpy : 0.028522014617919922 nb_pixel_total : 17279 time to create 1 rle with old method : 0.018800020217895508 time for calcul the mask position with numpy : 0.028278112411499023 nb_pixel_total : 10237 time to create 1 rle with old method : 0.010905027389526367 time for calcul the mask position with numpy : 0.02853560447692871 nb_pixel_total : 17568 time to create 1 rle with old method : 0.01988673210144043 time for calcul the mask position with numpy : 0.02836751937866211 nb_pixel_total : 17167 time to create 1 rle with old method : 0.019222736358642578 time for calcul the mask position with numpy : 0.028984546661376953 nb_pixel_total : 11816 time to create 1 rle with old method : 0.013292074203491211 time for calcul the mask position with numpy : 0.02884507179260254 nb_pixel_total : 41796 time to create 1 rle with old method : 0.04641461372375488 time for calcul the mask position with numpy : 0.028865575790405273 nb_pixel_total : 26060 time to create 1 rle with old method : 0.029242992401123047 time for calcul the mask position with numpy : 0.02908468246459961 nb_pixel_total : 17367 time to create 1 rle with old method : 0.01961064338684082 time for calcul the mask position with numpy : 0.028796911239624023 nb_pixel_total : 11468 time to create 1 rle with old method : 0.013111591339111328 time for calcul the mask position with numpy : 0.029172182083129883 nb_pixel_total : 16294 time to create 1 rle with old method : 0.018474102020263672 time for calcul the mask position with numpy : 0.031748294830322266 nb_pixel_total : 135087 time to create 1 rle with old method : 0.15006089210510254 time for calcul the mask position with numpy : 0.029378890991210938 nb_pixel_total : 15957 time to create 1 rle with old method : 0.017943143844604492 time for calcul the mask position with numpy : 0.030997276306152344 nb_pixel_total : 20545 time to create 1 rle with old method : 0.023206233978271484 time for calcul the mask position with numpy : 0.029205322265625 nb_pixel_total : 25643 time to create 1 rle with old method : 0.028626680374145508 time for calcul the mask position with numpy : 0.029159069061279297 nb_pixel_total : 40321 time to create 1 rle with old method : 0.04524397850036621 time for calcul the mask position with numpy : 0.029395341873168945 nb_pixel_total : 34973 time to create 1 rle with old method : 0.039121389389038086 time for calcul the mask position with numpy : 0.029255390167236328 nb_pixel_total : 14492 time to create 1 rle with old method : 0.016278982162475586 time for calcul the mask position with numpy : 0.030613183975219727 nb_pixel_total : 29638 time to create 1 rle with old method : 0.03889346122741699 time for calcul the mask position with numpy : 0.029274702072143555 nb_pixel_total : 28716 time to create 1 rle with old method : 0.03187823295593262 time for calcul the mask position with numpy : 0.029228687286376953 nb_pixel_total : 22665 time to create 1 rle with old method : 0.03213858604431152 time for calcul the mask position with numpy : 0.03304004669189453 nb_pixel_total : 18347 time to create 1 rle with old method : 0.02973008155822754 time for calcul the mask position with numpy : 0.029924631118774414 nb_pixel_total : 36489 time to create 1 rle with old method : 0.06012988090515137 time for calcul the mask position with numpy : 0.0304872989654541 nb_pixel_total : 21949 time to create 1 rle with old method : 0.02455902099609375 time for calcul the mask position with numpy : 0.02942824363708496 nb_pixel_total : 36581 time to create 1 rle with old method : 0.04091477394104004 time for calcul the mask position with numpy : 0.029222965240478516 nb_pixel_total : 33602 time to create 1 rle with old method : 0.0477747917175293 time for calcul the mask position with numpy : 0.03361177444458008 nb_pixel_total : 50418 time to create 1 rle with old method : 0.0766451358795166 time for calcul the mask position with numpy : 0.03039097785949707 nb_pixel_total : 118241 time to create 1 rle with old method : 0.13631391525268555 time for calcul the mask position with numpy : 0.029757022857666016 nb_pixel_total : 30209 time to create 1 rle with old method : 0.03469991683959961 time for calcul the mask position with numpy : 0.02956223487854004 nb_pixel_total : 79771 time to create 1 rle with old method : 0.08919143676757812 time for calcul the mask position with numpy : 0.028567075729370117 nb_pixel_total : 9483 time to create 1 rle with old method : 0.010749101638793945 time for calcul the mask position with numpy : 0.028595924377441406 nb_pixel_total : 24475 time to create 1 rle with old method : 0.027638673782348633 time for calcul the mask position with numpy : 0.029164552688598633 nb_pixel_total : 43061 time to create 1 rle with old method : 0.0478975772857666 time for calcul the mask position with numpy : 0.028711557388305664 nb_pixel_total : 8383 time to create 1 rle with old method : 0.009475231170654297 time for calcul the mask position with numpy : 0.028588533401489258 nb_pixel_total : 9579 time to create 1 rle with old method : 0.010848283767700195 create new chi : 4.220539808273315 time to delete rle : 0.003072500228881836 batch 1 Loaded 71 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 17324 TO DO : save crop sub photo not yet done ! save time : 1.0428013801574707 nb_obj : 15 nb_hashtags : 2 time to prepare the origin masks : 5.896259546279907 time for calcul the mask position with numpy : 0.7533547878265381 nb_pixel_total : 5005622 time to create 1 rle with new method : 0.453261137008667 time for calcul the mask position with numpy : 0.03460979461669922 nb_pixel_total : 789969 time to create 1 rle with new method : 1.1343235969543457 time for calcul the mask position with numpy : 0.024228334426879883 nb_pixel_total : 31903 time to create 1 rle with old method : 0.0357813835144043 time for calcul the mask position with numpy : 0.023944377899169922 nb_pixel_total : 3983 time to create 1 rle with old method : 0.0050160884857177734 time for calcul the mask position with numpy : 0.02496051788330078 nb_pixel_total : 11029 time to create 1 rle with old method : 0.012709379196166992 time for calcul the mask position with numpy : 0.02579665184020996 nb_pixel_total : 23285 time to create 1 rle with old method : 0.026151657104492188 time for calcul the mask position with numpy : 0.024713754653930664 nb_pixel_total : 171066 time to create 1 rle with new method : 0.7566018104553223 time for calcul the mask position with numpy : 0.02169942855834961 nb_pixel_total : 25557 time to create 1 rle with old method : 0.028327465057373047 time for calcul the mask position with numpy : 0.039788007736206055 nb_pixel_total : 127564 time to create 1 rle with old method : 0.14237093925476074 time for calcul the mask position with numpy : 0.03540396690368652 nb_pixel_total : 115719 time to create 1 rle with old method : 0.12556147575378418 time for calcul the mask position with numpy : 0.036653995513916016 nb_pixel_total : 19655 time to create 1 rle with old method : 0.04673480987548828 time for calcul the mask position with numpy : 0.03545045852661133 nb_pixel_total : 102776 time to create 1 rle with old method : 0.11525845527648926 time for calcul the mask position with numpy : 0.040859222412109375 nb_pixel_total : 296846 time to create 1 rle with new method : 2.3402633666992188 time for calcul the mask position with numpy : 0.029927730560302734 nb_pixel_total : 153104 time to create 1 rle with new method : 0.401691198348999 time for calcul the mask position with numpy : 0.03164529800415039 nb_pixel_total : 144644 time to create 1 rle with old method : 0.17644906044006348 time for calcul the mask position with numpy : 0.03249669075012207 nb_pixel_total : 27518 time to create 1 rle with old method : 0.030945539474487305 create new chi : 7.184747695922852 time to delete rle : 0.004250049591064453 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++++++++Number RLEs to save : 17346 TO DO : save crop sub photo not yet done ! save time : 1.1467711925506592 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 7.753478288650513 time for calcul the mask position with numpy : 0.2787766456604004 nb_pixel_total : 4321635 time to create 1 rle with new method : 0.3732442855834961 time for calcul the mask position with numpy : 0.050255775451660156 nb_pixel_total : 478183 time to create 1 rle with new method : 0.4051847457885742 time for calcul the mask position with numpy : 0.0409083366394043 nb_pixel_total : 45914 time to create 1 rle with old method : 0.05290484428405762 time for calcul the mask position with numpy : 0.04312539100646973 nb_pixel_total : 3193 time to create 1 rle with old method : 0.0037021636962890625 time for calcul the mask position with numpy : 0.037809133529663086 nb_pixel_total : 56441 time to create 1 rle with old method : 0.06715583801269531 time for calcul the mask position with numpy : 0.0404508113861084 nb_pixel_total : 135527 time to create 1 rle with old method : 0.1757190227508545 time for calcul the mask position with numpy : 0.03783416748046875 nb_pixel_total : 189419 time to create 1 rle with new method : 0.3752627372741699 time for calcul the mask position with numpy : 0.036754608154296875 nb_pixel_total : 28301 time to create 1 rle with old method : 0.03203582763671875 time for calcul the mask position with numpy : 0.035500288009643555 nb_pixel_total : 23156 time to create 1 rle with old method : 0.027724266052246094 time for calcul the mask position with numpy : 0.033284664154052734 nb_pixel_total : 61623 time to create 1 rle with old method : 0.06859421730041504 time for calcul the mask position with numpy : 0.028792142868041992 nb_pixel_total : 719005 time to create 1 rle with new method : 0.5877695083618164 time for calcul the mask position with numpy : 0.027423620223999023 nb_pixel_total : 339488 time to create 1 rle with new method : 0.4300215244293213 time for calcul the mask position with numpy : 0.03234052658081055 nb_pixel_total : 34311 time to create 1 rle with old method : 0.03870677947998047 time for calcul the mask position with numpy : 0.036835670471191406 nb_pixel_total : 32400 time to create 1 rle with old method : 0.04175305366516113 time for calcul the mask position with numpy : 0.04502439498901367 nb_pixel_total : 78885 time to create 1 rle with old method : 0.09246182441711426 time for calcul the mask position with numpy : 0.045063018798828125 nb_pixel_total : 49791 time to create 1 rle with old method : 0.0607755184173584 time for calcul the mask position with numpy : 0.05281257629394531 nb_pixel_total : 18790 time to create 1 rle with old method : 0.021464109420776367 time for calcul the mask position with numpy : 0.04847884178161621 nb_pixel_total : 321551 time to create 1 rle with new method : 0.39878201484680176 time for calcul the mask position with numpy : 0.05100369453430176 nb_pixel_total : 93023 time to create 1 rle with old method : 0.11470794677734375 time for calcul the mask position with numpy : 0.04100751876831055 nb_pixel_total : 19604 time to create 1 rle with old method : 0.021953582763671875 create new chi : 4.619636297225952 time to delete rle : 0.007235050201416016 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 20872 TO DO : save crop sub photo not yet done ! save time : 1.4010288715362549 map_output_result : {1350010093: (0.0, 'Should be the crop_list due to order', 0), 1350009993: (0.0, 'Should be the crop_list due to order', 0), 1350009959: (0.0, 'Should be the crop_list due to order', 0), 1350009930: (0.0, 'Should be the crop_list due to order', 0), 1350009729: (0.0, 'Should be the crop_list due to order', 0), 1350009703: (0.0, 'Should be the crop_list due to order', 0), 1350009682: (0.0, 'Should be the crop_list due to order', 0), 1350009675: (0.0, 'Should be the crop_list due to order', 0), 1350009123: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1350010093, 1350009993, 1350009959, 1350009930, 1350009729, 1350009703, 1350009682, 1350009675, 1350009123] Looping around the photos to save general results len do output : 9 /1350010093.Didn't retrieve data . /1350009993.Didn't retrieve data . /1350009959.Didn't retrieve data . /1350009930.Didn't retrieve data . /1350009729.Didn't retrieve data . /1350009703.Didn't retrieve data . /1350009682.Didn't retrieve data . /1350009675.Didn't retrieve data . /1350009123.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350010093', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009993', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009959', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009930', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009729', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009703', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009682', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009675', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009123', None, None, None, None, None, '2723665') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.018572330474853516 save_final save missing photos in datou_result : time spend for datou_step_exec : 97.83858180046082 time spend to save output : 0.01937103271484375 total time spend for step 3 : 97.85795283317566 step4:ventilate_hashtags_in_portfolio Tue Apr 15 22:36:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22051913 get user id for portfolio 22051913 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22051913 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','mal_croppe','pehd','pet_fonce','metal','carton','autre','environnement','flou','pet_clair','papier')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22051913 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','mal_croppe','pehd','pet_fonce','metal','carton','autre','environnement','flou','pet_clair','papier')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22051913 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','mal_croppe','pehd','pet_fonce','metal','carton','autre','environnement','flou','pet_clair','papier')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22052516,22052517,22052518,22052519,22052520,22052521,22052522,22052523,22052524,22052525,22052526?tags=background,mal_croppe,pehd,pet_fonce,metal,carton,autre,environnement,flou,pet_clair,papier Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1350010093, 1350009993, 1350009959, 1350009930, 1350009729, 1350009703, 1350009682, 1350009675, 1350009123] Looping around the photos to save general results len do output : 1 /22051913. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350010093', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009993', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009959', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009930', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009729', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009703', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009682', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009675', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009123', None, None, None, None, None, '2723665') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.016638755798339844 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6028406620025635 time spend to save output : 0.016887187957763672 total time spend for step 4 : 1.6197278499603271 step5:final Tue Apr 15 22:36:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1350010093: ('0.16937911963911076',), 1350009993: ('0.16937911963911076',), 1350009959: ('0.16937911963911076',), 1350009930: ('0.16937911963911076',), 1350009729: ('0.16937911963911076',), 1350009703: ('0.16937911963911076',), 1350009682: ('0.16937911963911076',), 1350009675: ('0.16937911963911076',), 1350009123: ('0.16937911963911076',)} new output for save of step final : {1350010093: ('0.16937911963911076',), 1350009993: ('0.16937911963911076',), 1350009959: ('0.16937911963911076',), 1350009930: ('0.16937911963911076',), 1350009729: ('0.16937911963911076',), 1350009703: ('0.16937911963911076',), 1350009682: ('0.16937911963911076',), 1350009675: ('0.16937911963911076',), 1350009123: ('0.16937911963911076',)} [1350010093, 1350009993, 1350009959, 1350009930, 1350009729, 1350009703, 1350009682, 1350009675, 1350009123] Looping around the photos to save general results len do output : 9 /1350010093.Didn't retrieve data . /1350009993.Didn't retrieve data . /1350009959.Didn't retrieve data . /1350009930.Didn't retrieve data . /1350009729.Didn't retrieve data . /1350009703.Didn't retrieve data . /1350009682.Didn't retrieve data . /1350009675.Didn't retrieve data . /1350009123.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350010093', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009993', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009959', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009930', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009729', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009703', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009682', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009675', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009123', None, None, None, None, None, '2723665') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.0157315731048584 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10830044746398926 time spend to save output : 0.016468048095703125 total time spend for step 5 : 0.12476849555969238 step6:blur_detection Tue Apr 15 22:36:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b.jpg resize: (2160, 3264) 1350010093 -5.603454452496175 treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8.jpg resize: (2160, 3264) 1350009993 -5.722842634063609 treat image : temp/1744749028_1571853_1350009959_8ebf35ab4e62771b355c5eb630a99832.jpg resize: (2160, 3264) 1350009959 -1.1625322540617218 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f.jpg resize: (2160, 3264) 1350009930 -3.928683536853321 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317.jpg resize: (2160, 3264) 1350009729 -5.533737848940691 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc.jpg resize: (2160, 3264) 1350009703 -4.555120789849023 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36.jpg resize: (2160, 3264) 1350009682 -2.403289240652564 treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76.jpg resize: (2160, 3264) 1350009675 -2.197422695102042 treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495.jpg resize: (2160, 3264) 1350009123 -4.702308331918951 treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608735_0.png resize: (886, 479) 1350044954 -4.564066033836964 treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608737_0.png resize: (134, 67) 1350044955 -3.4965922301511023 treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608721_0.png resize: (288, 158) 1350044956 -2.7312077710123446 treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608726_0.png resize: (111, 49) 1350044959 -3.4042844377743204 treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608729_0.png resize: (358, 294) 1350044961 -3.2822756252030425 treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608739_0.png resize: (529, 418) 1350044962 -6.084446371991938 treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608725_0.png resize: (242, 168) 1350044963 -5.032085134746345 treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608727_0.png resize: (240, 178) 1350044966 -3.2024432277108907 treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608738_0.png resize: (188, 165) 1350044968 -5.10125717218604 treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608732_0.png resize: (240, 325) 1350044969 -3.3764942830383267 treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608723_0.png resize: (131, 118) 1350044970 -3.7961658002063374 treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608730_0.png resize: (87, 168) 1350044973 -3.411074087676965 treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608722_0.png resize: (142, 138) 1350044975 -3.748164934600076 treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608736_0.png resize: (120, 62) 1350044976 -3.0246310585403315 treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608728_0.png resize: (102, 127) 1350044977 -3.855150467078047 treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608753_0.png resize: (899, 486) 1350044981 -4.448030763174293 treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608758_0.png resize: (282, 296) 1350044982 -2.2505028795021507 treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608749_0.png resize: (176, 291) 1350044983 -4.081247744081766 treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608759_0.png resize: (57, 83) 1350044985 -3.6309755221058286 treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608751_0.png resize: (131, 64) 1350044988 -3.577414478679661 treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608742_0.png resize: (292, 160) 1350044989 -2.6907473649255023 treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608748_0.png resize: (112, 54) 1350044990 -2.9799924698904317 treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608750_0.png resize: (532, 483) 1350044992 -5.770937838934744 treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608746_0.png resize: (356, 298) 1350044995 -3.183095712715969 treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608756_0.png resize: (233, 213) 1350044996 -1.4361031549514467 treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608741_0.png resize: (246, 171) 1350044997 -4.934874726988137 treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608743_0.png resize: (251, 178) 1350045000 -3.0020852780232774 treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608757_0.png resize: (373, 206) 1350045002 -4.972266419108165 treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608754_0.png resize: (160, 172) 1350045003 -5.405214078295319 treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608747_0.png resize: (248, 235) 1350045004 -3.7758914052790287 treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608745_0.png resize: (145, 139) 1350045007 -3.5621186626473196 treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608752_0.png resize: (105, 122) 1350045009 -3.3174409090112027 treat image : temp/1744749028_1571853_1350009959_8ebf35ab4e62771b355c5eb630a99832_rle_crop_3747608761_0.png resize: (439, 165) 1350045011 -1.632893790527304 treat image : temp/1744749028_1571853_1350009959_8ebf35ab4e62771b355c5eb630a99832_rle_crop_3747608760_0.png resize: (147, 180) 1350045012 -2.062545797220746 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608768_0.png resize: (197, 252) 1350045015 -1.8695714420073044 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608773_0.png resize: (231, 138) 1350045017 -3.4191940015279836 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608764_0.png resize: (504, 642) 1350045018 -1.3911434363138226 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608772_0.png resize: (256, 188) 1350045020 -2.3202219648486055 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608775_0.png resize: (148, 256) 1350045022 -2.908233445345769 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608766_0.png resize: (93, 158) 1350045024 -1.2259529490078223 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608777_0.png resize: (318, 252) 1350045025 -2.3841731527007357 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608774_0.png resize: (152, 133) 1350045028 -2.2548013648763217 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608770_0.png resize: (337, 496) 1350045030 -1.9186133526900409 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608790_0.png resize: (125, 182) 1350045031 -2.0881937328014586 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608769_0.png resize: (109, 86) 1350045032 -0.21368560858423408 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608784_0.png resize: (163, 199) 1350045035 -1.2299454012647144 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608771_0.png resize: (115, 114) 1350045037 -2.6061779455761487 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608763_0.png resize: (158, 171) 1350045038 -2.731823077678674 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608776_0.png resize: (314, 136) 1350045039 -2.334286464255241 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608778_0.png resize: (232, 162) 1350045042 -2.747517958390105 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608767_0.png resize: (154, 120) 1350045044 -1.408761372966886 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608783_0.png resize: (121, 92) 1350045045 -0.8219343275010914 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608780_0.png resize: (132, 175) 1350045047 -2.8258985639005227 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608781_0.png resize: (194, 293) 1350045049 -2.014971452820332 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608788_0.png resize: (274, 300) 1350045051 -3.180361181926865 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608786_0.png resize: (228, 134) 1350045052 -2.0031588682349133 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608800_0.png resize: (191, 191) 1350045055 -0.898819984784947 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608798_0.png resize: (312, 326) 1350045057 -2.1705516905378133 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608808_0.png resize: (113, 244) 1350045058 -2.590451394189072 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608797_0.png resize: (96, 123) 1350045060 -1.4779896292463355 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608801_0.png resize: (116, 234) 1350045063 -3.620089455691974 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608795_0.png resize: (251, 427) 1350045065 -3.9706769405443105 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608794_0.png resize: (357, 591) 1350045066 -3.199869764861658 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608817_0.png resize: (174, 197) 1350045068 -2.495786205827029 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608818_0.png resize: (62, 106) 1350045070 -2.2420917914057026 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608811_0.png resize: (191, 207) 1350045072 -3.8029588234453677 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608793_0.png resize: (96, 57) 1350045073 0.47305993927661766 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608803_0.png resize: (124, 183) 1350045075 -4.115646972886582 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608807_0.png resize: (104, 85) 1350045077 -3.0087658975887823 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608812_0.png resize: (172, 160) 1350045082 -2.3431478968868116 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608809_0.png resize: (95, 66) 1350045083 -1.9452172819910003 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608792_0.png resize: (136, 150) 1350045086 -2.378599830225797 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608802_0.png resize: (242, 424) 1350045088 -3.5446438150520896 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608805_0.png resize: (241, 171) 1350045089 -2.2951403716259446 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608815_0.png resize: (350, 238) 1350045091 -3.588092884427431 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608810_0.png resize: (207, 327) 1350045093 -3.9887984714611364 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608816_0.png resize: (113, 146) 1350045095 -3.902886954273226 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608848_0.png resize: (315, 262) 1350045096 -2.19327414884359 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608840_0.png resize: (357, 270) 1350045098 -2.0960548973609288 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608825_0.png resize: (240, 322) 1350045100 -2.2558136552237897 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608824_0.png resize: (181, 332) 1350045102 -1.8736813991765222 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608828_0.png resize: (241, 263) 1350045103 -2.439668796581263 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608842_0.png resize: (44, 78) 1350045106 -1.3376343843884742 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608822_0.png resize: (90, 140) 1350045108 -2.544144237862699 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608831_0.png resize: (157, 95) 1350045110 -1.0316553660064733 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608835_0.png resize: (91, 101) 1350045111 0.7568732628942855 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608823_0.png resize: (225, 229) 1350045113 -2.6650629467005875 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608844_0.png resize: (252, 302) 1350045115 -1.3062032444723788 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608832_0.png resize: (177, 171) 1350045117 -2.6476657321268733 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608829_0.png resize: (94, 92) 1350045118 -1.5279208392939627 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608826_0.png resize: (186, 175) 1350045120 -2.1574031328582506 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608833_0.png resize: (171, 159) 1350045123 -2.236723535262142 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608827_0.png resize: (94, 57) 1350045124 -1.6634209255123222 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608838_0.png resize: (222, 307) 1350045125 -3.183030176669121 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608845_0.png resize: (121, 158) 1350045127 -3.3704532870447705 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608834_0.png resize: (82, 140) 1350045130 -1.548115883965968 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608849_0.png resize: (213, 310) 1350045131 -3.4670407232966194 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608852_0.png resize: (407, 370) 1350045133 -3.6401873585862385 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608841_0.png resize: (256, 229) 1350045135 -1.4117847031355262 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608851_0.png resize: (209, 214) 1350045137 -2.568241995670958 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608854_0.png resize: (120, 101) 1350045138 -2.062152051108099 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608847_0.png resize: (224, 291) 1350045140 -2.3701744446296376 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608837_0.png resize: (212, 130) 1350045142 -3.7848435275057764 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608853_0.png resize: (204, 196) 1350045144 -2.706345468241933 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608839_0.png resize: (302, 202) 1350045146 -1.5876063133029932 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608830_0.png resize: (259, 124) 1350045147 -3.7528409221751193 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608821_0.png resize: (141, 219) 1350045149 -3.3031011517346767 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608846_0.png resize: (91, 55) 1350045151 -2.526819780738796 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608850_0.png resize: (123, 108) 1350045153 -1.875974254379213 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608884_0.png resize: (153, 141) 1350045155 -0.52823018941363 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608880_0.png resize: (463, 368) 1350045156 -1.8455311353198316 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608875_0.png resize: (154, 181) 1350045158 -2.4858890105770186 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608877_0.png resize: (192, 176) 1350045160 -0.811552306669263 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608882_0.png resize: (180, 194) 1350045162 -0.7027122147322061 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608861_0.png resize: (214, 207) 1350045163 -1.6913655532407224 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608863_0.png resize: (203, 106) 1350045165 -2.658268126866377 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608865_0.png resize: (156, 232) 1350045167 -1.8627485848049707 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608857_0.png resize: (351, 349) 1350045169 -2.7840919797579544 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608870_0.png resize: (305, 146) 1350045171 -0.25465878702045863 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608887_0.png resize: (183, 234) 1350045173 -2.923377949344468 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608873_0.png resize: (229, 208) 1350045175 -0.17546276096410654 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608866_0.png resize: (142, 159) 1350045176 -0.615209124994914 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608867_0.png resize: (138, 118) 1350045178 -0.481014884263055 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608886_0.png resize: (105, 228) 1350045180 -1.1167580829453567 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608872_0.png resize: (191, 315) 1350045182 -2.357608828742701 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608871_0.png resize: (214, 179) 1350045185 -0.9633459763417085 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608876_0.png resize: (288, 205) 1350045187 -1.53380349210044 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608879_0.png resize: (68, 192) 1350045189 -1.9816522125756084 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608881_0.png resize: (610, 390) 1350045191 0.11008516383287784 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608862_0.png resize: (251, 332) 1350045193 -1.4229223496737897 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608878_0.png resize: (257, 203) 1350045195 -1.279116392885003 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608856_0.png resize: (214, 278) 1350045197 -0.8492041700270477 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608868_0.png resize: (104, 211) 1350045199 -1.6933102942814302 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608889_0.png resize: (188, 247) 1350045200 -3.5066313651042065 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608859_0.png resize: (135, 162) 1350045202 -1.8721051746614972 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608869_0.png resize: (135, 258) 1350045204 -1.2041940778773568 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608888_0.png resize: (202, 175) 1350045206 -3.0822513703771763 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608864_0.png resize: (228, 182) 1350045207 -1.2102970878859445 treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608897_0.png resize: (614, 362) 1350045210 -1.4397015830466073 treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608892_0.png resize: (906, 395) 1350045212 -1.4511421960687787 treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608893_0.png resize: (1392, 762) 1350045213 -2.0480733319484528 treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608894_0.png resize: (337, 675) 1350045214 -2.2875907055507203 treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608895_0.png resize: (135, 227) 1350045217 -1.0772364123887606 treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608891_0.png resize: (545, 588) 1350045219 -1.382119536171754 treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608896_0.png resize: (305, 492) 1350045220 -3.9048207550344123 treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608904_0.png resize: (1124, 1017) 1350045222 -2.3433758840648014 treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608911_0.png resize: (254, 173) 1350045224 -0.9781883302469442 treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608916_0.png resize: (161, 279) 1350045226 -2.4986027715671395 treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608906_0.png resize: (349, 416) 1350045227 -1.7173519647347357 treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608915_0.png resize: (312, 402) 1350045230 -3.9987982276772067 treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608922_0.png resize: (345, 234) 1350045232 -2.684466920377141 treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608913_0.png resize: (816, 1281) 1350045234 -3.7266097225054757 treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608917_0.png resize: (267, 244) 1350045235 -4.507860351440609 treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608909_0.png resize: (265, 259) 1350045237 -2.6754323900789054 treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608923_0.png resize: (1029, 994) 1350045239 -4.216166990124697 treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608905_0.png resize: (230, 138) 1350045241 -3.953408451365176 treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608920_0.png resize: (318, 288) 1350045242 -1.439125332942503 treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608914_0.png resize: (904, 1147) 1350045244 -4.109583924027089 treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608907_0.png resize: (1127, 658) 1350045246 -1.5184912526396437 treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608918_0.png resize: (641, 379) 1350045248 -3.2296903306110654 treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608912_0.png resize: (335, 341) 1350045249 -2.668714911870201 treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608734_0.png resize: (220, 206) 1350045516 -1.5327923570538962 treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608731_0.png resize: (204, 178) 1350045517 -5.234030427599346 treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608720_0.png resize: (250, 250) 1350045519 -5.226153922532243 treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608724_0.png resize: (229, 546) 1350045521 -3.4915263124101834 treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608755_0.png resize: (231, 213) 1350045522 -1.402464799796789 treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608740_0.png resize: (250, 253) 1350045523 -5.191049075319742 treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608744_0.png resize: (229, 518) 1350045525 -3.0097801664058483 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608779_0.png resize: (236, 324) 1350045527 -3.0274816053758933 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608785_0.png resize: (238, 223) 1350045528 -3.1779835979168376 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608787_0.png resize: (200, 284) 1350045529 -2.37232707196425 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608789_0.png resize: (151, 197) 1350045531 -1.735807880400759 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608782_0.png resize: (170, 199) 1350045533 -1.1872258914328528 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608791_0.png resize: (164, 174) 1350045534 -1.3205121935284585 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608799_0.png resize: (138, 107) 1350045535 -1.7468892931838795 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608796_0.png resize: (163, 172) 1350045537 -1.5144814103510147 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608804_0.png resize: (113, 155) 1350045539 -3.8661844066808704 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608843_0.png resize: (96, 209) 1350045540 -3.002938854041973 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608883_0.png resize: (238, 243) 1350045541 0.4282815801174464 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608874_0.png resize: (86, 188) 1350045543 0.11252422616144905 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608858_0.png resize: (145, 204) 1350045545 -0.8004231546972126 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608860_0.png resize: (103, 127) 1350045546 -0.17199778746237676 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608855_0.png resize: (217, 182) 1350045547 -1.3113541852489026 treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608902_0.png resize: (319, 614) 1350045549 -1.8833897962608466 treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608900_0.png resize: (187, 171) 1350045551 -3.6605091489362076 treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608899_0.png resize: (665, 490) 1350045552 -2.406665465340277 treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608903_0.png resize: (159, 229) 1350045554 -1.7592283321244755 treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608898_0.png resize: (176, 207) 1350045555 -2.3780225133062913 treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608890_0.png resize: (114, 298) 1350045557 -0.6115954059367142 treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608901_0.png resize: (80, 185) 1350045558 -1.5500139315863526 treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608910_0.png resize: (449, 485) 1350045560 -1.9796462370000543 treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608919_0.png resize: (283, 549) 1350045561 -1.7211732525391974 treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608908_0.png resize: (137, 175) 1350045563 -1.6620863884412964 treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608733_0.png resize: (143, 136) 1350045668 -4.486780393480263 treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608765_0.png resize: (597, 416) 1350045669 -1.8054757403397117 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608814_0.png resize: (284, 442) 1350045670 -2.90484444894784 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608806_0.png resize: (308, 190) 1350045672 -2.897934920762456 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608819_0.png resize: (328, 313) 1350045674 -2.501044219606963 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608820_0.png resize: (412, 337) 1350045675 -3.7331362835743525 treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608836_0.png resize: (333, 271) 1350045677 -2.6078281369193084 treat image : temp/1744749028_1571853_1350009959_8ebf35ab4e62771b355c5eb630a99832_rle_crop_3747608762_0.png resize: (113, 97) 1350045708 -0.7802247938630825 treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608813_0.png resize: (180, 196) 1350045711 -2.855196222246686 treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608885_0.png resize: (147, 71) 1350045748 0.05550295063233042 treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608921_0.png resize: (62, 67) 1350045749 -1.547735621167824 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 213 time used for this insertion : 0.02574300765991211 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 213 time used for this insertion : 0.051926612854003906 save missing photos in datou_result : time spend for datou_step_exec : 37.223830223083496 time spend to save output : 0.08404779434204102 total time spend for step 6 : 37.30787801742554 step7:brightness Tue Apr 15 22:36:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b.jpg treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8.jpg treat image : temp/1744749028_1571853_1350009959_8ebf35ab4e62771b355c5eb630a99832.jpg treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f.jpg treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317.jpg treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc.jpg treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36.jpg treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76.jpg treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495.jpg treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608735_0.png treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608737_0.png treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608721_0.png treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608726_0.png treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608729_0.png treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608739_0.png treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608725_0.png treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608727_0.png treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608738_0.png treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608732_0.png treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608723_0.png treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608730_0.png treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608722_0.png treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608736_0.png treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608728_0.png treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608753_0.png treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608758_0.png treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608749_0.png treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608759_0.png treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608751_0.png treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608742_0.png treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608748_0.png treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608750_0.png treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608746_0.png treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608756_0.png treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608741_0.png treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608743_0.png treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608757_0.png treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608754_0.png treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608747_0.png treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608745_0.png treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608752_0.png treat image : temp/1744749028_1571853_1350009959_8ebf35ab4e62771b355c5eb630a99832_rle_crop_3747608761_0.png treat image : temp/1744749028_1571853_1350009959_8ebf35ab4e62771b355c5eb630a99832_rle_crop_3747608760_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608768_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608773_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608764_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608772_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608775_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608766_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608777_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608774_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608770_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608790_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608769_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608784_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608771_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608763_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608776_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608778_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608767_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608783_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608780_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608781_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608788_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608786_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608800_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608798_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608808_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608797_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608801_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608795_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608794_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608817_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608818_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608811_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608793_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608803_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608807_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608812_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608809_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608792_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608802_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608805_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608815_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608810_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608816_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608848_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608840_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608825_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608824_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608828_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608842_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608822_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608831_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608835_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608823_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608844_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608832_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608829_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608826_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608833_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608827_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608838_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608845_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608834_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608849_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608852_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608841_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608851_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608854_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608847_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608837_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608853_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608839_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608830_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608821_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608846_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608850_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608884_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608880_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608875_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608877_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608882_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608861_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608863_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608865_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608857_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608870_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608887_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608873_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608866_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608867_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608886_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608872_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608871_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608876_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608879_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608881_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608862_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608878_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608856_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608868_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608889_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608859_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608869_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608888_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608864_0.png treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608897_0.png treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608892_0.png treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608893_0.png treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608894_0.png treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608895_0.png treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608891_0.png treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608896_0.png treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608904_0.png treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608911_0.png treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608916_0.png treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608906_0.png treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608915_0.png treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608922_0.png treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608913_0.png treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608917_0.png treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608909_0.png treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608923_0.png treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608905_0.png treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608920_0.png treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608914_0.png treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608907_0.png treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608918_0.png treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608912_0.png treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608734_0.png treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608731_0.png treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608720_0.png treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608724_0.png treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608755_0.png treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608740_0.png treat image : temp/1744749028_1571853_1350009993_bc1360fb8ee726e24647b0ef89a8ead8_rle_crop_3747608744_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608779_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608785_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608787_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608789_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608782_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608791_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608799_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608796_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608804_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608843_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608883_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608874_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608858_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608860_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608855_0.png treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608902_0.png treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608900_0.png treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608899_0.png treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608903_0.png treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608898_0.png treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608890_0.png treat image : temp/1744749028_1571853_1350009675_d369887ab3f34e209673d88fb0ebbe76_rle_crop_3747608901_0.png treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608910_0.png treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608919_0.png treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608908_0.png treat image : temp/1744749028_1571853_1350010093_45d3a86da6c79326627a78cfeb5bad7b_rle_crop_3747608733_0.png treat image : temp/1744749028_1571853_1350009930_bc455f1e5f7db7af899b9c1bf300422f_rle_crop_3747608765_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608814_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608806_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608819_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608820_0.png treat image : temp/1744749028_1571853_1350009703_13a198d98ce823d28945ca41773bf9cc_rle_crop_3747608836_0.png treat image : temp/1744749028_1571853_1350009959_8ebf35ab4e62771b355c5eb630a99832_rle_crop_3747608762_0.png treat image : temp/1744749028_1571853_1350009729_ab61f200c6dcabd51bac27e08e9a0317_rle_crop_3747608813_0.png treat image : temp/1744749028_1571853_1350009682_793028c94c9a84dcf4601dad155cbc36_rle_crop_3747608885_0.png treat image : temp/1744749028_1571853_1350009123_27609c42454604d1b4fce51be8584495_rle_crop_3747608921_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 213 time used for this insertion : 0.023396730422973633 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 213 time used for this insertion : 0.05704832077026367 save missing photos in datou_result : time spend for datou_step_exec : 9.442379474639893 time spend to save output : 0.08649182319641113 total time spend for step 7 : 9.528871297836304 step8:velours_tree Tue Apr 15 22:37:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 6.206575393676758 time spend to save output : 0.04424858093261719 total time spend for step 8 : 6.250823974609375 step9:send_mail_cod Tue Apr 15 22:37:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22051913_15-04-2025_22_37_12.pdf 22052516 imagette220525161744749432 22052517 imagette220525171744749432 22052518 change filename to text .change filename to text .imagette220525181744749432 22052519 imagette220525191744749433 22052520 imagette220525201744749433 22052521 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette220525211744749433 22052522 change filename to text .change filename to text .imagette220525221744749434 22052524 imagette220525241744749434 22052525 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette220525251744749434 22052526 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette220525261744749434 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22051913 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22052516,22052517,22052518,22052519,22052520,22052521,22052522,22052523,22052524,22052525,22052526?tags=background,mal_croppe,pehd,pet_fonce,metal,carton,autre,environnement,flou,pet_clair,papier args[1350010093] : ((1350010093, -5.603454452496175, 492609224), (1350010093, 0.45958782994926295, 2107752395), '0.16937911963911076') We are sending mail with results at report@fotonower.com args[1350009993] : ((1350009993, -5.722842634063609, 492609224), (1350009993, 0.6673845574774246, 2107752395), '0.16937911963911076') We are sending mail with results at report@fotonower.com args[1350009959] : ((1350009959, -1.1625322540617218, 492688767), (1350009959, -0.16516228885477832, 496442774), '0.16937911963911076') We are sending mail with results at report@fotonower.com args[1350009930] : ((1350009930, -3.928683536853321, 492609224), (1350009930, -0.26967556570797524, 496442774), '0.16937911963911076') We are sending mail with results at report@fotonower.com args[1350009729] : ((1350009729, -5.533737848940691, 492609224), (1350009729, -0.045020694925937195, 2107752395), '0.16937911963911076') We are sending mail with results at report@fotonower.com args[1350009703] : ((1350009703, -4.555120789849023, 492609224), (1350009703, -0.08322115033878132, 496442774), '0.16937911963911076') We are sending mail with results at report@fotonower.com args[1350009682] : ((1350009682, -2.403289240652564, 492609224), (1350009682, 0.07585498498584446, 2107752395), '0.16937911963911076') We are sending mail with results at report@fotonower.com args[1350009675] : ((1350009675, -2.197422695102042, 492609224), (1350009675, -0.408824441672465, 496442774), '0.16937911963911076') We are sending mail with results at report@fotonower.com args[1350009123] : ((1350009123, -4.702308331918951, 492609224), (1350009123, -0.08921045306432981, 496442774), '0.16937911963911076') We are sending mail with results at report@fotonower.com refus_total : 0.16937911963911076 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22051913 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1350009123,1350009675,1350009682,1350009703,1350009729,1350009930,1350009959,1350009993,1350010093) Found this number of photos: 9 begin to download photo : 1350009123 begin to download photo : 1350009682 begin to download photo : 1350009729 begin to download photo : 1350009959 begin to download photo : 1350010093 download finish for photo 1350009682 begin to download photo : 1350009703 download finish for photo 1350010093 download finish for photo 1350009959 begin to download photo : 1350009993 download finish for photo 1350009123 begin to download photo : 1350009675 download finish for photo 1350009729 begin to download photo : 1350009930 download finish for photo 1350009675 download finish for photo 1350009993 download finish for photo 1350009703 download finish for photo 1350009930 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22051913_15-04-2025_22_37_12.pdf results_Auto_P22051913_15-04-2025_22_37_12.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22051913_15-04-2025_22_37_12.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22051913','results_Auto_P22051913_15-04-2025_22_37_12.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22051913_15-04-2025_22_37_12.pdf','pdf','','0.6','0.16937911963911076') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22051913

https://www.fotonower.com/image?json=false&list_photos_id=1350010093
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350009993
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350009959
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350009930
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350009729
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350009703
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350009682
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350009675
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350009123
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 16.94%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pehd: https://www.fotonower.com/view/22052518?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22052521?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22052522?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22052525?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22052526?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22051913_15-04-2025_22_37_12.pdf.

Lien vers velours :https://www.fotonower.com/velours/22052516,22052517,22052518,22052519,22052520,22052521,22052522,22052523,22052524,22052525,22052526?tags=background,mal_croppe,pehd,pet_fonce,metal,carton,autre,environnement,flou,pet_clair,papier.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 15 Apr 2025 20:37:19 GMT Content-Length: 0 Connection: close X-Message-Id: 4iTeKv6QSFSJHMW4qxXjeA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1350010093, 1350009993, 1350009959, 1350009930, 1350009729, 1350009703, 1350009682, 1350009675, 1350009123] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350010093', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009993', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009959', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009930', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009729', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009703', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009682', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009675', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009123', None, None, None, None, None, '2723665') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014883995056152344 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.242769956588745 time spend to save output : 0.015084266662597656 total time spend for step 9 : 6.257854223251343 step10:split_time_score Tue Apr 15 22:37:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('07', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 15042025 22051913 Nombre de photos uploadées : 9 / 23040 (0%) 15042025 22051913 Nombre de photos taguées (types de déchets): 0 / 9 (0%) 15042025 22051913 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 2.384185791015625e-06 elapsed_time : order_list_meta_photo_and_scores 6.4373016357421875e-06 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005304813385009766 elapsed_time : insert_dashboard_record_day_entry 0.023537158966064453 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.16937911963911076 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22051913_15-04-2025_22_37_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22051913 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22051913 AND mptpi.`type`=3594 To do Qualite : 0.09394774149532498 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22051915_15-04-2025_22_25_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22051915 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22051915 AND mptpi.`type`=3594 To do Qualite : 0.20541652095918328 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22027920_15-04-2025_12_49_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22027920 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22027920 AND mptpi.`type`=3594 To do Qualite : 0.10993276470020877 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22027923_15-04-2025_12_24_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22027923 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22027923 AND mptpi.`type`=3594 To do Qualite : 0.05652087531411031 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22028718_15-04-2025_13_11_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22028718 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22028718 AND mptpi.`type`=3726 To do Qualite : 0.17023427379585465 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22049536_15-04-2025_22_15_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22049536 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22049536 AND mptpi.`type`=3594 To do Qualite : 0.14085696298804612 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22050503_15-04-2025_22_01_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22050503 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22050503 AND mptpi.`type`=3594 To do Qualite : 0.04204030528478445 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22049539_15-04-2025_21_13_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22049539 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22049539 AND mptpi.`type`=3726 To do Qualite : 0.1399238807723525 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22049544_15-04-2025_21_21_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22049544 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22049544 AND mptpi.`type`=3594 To do Qualite : 0.1389535804325939 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22050507_15-04-2025_21_29_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22050507 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22050507 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'15042025': {'nb_upload': 9, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1350010093, 1350009993, 1350009959, 1350009930, 1350009729, 1350009703, 1350009682, 1350009675, 1350009123] Looping around the photos to save general results len do output : 1 /22051913Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350010093', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009993', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009959', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009930', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009729', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009703', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009682', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009675', None, None, None, None, None, '2723665') ('3318', None, None, None, None, None, None, None, '2723665') ('3318', '22051913', '1350009123', None, None, None, None, None, '2723665') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.01761913299560547 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.7718567848205566 time spend to save output : 0.017805099487304688 total time spend for step 10 : 0.7896618843078613 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 199.50user 133.66system 6:55.45elapsed 80%CPU (0avgtext+0avgdata 3978424maxresident)k 3177608inputs+150472outputs (107684major+16497491minor)pagefaults 0swaps