python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2310830 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2648027'] with mtr_portfolio_ids : ['21139334'] and first list_photo_ids : [] new path : /proc/2310830/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.3219027519226074 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Mar 7 11:10:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10593 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-07 11:10:31.531801: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-07 11:10:31.559339: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-07 11:10:31.560839: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f9ea0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-07 11:10:31.560859: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-07 11:10:31.563703: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-07 11:10:31.811854: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x37e6bb30 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-07 11:10:31.811896: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-07 11:10:31.812827: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-07 11:10:31.813133: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 11:10:31.815201: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 11:10:31.817487: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-07 11:10:31.817810: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-07 11:10:31.821329: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-07 11:10:31.822627: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-07 11:10:31.828532: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-07 11:10:31.830005: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-07 11:10:31.830092: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 11:10:31.830847: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-07 11:10:31.830862: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-07 11:10:31.830871: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-07 11:10:31.832268: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9815 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-07 11:10:32.156879: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-07 11:10:32.156966: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 11:10:32.156987: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 11:10:32.157005: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-07 11:10:32.157024: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-07 11:10:32.157041: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-07 11:10:32.157059: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-07 11:10:32.157077: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-07 11:10:32.158668: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-07 11:10:32.160151: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-07 11:10:32.160196: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 11:10:32.160211: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 11:10:32.160226: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-07 11:10:32.160239: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-07 11:10:32.160253: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-07 11:10:32.160267: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-07 11:10:32.160282: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-07 11:10:32.161574: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-07 11:10:32.161610: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-07 11:10:32.161619: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-07 11:10:32.161627: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-07 11:10:32.162983: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9815 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-07 11:10:46.925354: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 11:10:47.175634: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 62 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 54 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 28 Detection mask done ! Trying to reset tf kernel 2311369 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5304 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10593 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0012593269348144531 nb_pixel_total : 44872 time to create 1 rle with old method : 0.05373573303222656 length of segment : 272 time for calcul the mask position with numpy : 0.0011229515075683594 nb_pixel_total : 45106 time to create 1 rle with old method : 0.05391192436218262 length of segment : 440 time for calcul the mask position with numpy : 0.0002474784851074219 nb_pixel_total : 10619 time to create 1 rle with old method : 0.012274980545043945 length of segment : 129 time for calcul the mask position with numpy : 0.0002770423889160156 nb_pixel_total : 15107 time to create 1 rle with old method : 0.02142477035522461 length of segment : 97 time for calcul the mask position with numpy : 0.0007414817810058594 nb_pixel_total : 37891 time to create 1 rle with old method : 0.04367566108703613 length of segment : 294 time for calcul the mask position with numpy : 0.00037932395935058594 nb_pixel_total : 13012 time to create 1 rle with old method : 0.015013694763183594 length of segment : 131 time for calcul the mask position with numpy : 0.004615068435668945 nb_pixel_total : 202267 time to create 1 rle with new method : 0.013367652893066406 length of segment : 758 time for calcul the mask position with numpy : 0.00021123886108398438 nb_pixel_total : 6210 time to create 1 rle with old method : 0.007962942123413086 length of segment : 92 time for calcul the mask position with numpy : 0.0001766681671142578 nb_pixel_total : 6612 time to create 1 rle with old method : 0.009807586669921875 length of segment : 112 time for calcul the mask position with numpy : 0.0002923011779785156 nb_pixel_total : 13815 time to create 1 rle with old method : 0.018931150436401367 length of segment : 105 time for calcul the mask position with numpy : 0.0005269050598144531 nb_pixel_total : 31413 time to create 1 rle with old method : 0.03744029998779297 length of segment : 199 time for calcul the mask position with numpy : 0.0003256797790527344 nb_pixel_total : 13258 time to create 1 rle with old method : 0.017342329025268555 length of segment : 146 time for calcul the mask position with numpy : 0.0016100406646728516 nb_pixel_total : 90916 time to create 1 rle with old method : 0.10637021064758301 length of segment : 515 time for calcul the mask position with numpy : 0.0004100799560546875 nb_pixel_total : 16350 time to create 1 rle with old method : 0.019814014434814453 length of segment : 292 time for calcul the mask position with numpy : 0.00025153160095214844 nb_pixel_total : 10228 time to create 1 rle with old method : 0.012342691421508789 length of segment : 180 time for calcul the mask position with numpy : 0.00040721893310546875 nb_pixel_total : 21590 time to create 1 rle with old method : 0.02727961540222168 length of segment : 164 time for calcul the mask position with numpy : 0.0003299713134765625 nb_pixel_total : 18606 time to create 1 rle with old method : 0.02260112762451172 length of segment : 143 time for calcul the mask position with numpy : 0.00035071372985839844 nb_pixel_total : 17670 time to create 1 rle with old method : 0.02205681800842285 length of segment : 217 time for calcul the mask position with numpy : 0.00014209747314453125 nb_pixel_total : 4285 time to create 1 rle with old method : 0.005530357360839844 length of segment : 82 time for calcul the mask position with numpy : 0.00017142295837402344 nb_pixel_total : 6146 time to create 1 rle with old method : 0.008114099502563477 length of segment : 66 time for calcul the mask position with numpy : 0.0004277229309082031 nb_pixel_total : 20971 time to create 1 rle with old method : 0.025788545608520508 length of segment : 157 time for calcul the mask position with numpy : 0.0002415180206298828 nb_pixel_total : 9067 time to create 1 rle with old method : 0.013882637023925781 length of segment : 92 time for calcul the mask position with numpy : 0.0003211498260498047 nb_pixel_total : 16189 time to create 1 rle with old method : 0.020298480987548828 length of segment : 121 time for calcul the mask position with numpy : 0.0003254413604736328 nb_pixel_total : 15792 time to create 1 rle with old method : 0.01947641372680664 length of segment : 128 time for calcul the mask position with numpy : 0.00029015541076660156 nb_pixel_total : 11473 time to create 1 rle with old method : 0.014020919799804688 length of segment : 153 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 1280 time to create 1 rle with old method : 0.0016815662384033203 length of segment : 61 time for calcul the mask position with numpy : 0.022773265838623047 nb_pixel_total : 311040 time to create 1 rle with new method : 0.027954578399658203 length of segment : 666 time for calcul the mask position with numpy : 0.0013289451599121094 nb_pixel_total : 48324 time to create 1 rle with old method : 0.0567622184753418 length of segment : 408 time for calcul the mask position with numpy : 0.000194549560546875 nb_pixel_total : 5336 time to create 1 rle with old method : 0.0065691471099853516 length of segment : 88 time for calcul the mask position with numpy : 0.0003628730773925781 nb_pixel_total : 14458 time to create 1 rle with old method : 0.018207550048828125 length of segment : 133 time for calcul the mask position with numpy : 0.00046539306640625 nb_pixel_total : 16696 time to create 1 rle with old method : 0.020630359649658203 length of segment : 172 time for calcul the mask position with numpy : 0.000385284423828125 nb_pixel_total : 14334 time to create 1 rle with old method : 0.017996549606323242 length of segment : 123 time for calcul the mask position with numpy : 0.00018644332885742188 nb_pixel_total : 6100 time to create 1 rle with old method : 0.007541179656982422 length of segment : 101 time for calcul the mask position with numpy : 0.0013275146484375 nb_pixel_total : 56057 time to create 1 rle with old method : 0.06570744514465332 length of segment : 307 time for calcul the mask position with numpy : 0.00016427040100097656 nb_pixel_total : 5278 time to create 1 rle with old method : 0.010569572448730469 length of segment : 85 time for calcul the mask position with numpy : 0.0010461807250976562 nb_pixel_total : 35591 time to create 1 rle with old method : 0.04311513900756836 length of segment : 265 time for calcul the mask position with numpy : 0.0003752708435058594 nb_pixel_total : 14000 time to create 1 rle with old method : 0.016400814056396484 length of segment : 147 time for calcul the mask position with numpy : 0.0001785755157470703 nb_pixel_total : 5625 time to create 1 rle with old method : 0.007209062576293945 length of segment : 98 time for calcul the mask position with numpy : 0.00012636184692382812 nb_pixel_total : 3369 time to create 1 rle with old method : 0.004410982131958008 length of segment : 58 time for calcul the mask position with numpy : 0.0006666183471679688 nb_pixel_total : 24635 time to create 1 rle with old method : 0.030277729034423828 length of segment : 263 time for calcul the mask position with numpy : 0.0007228851318359375 nb_pixel_total : 11354 time to create 1 rle with old method : 0.018416166305541992 length of segment : 409 time for calcul the mask position with numpy : 0.0004820823669433594 nb_pixel_total : 18902 time to create 1 rle with old method : 0.023011207580566406 length of segment : 180 time for calcul the mask position with numpy : 0.0005273818969726562 nb_pixel_total : 23905 time to create 1 rle with old method : 0.029758930206298828 length of segment : 182 time for calcul the mask position with numpy : 0.0003159046173095703 nb_pixel_total : 11217 time to create 1 rle with old method : 0.0141143798828125 length of segment : 108 time for calcul the mask position with numpy : 0.0004448890686035156 nb_pixel_total : 16738 time to create 1 rle with old method : 0.020482778549194336 length of segment : 165 time for calcul the mask position with numpy : 0.00021147727966308594 nb_pixel_total : 7423 time to create 1 rle with old method : 0.01076364517211914 length of segment : 119 time for calcul the mask position with numpy : 0.0004763603210449219 nb_pixel_total : 19554 time to create 1 rle with old method : 0.024349212646484375 length of segment : 228 time for calcul the mask position with numpy : 0.0002548694610595703 nb_pixel_total : 9722 time to create 1 rle with old method : 0.012146949768066406 length of segment : 172 time for calcul the mask position with numpy : 0.0005393028259277344 nb_pixel_total : 20067 time to create 1 rle with old method : 0.024574756622314453 length of segment : 168 time for calcul the mask position with numpy : 0.0009560585021972656 nb_pixel_total : 22153 time to create 1 rle with old method : 0.02655172348022461 length of segment : 290 time for calcul the mask position with numpy : 0.0005242824554443359 nb_pixel_total : 22385 time to create 1 rle with old method : 0.027718782424926758 length of segment : 196 time for calcul the mask position with numpy : 0.0002338886260986328 nb_pixel_total : 8591 time to create 1 rle with old method : 0.010614156723022461 length of segment : 109 time for calcul the mask position with numpy : 0.0003380775451660156 nb_pixel_total : 9716 time to create 1 rle with old method : 0.011896848678588867 length of segment : 99 time for calcul the mask position with numpy : 0.0006258487701416016 nb_pixel_total : 25137 time to create 1 rle with old method : 0.030652284622192383 length of segment : 245 time for calcul the mask position with numpy : 0.0004730224609375 nb_pixel_total : 16871 time to create 1 rle with old method : 0.020560503005981445 length of segment : 266 time for calcul the mask position with numpy : 0.0009636878967285156 nb_pixel_total : 33845 time to create 1 rle with old method : 0.04202437400817871 length of segment : 219 time for calcul the mask position with numpy : 0.0017740726470947266 nb_pixel_total : 59643 time to create 1 rle with old method : 0.07554221153259277 length of segment : 315 time for calcul the mask position with numpy : 0.0002968311309814453 nb_pixel_total : 10986 time to create 1 rle with old method : 0.014857769012451172 length of segment : 178 time for calcul the mask position with numpy : 0.0008940696716308594 nb_pixel_total : 34023 time to create 1 rle with old method : 0.04547572135925293 length of segment : 268 time for calcul the mask position with numpy : 0.0005774497985839844 nb_pixel_total : 22289 time to create 1 rle with old method : 0.027002811431884766 length of segment : 173 time for calcul the mask position with numpy : 0.0024039745330810547 nb_pixel_total : 75604 time to create 1 rle with old method : 0.09536147117614746 length of segment : 306 time for calcul the mask position with numpy : 0.0006451606750488281 nb_pixel_total : 23600 time to create 1 rle with old method : 0.029099702835083008 length of segment : 171 time for calcul the mask position with numpy : 0.0007655620574951172 nb_pixel_total : 24724 time to create 1 rle with old method : 0.035180091857910156 length of segment : 255 time for calcul the mask position with numpy : 0.0002110004425048828 nb_pixel_total : 8309 time to create 1 rle with old method : 0.009921073913574219 length of segment : 102 time for calcul the mask position with numpy : 0.0006191730499267578 nb_pixel_total : 27199 time to create 1 rle with old method : 0.0318148136138916 length of segment : 238 time for calcul the mask position with numpy : 0.0005550384521484375 nb_pixel_total : 6956 time to create 1 rle with old method : 0.008614540100097656 length of segment : 116 time for calcul the mask position with numpy : 0.0002357959747314453 nb_pixel_total : 7750 time to create 1 rle with old method : 0.009761333465576172 length of segment : 90 time for calcul the mask position with numpy : 0.0009469985961914062 nb_pixel_total : 19365 time to create 1 rle with old method : 0.028699636459350586 length of segment : 190 time for calcul the mask position with numpy : 0.00021767616271972656 nb_pixel_total : 4497 time to create 1 rle with old method : 0.006628990173339844 length of segment : 111 time for calcul the mask position with numpy : 0.0008516311645507812 nb_pixel_total : 7068 time to create 1 rle with old method : 0.008526802062988281 length of segment : 252 time for calcul the mask position with numpy : 0.0008032321929931641 nb_pixel_total : 13280 time to create 1 rle with old method : 0.016831636428833008 length of segment : 178 time for calcul the mask position with numpy : 0.00045943260192871094 nb_pixel_total : 5273 time to create 1 rle with old method : 0.006510734558105469 length of segment : 208 time for calcul the mask position with numpy : 0.009367942810058594 nb_pixel_total : 348519 time to create 1 rle with new method : 0.0232851505279541 length of segment : 770 time for calcul the mask position with numpy : 0.0032100677490234375 nb_pixel_total : 155343 time to create 1 rle with new method : 0.010362386703491211 length of segment : 484 time for calcul the mask position with numpy : 0.0002644062042236328 nb_pixel_total : 10093 time to create 1 rle with old method : 0.012302875518798828 length of segment : 116 time for calcul the mask position with numpy : 0.002827167510986328 nb_pixel_total : 36044 time to create 1 rle with old method : 0.04446768760681152 length of segment : 288 time for calcul the mask position with numpy : 0.0021719932556152344 nb_pixel_total : 48243 time to create 1 rle with old method : 0.056638240814208984 length of segment : 580 time for calcul the mask position with numpy : 0.00128173828125 nb_pixel_total : 23357 time to create 1 rle with old method : 0.027685880661010742 length of segment : 271 time for calcul the mask position with numpy : 0.0003533363342285156 nb_pixel_total : 6491 time to create 1 rle with old method : 0.008129358291625977 length of segment : 95 time for calcul the mask position with numpy : 0.0004723072052001953 nb_pixel_total : 13889 time to create 1 rle with old method : 0.017194509506225586 length of segment : 163 time for calcul the mask position with numpy : 0.0007345676422119141 nb_pixel_total : 14337 time to create 1 rle with old method : 0.016997337341308594 length of segment : 127 time for calcul the mask position with numpy : 0.0006074905395507812 nb_pixel_total : 8531 time to create 1 rle with old method : 0.010537862777709961 length of segment : 83 time for calcul the mask position with numpy : 0.0008425712585449219 nb_pixel_total : 14164 time to create 1 rle with old method : 0.017885446548461914 length of segment : 173 time for calcul the mask position with numpy : 0.0019512176513671875 nb_pixel_total : 32394 time to create 1 rle with old method : 0.03711676597595215 length of segment : 279 time for calcul the mask position with numpy : 0.001796722412109375 nb_pixel_total : 47299 time to create 1 rle with old method : 0.054556846618652344 length of segment : 217 time for calcul the mask position with numpy : 0.0015649795532226562 nb_pixel_total : 36002 time to create 1 rle with old method : 0.04224443435668945 length of segment : 208 time for calcul the mask position with numpy : 0.00045108795166015625 nb_pixel_total : 4276 time to create 1 rle with old method : 0.005298614501953125 length of segment : 79 time for calcul the mask position with numpy : 0.0009102821350097656 nb_pixel_total : 14355 time to create 1 rle with old method : 0.017889976501464844 length of segment : 197 time for calcul the mask position with numpy : 0.0008301734924316406 nb_pixel_total : 12968 time to create 1 rle with old method : 0.015156030654907227 length of segment : 213 time for calcul the mask position with numpy : 0.022555828094482422 nb_pixel_total : 336627 time to create 1 rle with new method : 0.039743661880493164 length of segment : 952 time for calcul the mask position with numpy : 0.0027577877044677734 nb_pixel_total : 69253 time to create 1 rle with old method : 0.07942724227905273 length of segment : 385 time for calcul the mask position with numpy : 0.0004975795745849609 nb_pixel_total : 29954 time to create 1 rle with old method : 0.04081892967224121 length of segment : 177 time for calcul the mask position with numpy : 0.00020766258239746094 nb_pixel_total : 9719 time to create 1 rle with old method : 0.012077569961547852 length of segment : 135 time for calcul the mask position with numpy : 0.00017595291137695312 nb_pixel_total : 7788 time to create 1 rle with old method : 0.009643316268920898 length of segment : 106 time for calcul the mask position with numpy : 0.0001919269561767578 nb_pixel_total : 9211 time to create 1 rle with old method : 0.011337041854858398 length of segment : 123 time for calcul the mask position with numpy : 0.003054380416870117 nb_pixel_total : 176773 time to create 1 rle with new method : 0.010164976119995117 length of segment : 766 time for calcul the mask position with numpy : 0.00020599365234375 nb_pixel_total : 9502 time to create 1 rle with old method : 0.011265039443969727 length of segment : 116 time for calcul the mask position with numpy : 0.004333019256591797 nb_pixel_total : 280857 time to create 1 rle with new method : 0.014550209045410156 length of segment : 552 time for calcul the mask position with numpy : 0.00013971328735351562 nb_pixel_total : 4185 time to create 1 rle with old method : 0.00520777702331543 length of segment : 87 time for calcul the mask position with numpy : 0.00015974044799804688 nb_pixel_total : 6313 time to create 1 rle with old method : 0.007959127426147461 length of segment : 168 time for calcul the mask position with numpy : 0.00031065940856933594 nb_pixel_total : 14128 time to create 1 rle with old method : 0.02164006233215332 length of segment : 127 time for calcul the mask position with numpy : 0.0007379055023193359 nb_pixel_total : 51767 time to create 1 rle with old method : 0.06047677993774414 length of segment : 332 time for calcul the mask position with numpy : 0.0003008842468261719 nb_pixel_total : 14964 time to create 1 rle with old method : 0.01785111427307129 length of segment : 184 time for calcul the mask position with numpy : 0.00022459030151367188 nb_pixel_total : 10374 time to create 1 rle with old method : 0.012152433395385742 length of segment : 112 time for calcul the mask position with numpy : 0.00020813941955566406 nb_pixel_total : 10289 time to create 1 rle with old method : 0.012893915176391602 length of segment : 123 time for calcul the mask position with numpy : 0.00027060508728027344 nb_pixel_total : 15510 time to create 1 rle with old method : 0.018856287002563477 length of segment : 110 time for calcul the mask position with numpy : 0.0017497539520263672 nb_pixel_total : 107682 time to create 1 rle with old method : 0.12460136413574219 length of segment : 293 time for calcul the mask position with numpy : 0.0009708404541015625 nb_pixel_total : 31839 time to create 1 rle with old method : 0.03948616981506348 length of segment : 202 time for calcul the mask position with numpy : 0.0025620460510253906 nb_pixel_total : 150477 time to create 1 rle with new method : 0.010030508041381836 length of segment : 407 time for calcul the mask position with numpy : 0.00029206275939941406 nb_pixel_total : 12526 time to create 1 rle with old method : 0.015461921691894531 length of segment : 156 time for calcul the mask position with numpy : 0.00086212158203125 nb_pixel_total : 57359 time to create 1 rle with old method : 0.06864786148071289 length of segment : 321 time for calcul the mask position with numpy : 0.0006439685821533203 nb_pixel_total : 16316 time to create 1 rle with old method : 0.019383668899536133 length of segment : 186 time for calcul the mask position with numpy : 0.00016021728515625 nb_pixel_total : 6007 time to create 1 rle with old method : 0.007794857025146484 length of segment : 94 time for calcul the mask position with numpy : 0.0007345676422119141 nb_pixel_total : 26772 time to create 1 rle with old method : 0.03263425827026367 length of segment : 240 time for calcul the mask position with numpy : 0.0005047321319580078 nb_pixel_total : 22142 time to create 1 rle with old method : 0.02722620964050293 length of segment : 250 time for calcul the mask position with numpy : 0.00034427642822265625 nb_pixel_total : 14685 time to create 1 rle with old method : 0.018407583236694336 length of segment : 122 time for calcul the mask position with numpy : 0.00196075439453125 nb_pixel_total : 41278 time to create 1 rle with old method : 0.04920697212219238 length of segment : 380 time for calcul the mask position with numpy : 0.0033142566680908203 nb_pixel_total : 205571 time to create 1 rle with new method : 0.009713411331176758 length of segment : 356 time for calcul the mask position with numpy : 0.0002624988555908203 nb_pixel_total : 11841 time to create 1 rle with old method : 0.015082120895385742 length of segment : 100 time for calcul the mask position with numpy : 0.000286102294921875 nb_pixel_total : 9566 time to create 1 rle with old method : 0.011970996856689453 length of segment : 136 time for calcul the mask position with numpy : 0.0009140968322753906 nb_pixel_total : 51533 time to create 1 rle with old method : 0.06229400634765625 length of segment : 353 time for calcul the mask position with numpy : 0.006426095962524414 nb_pixel_total : 250022 time to create 1 rle with new method : 0.03185844421386719 length of segment : 1188 time for calcul the mask position with numpy : 0.007659196853637695 nb_pixel_total : 459162 time to create 1 rle with new method : 0.1988520622253418 length of segment : 591 time for calcul the mask position with numpy : 0.0004413127899169922 nb_pixel_total : 7912 time to create 1 rle with old method : 0.009868621826171875 length of segment : 101 time for calcul the mask position with numpy : 0.0005483627319335938 nb_pixel_total : 19490 time to create 1 rle with old method : 0.02475905418395996 length of segment : 122 time for calcul the mask position with numpy : 0.0012173652648925781 nb_pixel_total : 29210 time to create 1 rle with old method : 0.03594398498535156 length of segment : 265 time for calcul the mask position with numpy : 0.00026679039001464844 nb_pixel_total : 5946 time to create 1 rle with old method : 0.007680416107177734 length of segment : 60 time for calcul the mask position with numpy : 0.0008599758148193359 nb_pixel_total : 21171 time to create 1 rle with old method : 0.026369333267211914 length of segment : 169 time for calcul the mask position with numpy : 0.0007262229919433594 nb_pixel_total : 17572 time to create 1 rle with old method : 0.023549795150756836 length of segment : 163 time for calcul the mask position with numpy : 0.0006117820739746094 nb_pixel_total : 17835 time to create 1 rle with old method : 0.0218808650970459 length of segment : 194 time for calcul the mask position with numpy : 0.00045800209045410156 nb_pixel_total : 9765 time to create 1 rle with old method : 0.012095451354980469 length of segment : 125 time for calcul the mask position with numpy : 0.0011265277862548828 nb_pixel_total : 21497 time to create 1 rle with old method : 0.028746843338012695 length of segment : 291 time for calcul the mask position with numpy : 0.00029587745666503906 nb_pixel_total : 7729 time to create 1 rle with old method : 0.009597539901733398 length of segment : 98 time for calcul the mask position with numpy : 0.0013120174407958984 nb_pixel_total : 44185 time to create 1 rle with old method : 0.05286455154418945 length of segment : 246 time for calcul the mask position with numpy : 0.0007557868957519531 nb_pixel_total : 18670 time to create 1 rle with old method : 0.023601770401000977 length of segment : 182 time for calcul the mask position with numpy : 0.0002512931823730469 nb_pixel_total : 8986 time to create 1 rle with old method : 0.01277923583984375 length of segment : 93 time for calcul the mask position with numpy : 0.0003237724304199219 nb_pixel_total : 8460 time to create 1 rle with old method : 0.010787725448608398 length of segment : 83 time for calcul the mask position with numpy : 0.00027871131896972656 nb_pixel_total : 6333 time to create 1 rle with old method : 0.007845163345336914 length of segment : 75 time for calcul the mask position with numpy : 0.0008034706115722656 nb_pixel_total : 20323 time to create 1 rle with old method : 0.024815797805786133 length of segment : 186 time for calcul the mask position with numpy : 0.0009436607360839844 nb_pixel_total : 21797 time to create 1 rle with old method : 0.026578426361083984 length of segment : 168 time for calcul the mask position with numpy : 0.000507354736328125 nb_pixel_total : 12565 time to create 1 rle with old method : 0.015548944473266602 length of segment : 169 time for calcul the mask position with numpy : 0.0003650188446044922 nb_pixel_total : 8621 time to create 1 rle with old method : 0.01122736930847168 length of segment : 167 time for calcul the mask position with numpy : 0.00023102760314941406 nb_pixel_total : 9551 time to create 1 rle with old method : 0.011694192886352539 length of segment : 102 time for calcul the mask position with numpy : 0.000270843505859375 nb_pixel_total : 6218 time to create 1 rle with old method : 0.007701396942138672 length of segment : 81 time for calcul the mask position with numpy : 0.00019550323486328125 nb_pixel_total : 6129 time to create 1 rle with old method : 0.007714271545410156 length of segment : 122 time for calcul the mask position with numpy : 0.0008032321929931641 nb_pixel_total : 29026 time to create 1 rle with old method : 0.03590202331542969 length of segment : 372 time for calcul the mask position with numpy : 0.0002682209014892578 nb_pixel_total : 7806 time to create 1 rle with old method : 0.01041412353515625 length of segment : 126 time for calcul the mask position with numpy : 0.0009224414825439453 nb_pixel_total : 18926 time to create 1 rle with old method : 0.02708911895751953 length of segment : 139 time for calcul the mask position with numpy : 0.00066375732421875 nb_pixel_total : 11546 time to create 1 rle with old method : 0.015607595443725586 length of segment : 142 time for calcul the mask position with numpy : 0.001832723617553711 nb_pixel_total : 37858 time to create 1 rle with old method : 0.05069589614868164 length of segment : 325 time for calcul the mask position with numpy : 0.004254579544067383 nb_pixel_total : 136799 time to create 1 rle with old method : 0.16448712348937988 length of segment : 640 time for calcul the mask position with numpy : 0.0008478164672851562 nb_pixel_total : 21796 time to create 1 rle with old method : 0.026799678802490234 length of segment : 191 time for calcul the mask position with numpy : 0.0004284381866455078 nb_pixel_total : 10002 time to create 1 rle with old method : 0.012298583984375 length of segment : 117 time for calcul the mask position with numpy : 0.0020372867584228516 nb_pixel_total : 57414 time to create 1 rle with old method : 0.07012462615966797 length of segment : 292 time for calcul the mask position with numpy : 0.0002994537353515625 nb_pixel_total : 6615 time to create 1 rle with old method : 0.00793147087097168 length of segment : 66 time for calcul the mask position with numpy : 0.0023331642150878906 nb_pixel_total : 75001 time to create 1 rle with old method : 0.08837628364562988 length of segment : 642 time for calcul the mask position with numpy : 0.0022325515747070312 nb_pixel_total : 61441 time to create 1 rle with old method : 0.07161784172058105 length of segment : 415 time for calcul the mask position with numpy : 0.002283334732055664 nb_pixel_total : 77985 time to create 1 rle with old method : 0.09120416641235352 length of segment : 319 time for calcul the mask position with numpy : 0.0004572868347167969 nb_pixel_total : 13245 time to create 1 rle with old method : 0.016069650650024414 length of segment : 148 time for calcul the mask position with numpy : 0.0020294189453125 nb_pixel_total : 65316 time to create 1 rle with old method : 0.07876300811767578 length of segment : 302 time for calcul the mask position with numpy : 0.00035500526428222656 nb_pixel_total : 9364 time to create 1 rle with old method : 0.011762857437133789 length of segment : 73 time for calcul the mask position with numpy : 0.00047326087951660156 nb_pixel_total : 7733 time to create 1 rle with old method : 0.009908676147460938 length of segment : 118 time for calcul the mask position with numpy : 0.0006835460662841797 nb_pixel_total : 25383 time to create 1 rle with old method : 0.03117656707763672 length of segment : 202 time spent for convertir_results : 10.84903597831726 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 163 chid ids of type : 3594 Number RLEs to save : 36530 save missing photos in datou_result : time spend for datou_step_exec : 84.29740405082703 time spend to save output : 2.8410685062408447 total time spend for step 1 : 87.13847255706787 step2:crop_condition Fri Mar 7 11:11:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 163 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 127 About to insert : list_path_to_insert length 127 new photo from crops ! About to upload 127 photos upload in portfolio : 3736932 init cache_photo without model_param we have 127 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741342334_2310830 we have uploaded 127 photos in the portfolio 3736932 time of upload the photos Elapsed time : 37.46092081069946 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 28 About to insert : list_path_to_insert length 28 new photo from crops ! About to upload 28 photos upload in portfolio : 3736932 init cache_photo without model_param we have 28 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741342384_2310830 we have uploaded 28 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.902024984359741 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741342395_2310830 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7098684310913086 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741342400_2310830 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.483400583267212 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741342410_2310830 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.845468282699585 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741342412_2310830 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6967198848724365 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1341420440, 1341420423, 1341420419, 1341420398, 1341420396, 1341420387, 1341420297, 1341420294] Looping around the photos to save general results len do output : 163 /1341438228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341438431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420440', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420423', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420419', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420398', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420396', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420387', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420297', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420294', None, None, None, None, None, '2648027') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 497 time used for this insertion : 0.06982779502868652 save_final save missing photos in datou_result : time spend for datou_step_exec : 97.20835900306702 time spend to save output : 0.07624292373657227 total time spend for step 2 : 97.28460192680359 step3:rle_unique_nms_with_priority Fri Mar 7 11:13:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 163 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 16 nb_hashtags : 2 time to prepare the origin masks : 6.076167821884155 time for calcul the mask position with numpy : 0.6662654876708984 nb_pixel_total : 6482710 time to create 1 rle with new method : 0.9210453033447266 time for calcul the mask position with numpy : 0.02326822280883789 nb_pixel_total : 21590 time to create 1 rle with old method : 0.023972511291503906 time for calcul the mask position with numpy : 0.026389598846435547 nb_pixel_total : 5638 time to create 1 rle with old method : 0.006326436996459961 time for calcul the mask position with numpy : 0.025235414505004883 nb_pixel_total : 16350 time to create 1 rle with old method : 0.020392417907714844 time for calcul the mask position with numpy : 0.0240938663482666 nb_pixel_total : 90916 time to create 1 rle with old method : 0.10134553909301758 time for calcul the mask position with numpy : 0.023426532745361328 nb_pixel_total : 13258 time to create 1 rle with old method : 0.014986753463745117 time for calcul the mask position with numpy : 0.026413917541503906 nb_pixel_total : 31413 time to create 1 rle with old method : 0.03670358657836914 time for calcul the mask position with numpy : 0.023850202560424805 nb_pixel_total : 13815 time to create 1 rle with old method : 0.016176939010620117 time for calcul the mask position with numpy : 0.022902727127075195 nb_pixel_total : 6612 time to create 1 rle with old method : 0.00751948356628418 time for calcul the mask position with numpy : 0.023064136505126953 nb_pixel_total : 6210 time to create 1 rle with old method : 0.007471561431884766 time for calcul the mask position with numpy : 0.025194644927978516 nb_pixel_total : 195121 time to create 1 rle with new method : 0.6562790870666504 time for calcul the mask position with numpy : 0.02458786964416504 nb_pixel_total : 13012 time to create 1 rle with old method : 0.015128612518310547 time for calcul the mask position with numpy : 0.025962114334106445 nb_pixel_total : 37891 time to create 1 rle with old method : 0.0493314266204834 time for calcul the mask position with numpy : 0.022442340850830078 nb_pixel_total : 15107 time to create 1 rle with old method : 0.018736600875854492 time for calcul the mask position with numpy : 0.023483991622924805 nb_pixel_total : 10619 time to create 1 rle with old method : 0.013019800186157227 time for calcul the mask position with numpy : 0.025237560272216797 nb_pixel_total : 45106 time to create 1 rle with old method : 0.05228710174560547 time for calcul the mask position with numpy : 0.023326396942138672 nb_pixel_total : 44872 time to create 1 rle with old method : 0.0521240234375 create new chi : 3.134129047393799 time to delete rle : 0.019964933395385742 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 9726 TO DO : save crop sub photo not yet done ! save time : 0.5891749858856201 nb_obj : 11 nb_hashtags : 2 time to prepare the origin masks : 4.475850820541382 time for calcul the mask position with numpy : 0.6065630912780762 nb_pixel_total : 6617721 time to create 1 rle with new method : 0.6101109981536865 time for calcul the mask position with numpy : 0.028996944427490234 nb_pixel_total : 311040 time to create 1 rle with new method : 0.548424243927002 time for calcul the mask position with numpy : 0.03191065788269043 nb_pixel_total : 1280 time to create 1 rle with old method : 0.001421213150024414 time for calcul the mask position with numpy : 0.020432233810424805 nb_pixel_total : 11473 time to create 1 rle with old method : 0.01231074333190918 time for calcul the mask position with numpy : 0.020519495010375977 nb_pixel_total : 15792 time to create 1 rle with old method : 0.01705145835876465 time for calcul the mask position with numpy : 0.019494295120239258 nb_pixel_total : 16189 time to create 1 rle with old method : 0.01743173599243164 time for calcul the mask position with numpy : 0.02026820182800293 nb_pixel_total : 9067 time to create 1 rle with old method : 0.009785652160644531 time for calcul the mask position with numpy : 0.020203113555908203 nb_pixel_total : 20971 time to create 1 rle with old method : 0.023102760314941406 time for calcul the mask position with numpy : 0.020542621612548828 nb_pixel_total : 6146 time to create 1 rle with old method : 0.006811618804931641 time for calcul the mask position with numpy : 0.02115941047668457 nb_pixel_total : 4285 time to create 1 rle with old method : 0.0046689510345458984 time for calcul the mask position with numpy : 0.0206453800201416 nb_pixel_total : 17670 time to create 1 rle with old method : 0.018432140350341797 time for calcul the mask position with numpy : 0.021671772003173828 nb_pixel_total : 18606 time to create 1 rle with old method : 0.0209500789642334 create new chi : 2.2000858783721924 time to delete rle : 0.0008761882781982422 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++Number RLEs to save : 5932 TO DO : save crop sub photo not yet done ! save time : 0.3780655860900879 nb_obj : 37 nb_hashtags : 5 time to prepare the origin masks : 3.865010976791382 time for calcul the mask position with numpy : 0.5676329135894775 nb_pixel_total : 6291497 time to create 1 rle with new method : 0.7180893421173096 time for calcul the mask position with numpy : 0.029756546020507812 nb_pixel_total : 16871 time to create 1 rle with old method : 0.020041465759277344 time for calcul the mask position with numpy : 0.029105663299560547 nb_pixel_total : 1339 time to create 1 rle with old method : 0.0016384124755859375 time for calcul the mask position with numpy : 0.029139280319213867 nb_pixel_total : 9722 time to create 1 rle with old method : 0.011051416397094727 time for calcul the mask position with numpy : 0.029334306716918945 nb_pixel_total : 24724 time to create 1 rle with old method : 0.02815556526184082 time for calcul the mask position with numpy : 0.029649972915649414 nb_pixel_total : 14000 time to create 1 rle with old method : 0.015964031219482422 time for calcul the mask position with numpy : 0.029251813888549805 nb_pixel_total : 16696 time to create 1 rle with old method : 0.019684791564941406 time for calcul the mask position with numpy : 0.029400348663330078 nb_pixel_total : 19554 time to create 1 rle with old method : 0.022495508193969727 time for calcul the mask position with numpy : 0.029265880584716797 nb_pixel_total : 16738 time to create 1 rle with old method : 0.01883697509765625 time for calcul the mask position with numpy : 0.029389142990112305 nb_pixel_total : 14334 time to create 1 rle with old method : 0.01627373695373535 time for calcul the mask position with numpy : 0.029477357864379883 nb_pixel_total : 25137 time to create 1 rle with old method : 0.02846837043762207 time for calcul the mask position with numpy : 0.02945232391357422 nb_pixel_total : 56057 time to create 1 rle with old method : 0.06457281112670898 time for calcul the mask position with numpy : 0.029081106185913086 nb_pixel_total : 5336 time to create 1 rle with old method : 0.00613856315612793 time for calcul the mask position with numpy : 0.029181241989135742 nb_pixel_total : 11217 time to create 1 rle with old method : 0.013381481170654297 time for calcul the mask position with numpy : 0.029298067092895508 nb_pixel_total : 33845 time to create 1 rle with old method : 0.03848528861999512 time for calcul the mask position with numpy : 0.02910923957824707 nb_pixel_total : 7423 time to create 1 rle with old method : 0.008616447448730469 time for calcul the mask position with numpy : 0.02944350242614746 nb_pixel_total : 75604 time to create 1 rle with old method : 0.10258269309997559 time for calcul the mask position with numpy : 0.03171038627624512 nb_pixel_total : 9716 time to create 1 rle with old method : 0.011407136917114258 time for calcul the mask position with numpy : 0.029113054275512695 nb_pixel_total : 20067 time to create 1 rle with old method : 0.02306532859802246 time for calcul the mask position with numpy : 0.029323577880859375 nb_pixel_total : 22136 time to create 1 rle with old method : 0.02547001838684082 time for calcul the mask position with numpy : 0.030658960342407227 nb_pixel_total : 23600 time to create 1 rle with old method : 0.02740764617919922 time for calcul the mask position with numpy : 0.029236555099487305 nb_pixel_total : 5625 time to create 1 rle with old method : 0.006473541259765625 time for calcul the mask position with numpy : 0.029262065887451172 nb_pixel_total : 3369 time to create 1 rle with old method : 0.003844738006591797 time for calcul the mask position with numpy : 0.029066801071166992 nb_pixel_total : 23905 time to create 1 rle with old method : 0.02695298194885254 time for calcul the mask position with numpy : 0.02923297882080078 nb_pixel_total : 11354 time to create 1 rle with old method : 0.013181209564208984 time for calcul the mask position with numpy : 0.02923130989074707 nb_pixel_total : 34023 time to create 1 rle with old method : 0.038806915283203125 time for calcul the mask position with numpy : 0.029391765594482422 nb_pixel_total : 24635 time to create 1 rle with old method : 0.030200481414794922 time for calcul the mask position with numpy : 0.031632423400878906 nb_pixel_total : 8591 time to create 1 rle with old method : 0.009657621383666992 time for calcul the mask position with numpy : 0.031566619873046875 nb_pixel_total : 8309 time to create 1 rle with old method : 0.010643243789672852 time for calcul the mask position with numpy : 0.03420066833496094 nb_pixel_total : 5278 time to create 1 rle with old method : 0.006531953811645508 time for calcul the mask position with numpy : 0.029160499572753906 nb_pixel_total : 48324 time to create 1 rle with old method : 0.055028438568115234 time for calcul the mask position with numpy : 0.03154277801513672 nb_pixel_total : 6100 time to create 1 rle with old method : 0.006934165954589844 time for calcul the mask position with numpy : 0.029210805892944336 nb_pixel_total : 22385 time to create 1 rle with old method : 0.02821803092956543 time for calcul the mask position with numpy : 0.029119491577148438 nb_pixel_total : 14458 time to create 1 rle with old method : 0.01627969741821289 time for calcul the mask position with numpy : 0.03564763069152832 nb_pixel_total : 22289 time to create 1 rle with old method : 0.027369976043701172 time for calcul the mask position with numpy : 0.029143571853637695 nb_pixel_total : 59643 time to create 1 rle with old method : 0.06994962692260742 time for calcul the mask position with numpy : 0.030493974685668945 nb_pixel_total : 35591 time to create 1 rle with old method : 0.04650092124938965 time for calcul the mask position with numpy : 0.02912116050720215 nb_pixel_total : 748 time to create 1 rle with old method : 0.0012464523315429688 create new chi : 3.338763475418091 time to delete rle : 0.0024743080139160156 batch 1 Loaded 75 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 16083 TO DO : save crop sub photo not yet done ! save time : 0.9471907615661621 nb_obj : 27 nb_hashtags : 2 time to prepare the origin masks : 4.173035383224487 time for calcul the mask position with numpy : 0.35809826850891113 nb_pixel_total : 5736963 time to create 1 rle with new method : 0.6551458835601807 time for calcul the mask position with numpy : 0.029241561889648438 nb_pixel_total : 14337 time to create 1 rle with old method : 0.017192602157592773 time for calcul the mask position with numpy : 0.028979778289794922 nb_pixel_total : 19365 time to create 1 rle with old method : 0.024241924285888672 time for calcul the mask position with numpy : 0.029172897338867188 nb_pixel_total : 47444 time to create 1 rle with old method : 0.05380702018737793 time for calcul the mask position with numpy : 0.028902053833007812 nb_pixel_total : 36044 time to create 1 rle with old method : 0.04096841812133789 time for calcul the mask position with numpy : 0.030347347259521484 nb_pixel_total : 6956 time to create 1 rle with old method : 0.008280754089355469 time for calcul the mask position with numpy : 0.030298471450805664 nb_pixel_total : 6491 time to create 1 rle with old method : 0.007379055023193359 time for calcul the mask position with numpy : 0.029087543487548828 nb_pixel_total : 7068 time to create 1 rle with old method : 0.008082151412963867 time for calcul the mask position with numpy : 0.028864383697509766 nb_pixel_total : 36002 time to create 1 rle with old method : 0.040932416915893555 time for calcul the mask position with numpy : 0.02976512908935547 nb_pixel_total : 3135 time to create 1 rle with old method : 0.005288362503051758 time for calcul the mask position with numpy : 0.03265047073364258 nb_pixel_total : 13280 time to create 1 rle with old method : 0.02197742462158203 time for calcul the mask position with numpy : 0.02894306182861328 nb_pixel_total : 13889 time to create 1 rle with old method : 0.01568746566772461 time for calcul the mask position with numpy : 0.02872490882873535 nb_pixel_total : 12968 time to create 1 rle with old method : 0.014727592468261719 time for calcul the mask position with numpy : 0.029166698455810547 nb_pixel_total : 32394 time to create 1 rle with old method : 0.036438941955566406 time for calcul the mask position with numpy : 0.03327631950378418 nb_pixel_total : 348519 time to create 1 rle with new method : 0.6512260437011719 time for calcul the mask position with numpy : 0.037737369537353516 nb_pixel_total : 332130 time to create 1 rle with new method : 1.1859796047210693 time for calcul the mask position with numpy : 0.02903008460998535 nb_pixel_total : 7750 time to create 1 rle with old method : 0.009274005889892578 time for calcul the mask position with numpy : 0.02870798110961914 nb_pixel_total : 4497 time to create 1 rle with old method : 0.005146026611328125 time for calcul the mask position with numpy : 0.029575824737548828 nb_pixel_total : 155343 time to create 1 rle with new method : 0.5693755149841309 time for calcul the mask position with numpy : 0.029555082321166992 nb_pixel_total : 13250 time to create 1 rle with old method : 0.015805721282958984 time for calcul the mask position with numpy : 0.02927088737487793 nb_pixel_total : 8531 time to create 1 rle with old method : 0.009713888168334961 time for calcul the mask position with numpy : 0.029409170150756836 nb_pixel_total : 14164 time to create 1 rle with old method : 0.01850104331970215 time for calcul the mask position with numpy : 0.029565095901489258 nb_pixel_total : 67496 time to create 1 rle with old method : 0.08681869506835938 time for calcul the mask position with numpy : 0.03664445877075195 nb_pixel_total : 27199 time to create 1 rle with old method : 0.031409263610839844 time for calcul the mask position with numpy : 0.03179931640625 nb_pixel_total : 10093 time to create 1 rle with old method : 0.011665582656860352 time for calcul the mask position with numpy : 0.02934741973876953 nb_pixel_total : 47299 time to create 1 rle with old method : 0.053342342376708984 time for calcul the mask position with numpy : 0.031256914138793945 nb_pixel_total : 4276 time to create 1 rle with old method : 0.00516057014465332 time for calcul the mask position with numpy : 0.028736114501953125 nb_pixel_total : 23357 time to create 1 rle with old method : 0.02657914161682129 create new chi : 4.917357444763184 time to delete rle : 0.0026030540466308594 batch 1 Loaded 55 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 15758 TO DO : save crop sub photo not yet done ! save time : 1.7440364360809326 nb_obj : 16 nb_hashtags : 4 time to prepare the origin masks : 8.38719916343689 time for calcul the mask position with numpy : 0.6841075420379639 nb_pixel_total : 6292438 time to create 1 rle with new method : 1.0608327388763428 time for calcul the mask position with numpy : 0.034096717834472656 nb_pixel_total : 107682 time to create 1 rle with old method : 0.12772440910339355 time for calcul the mask position with numpy : 0.023059844970703125 nb_pixel_total : 15510 time to create 1 rle with old method : 0.017960071563720703 time for calcul the mask position with numpy : 0.0210268497467041 nb_pixel_total : 10289 time to create 1 rle with old method : 0.012131690979003906 time for calcul the mask position with numpy : 0.022022724151611328 nb_pixel_total : 10374 time to create 1 rle with old method : 0.011716127395629883 time for calcul the mask position with numpy : 0.022511959075927734 nb_pixel_total : 14964 time to create 1 rle with old method : 0.01661992073059082 time for calcul the mask position with numpy : 0.02169346809387207 nb_pixel_total : 51767 time to create 1 rle with old method : 0.06027078628540039 time for calcul the mask position with numpy : 0.020877361297607422 nb_pixel_total : 14128 time to create 1 rle with old method : 0.016466140747070312 time for calcul the mask position with numpy : 0.02177262306213379 nb_pixel_total : 5099 time to create 1 rle with old method : 0.00603032112121582 time for calcul the mask position with numpy : 0.021531105041503906 nb_pixel_total : 4185 time to create 1 rle with old method : 0.004610538482666016 time for calcul the mask position with numpy : 0.023204565048217773 nb_pixel_total : 280857 time to create 1 rle with new method : 0.7383301258087158 time for calcul the mask position with numpy : 0.021666288375854492 nb_pixel_total : 9502 time to create 1 rle with old method : 0.010683774948120117 time for calcul the mask position with numpy : 0.025073766708374023 nb_pixel_total : 176773 time to create 1 rle with new method : 1.0392014980316162 time for calcul the mask position with numpy : 0.022985219955444336 nb_pixel_total : 9211 time to create 1 rle with old method : 0.010627269744873047 time for calcul the mask position with numpy : 0.0259854793548584 nb_pixel_total : 7788 time to create 1 rle with old method : 0.0092926025390625 time for calcul the mask position with numpy : 0.023186445236206055 nb_pixel_total : 9719 time to create 1 rle with old method : 0.011110305786132812 time for calcul the mask position with numpy : 0.0264742374420166 nb_pixel_total : 29954 time to create 1 rle with old method : 0.033446550369262695 create new chi : 4.338160991668701 time to delete rle : 0.0013828277587890625 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 9099 TO DO : save crop sub photo not yet done ! save time : 0.6250038146972656 nb_obj : 17 nb_hashtags : 2 time to prepare the origin masks : 8.539368629455566 time for calcul the mask position with numpy : 0.7419002056121826 nb_pixel_total : 5682745 time to create 1 rle with new method : 1.4709818363189697 time for calcul the mask position with numpy : 0.02521371841430664 nb_pixel_total : 6018 time to create 1 rle with old method : 0.007334709167480469 time for calcul the mask position with numpy : 0.03374981880187988 nb_pixel_total : 453543 time to create 1 rle with new method : 0.8215081691741943 time for calcul the mask position with numpy : 0.04095888137817383 nb_pixel_total : 250022 time to create 1 rle with new method : 0.88812255859375 time for calcul the mask position with numpy : 0.03445935249328613 nb_pixel_total : 51533 time to create 1 rle with old method : 0.061194419860839844 time for calcul the mask position with numpy : 0.029802560806274414 nb_pixel_total : 9566 time to create 1 rle with old method : 0.010877370834350586 time for calcul the mask position with numpy : 0.03725743293762207 nb_pixel_total : 11841 time to create 1 rle with old method : 0.013432741165161133 time for calcul the mask position with numpy : 0.03919076919555664 nb_pixel_total : 205571 time to create 1 rle with new method : 0.6047482490539551 time for calcul the mask position with numpy : 0.035307884216308594 nb_pixel_total : 41278 time to create 1 rle with old method : 0.04668688774108887 time for calcul the mask position with numpy : 0.03629589080810547 nb_pixel_total : 14685 time to create 1 rle with old method : 0.016723155975341797 time for calcul the mask position with numpy : 0.037056922912597656 nb_pixel_total : 22142 time to create 1 rle with old method : 0.02510356903076172 time for calcul the mask position with numpy : 0.037026166915893555 nb_pixel_total : 26772 time to create 1 rle with old method : 0.030322551727294922 time for calcul the mask position with numpy : 0.0362088680267334 nb_pixel_total : 6007 time to create 1 rle with old method : 0.0068817138671875 time for calcul the mask position with numpy : 0.03915834426879883 nb_pixel_total : 16316 time to create 1 rle with old method : 0.01974630355834961 time for calcul the mask position with numpy : 0.0353548526763916 nb_pixel_total : 57359 time to create 1 rle with old method : 0.06465435028076172 time for calcul the mask position with numpy : 0.03820013999938965 nb_pixel_total : 12526 time to create 1 rle with old method : 0.01426386833190918 time for calcul the mask position with numpy : 0.04383397102355957 nb_pixel_total : 150477 time to create 1 rle with new method : 0.8557615280151367 time for calcul the mask position with numpy : 0.0395350456237793 nb_pixel_total : 31839 time to create 1 rle with old method : 0.036295413970947266 create new chi : 6.510295867919922 time to delete rle : 0.0029342174530029297 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 12275 TO DO : save crop sub photo not yet done ! save time : 1.4640421867370605 nb_obj : 22 nb_hashtags : 2 time to prepare the origin masks : 13.447728395462036 time for calcul the mask position with numpy : 0.7588205337524414 nb_pixel_total : 6702001 time to create 1 rle with new method : 1.3226923942565918 time for calcul the mask position with numpy : 0.04301786422729492 nb_pixel_total : 26393 time to create 1 rle with old method : 0.030240535736083984 time for calcul the mask position with numpy : 0.03795123100280762 nb_pixel_total : 6129 time to create 1 rle with old method : 0.007027626037597656 time for calcul the mask position with numpy : 0.038132667541503906 nb_pixel_total : 6218 time to create 1 rle with old method : 0.0071258544921875 time for calcul the mask position with numpy : 0.044891357421875 nb_pixel_total : 9551 time to create 1 rle with old method : 0.01151895523071289 time for calcul the mask position with numpy : 0.0382227897644043 nb_pixel_total : 8621 time to create 1 rle with old method : 0.01073598861694336 time for calcul the mask position with numpy : 0.03829216957092285 nb_pixel_total : 12565 time to create 1 rle with old method : 0.014484405517578125 time for calcul the mask position with numpy : 0.03917288780212402 nb_pixel_total : 21797 time to create 1 rle with old method : 0.024872303009033203 time for calcul the mask position with numpy : 0.037544965744018555 nb_pixel_total : 20323 time to create 1 rle with old method : 0.023267507553100586 time for calcul the mask position with numpy : 0.03922319412231445 nb_pixel_total : 6333 time to create 1 rle with old method : 0.007230520248413086 time for calcul the mask position with numpy : 0.03862476348876953 nb_pixel_total : 8253 time to create 1 rle with old method : 0.009660959243774414 time for calcul the mask position with numpy : 0.025814294815063477 nb_pixel_total : 8986 time to create 1 rle with old method : 0.010349512100219727 time for calcul the mask position with numpy : 0.025295734405517578 nb_pixel_total : 18670 time to create 1 rle with old method : 0.021218061447143555 time for calcul the mask position with numpy : 0.02413344383239746 nb_pixel_total : 44185 time to create 1 rle with old method : 0.054028987884521484 time for calcul the mask position with numpy : 0.029547452926635742 nb_pixel_total : 7729 time to create 1 rle with old method : 0.009231328964233398 time for calcul the mask position with numpy : 0.03692460060119629 nb_pixel_total : 21497 time to create 1 rle with old method : 0.02528548240661621 time for calcul the mask position with numpy : 0.0372769832611084 nb_pixel_total : 9765 time to create 1 rle with old method : 0.011587381362915039 time for calcul the mask position with numpy : 0.036067962646484375 nb_pixel_total : 17835 time to create 1 rle with old method : 0.019960403442382812 time for calcul the mask position with numpy : 0.03425168991088867 nb_pixel_total : 17572 time to create 1 rle with old method : 0.019812345504760742 time for calcul the mask position with numpy : 0.04385876655578613 nb_pixel_total : 21171 time to create 1 rle with old method : 0.03528904914855957 time for calcul the mask position with numpy : 0.04383087158203125 nb_pixel_total : 5946 time to create 1 rle with old method : 0.009995698928833008 time for calcul the mask position with numpy : 0.03781938552856445 nb_pixel_total : 29210 time to create 1 rle with old method : 0.03455686569213867 time for calcul the mask position with numpy : 0.036248207092285156 nb_pixel_total : 19490 time to create 1 rle with old method : 0.022249221801757812 create new chi : 3.352116584777832 time to delete rle : 0.001657724380493164 batch 1 Loaded 45 chid ids of type : 3594 ++++++++++++++++++++++++++Number RLEs to save : 8960 TO DO : save crop sub photo not yet done ! save time : 0.672741174697876 nb_obj : 17 nb_hashtags : 4 time to prepare the origin masks : 9.142700672149658 time for calcul the mask position with numpy : 0.6646974086761475 nb_pixel_total : 6406010 time to create 1 rle with new method : 0.8240787982940674 time for calcul the mask position with numpy : 0.035668373107910156 nb_pixel_total : 25383 time to create 1 rle with old method : 0.029769420623779297 time for calcul the mask position with numpy : 0.03709697723388672 nb_pixel_total : 7733 time to create 1 rle with old method : 0.009261608123779297 time for calcul the mask position with numpy : 0.038887739181518555 nb_pixel_total : 9364 time to create 1 rle with old method : 0.010660409927368164 time for calcul the mask position with numpy : 0.0375516414642334 nb_pixel_total : 65316 time to create 1 rle with old method : 0.07556629180908203 time for calcul the mask position with numpy : 0.07350993156433105 nb_pixel_total : 13245 time to create 1 rle with old method : 0.03180551528930664 time for calcul the mask position with numpy : 0.05557537078857422 nb_pixel_total : 77985 time to create 1 rle with old method : 0.10541296005249023 time for calcul the mask position with numpy : 0.04142642021179199 nb_pixel_total : 61441 time to create 1 rle with old method : 0.06992435455322266 time for calcul the mask position with numpy : 0.03777289390563965 nb_pixel_total : 75001 time to create 1 rle with old method : 0.09162735939025879 time for calcul the mask position with numpy : 0.043566226959228516 nb_pixel_total : 6615 time to create 1 rle with old method : 0.008112668991088867 time for calcul the mask position with numpy : 0.03806471824645996 nb_pixel_total : 57414 time to create 1 rle with old method : 0.07170391082763672 time for calcul the mask position with numpy : 0.03633689880371094 nb_pixel_total : 10002 time to create 1 rle with old method : 0.011842727661132812 time for calcul the mask position with numpy : 0.03813338279724121 nb_pixel_total : 21796 time to create 1 rle with old method : 0.025003671646118164 time for calcul the mask position with numpy : 0.03738975524902344 nb_pixel_total : 136799 time to create 1 rle with old method : 0.18072247505187988 time for calcul the mask position with numpy : 0.02478480339050293 nb_pixel_total : 37858 time to create 1 rle with old method : 0.0450286865234375 time for calcul the mask position with numpy : 0.023630380630493164 nb_pixel_total : 11546 time to create 1 rle with old method : 0.014165401458740234 time for calcul the mask position with numpy : 0.025626659393310547 nb_pixel_total : 18926 time to create 1 rle with old method : 0.023227214813232422 time for calcul the mask position with numpy : 0.027912139892578125 nb_pixel_total : 7806 time to create 1 rle with old method : 0.01157522201538086 create new chi : 3.0029594898223877 time to delete rle : 0.002232074737548828 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 10674 TO DO : save crop sub photo not yet done ! save time : 0.750934362411499 map_output_result : {1341420440: (0.0, 'Should be the crop_list due to order', 0), 1341420423: (0.0, 'Should be the crop_list due to order', 0), 1341420419: (0.0, 'Should be the crop_list due to order', 0), 1341420398: (0.0, 'Should be the crop_list due to order', 0), 1341420396: (0.0, 'Should be the crop_list due to order', 0), 1341420387: (0.0, 'Should be the crop_list due to order', 0), 1341420297: (0.0, 'Should be the crop_list due to order', 0), 1341420294: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1341420440, 1341420423, 1341420419, 1341420398, 1341420396, 1341420387, 1341420297, 1341420294] Looping around the photos to save general results len do output : 8 /1341420440.Didn't retrieve data . /1341420423.Didn't retrieve data . /1341420419.Didn't retrieve data . /1341420398.Didn't retrieve data . /1341420396.Didn't retrieve data . /1341420387.Didn't retrieve data . /1341420297.Didn't retrieve data . /1341420294.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420440', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420423', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420419', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420398', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420396', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420387', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420297', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420294', None, None, None, None, None, '2648027') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.022098541259765625 save_final save missing photos in datou_result : time spend for datou_step_exec : 97.27818894386292 time spend to save output : 0.022694826126098633 total time spend for step 3 : 97.30088376998901 step4:ventilate_hashtags_in_portfolio Fri Mar 7 11:15:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 21139334 get user id for portfolio 21139334 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21139334 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','autre','metal','environnement','mal_croppe','carton','pet_clair','flou','papier','pehd','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21139334 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','autre','metal','environnement','mal_croppe','carton','pet_clair','flou','papier','pehd','pet_fonce')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21139334 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','autre','metal','environnement','mal_croppe','carton','pet_clair','flou','papier','pehd','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/21139598,21139599,21139600,21139601,21139602,21139603,21139604,21139605,21139606,21139607,21139608?tags=background,autre,metal,environnement,mal_croppe,carton,pet_clair,flou,papier,pehd,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1341420440, 1341420423, 1341420419, 1341420398, 1341420396, 1341420387, 1341420297, 1341420294] Looping around the photos to save general results len do output : 1 /21139334. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420440', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420423', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420419', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420398', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420396', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420387', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420297', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420294', None, None, None, None, None, '2648027') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01409602165222168 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.643193006515503 time spend to save output : 0.014495849609375 total time spend for step 4 : 1.657688856124878 step5:final Fri Mar 7 11:15:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1341420440: ('0.10974511151393432',), 1341420423: ('0.10974511151393432',), 1341420419: ('0.10974511151393432',), 1341420398: ('0.10974511151393432',), 1341420396: ('0.10974511151393432',), 1341420387: ('0.10974511151393432',), 1341420297: ('0.10974511151393432',), 1341420294: ('0.10974511151393432',)} new output for save of step final : {1341420440: ('0.10974511151393432',), 1341420423: ('0.10974511151393432',), 1341420419: ('0.10974511151393432',), 1341420398: ('0.10974511151393432',), 1341420396: ('0.10974511151393432',), 1341420387: ('0.10974511151393432',), 1341420297: ('0.10974511151393432',), 1341420294: ('0.10974511151393432',)} [1341420440, 1341420423, 1341420419, 1341420398, 1341420396, 1341420387, 1341420297, 1341420294] Looping around the photos to save general results len do output : 8 /1341420440.Didn't retrieve data . /1341420423.Didn't retrieve data . /1341420419.Didn't retrieve data . /1341420398.Didn't retrieve data . /1341420396.Didn't retrieve data . /1341420387.Didn't retrieve data . /1341420297.Didn't retrieve data . /1341420294.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420440', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420423', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420419', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420398', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420396', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420387', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420297', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420294', None, None, None, None, None, '2648027') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.012677907943725586 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11934494972229004 time spend to save output : 0.013148069381713867 total time spend for step 5 : 0.1324930191040039 step6:blur_detection Fri Mar 7 11:15:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072.jpg resize: (2160, 3264) 1341420440 -2.712575787665785 treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a.jpg resize: (2160, 3264) 1341420423 -3.4152653956166734 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd.jpg resize: (2160, 3264) 1341420419 -3.594867800541558 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f.jpg resize: (2160, 3264) 1341420398 -3.7910693018676804 treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001.jpg resize: (2160, 3264) 1341420396 -2.7753133372104415 treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98.jpg resize: (2160, 3264) 1341420387 -0.464800901978285 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1.jpg resize: (2160, 3264) 1341420297 -1.6366347872715343 treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a.jpg resize: (2160, 3264) 1341420294 -2.0151916478539897 treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146992_0.png resize: (91, 119) 1341438228 -2.1384214822652794 treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697147000_0.png resize: (147, 224) 1341438229 -1.7802712097391025 treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146990_0.png resize: (131, 238) 1341438230 -2.6124809200866226 treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146999_0.png resize: (166, 88) 1341438231 -2.8499219677132497 treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146986_0.png resize: (321, 223) 1341438232 -1.9707137201162581 treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146989_0.png resize: (255, 233) 1341438233 -2.699188134762972 treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146997_0.png resize: (287, 414) 1341438234 -1.69489926471418 treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146987_0.png resize: (129, 130) 1341438235 -1.4772132967169147 treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146993_0.png resize: (111, 82) 1341438236 -1.0533026366200564 treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146985_0.png resize: (270, 251) 1341438237 -2.3053076751989456 treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146995_0.png resize: (198, 219) 1341438238 -1.158556527111951 treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146996_0.png resize: (145, 114) 1341438239 -1.5081541984491305 treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146994_0.png resize: (102, 184) 1341438240 -2.0866320776368994 treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146998_0.png resize: (209, 123) 1341438241 -3.425854354616062 treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a_rle_crop_3697147009_0.png resize: (137, 138) 1341438242 -2.860196048904141 treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a_rle_crop_3697147010_0.png resize: (61, 30) 1341438243 3.239484895273358 treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a_rle_crop_3697147005_0.png resize: (144, 217) 1341438244 -1.6425829090101014 treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a_rle_crop_3697147003_0.png resize: (82, 65) 1341438245 0.42180619792318813 treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a_rle_crop_3697147004_0.png resize: (65, 112) 1341438246 2.7970676636654535 treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a_rle_crop_3697147002_0.png resize: (217, 136) 1341438247 -1.6656871824677244 treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a_rle_crop_3697147008_0.png resize: (126, 156) 1341438248 -4.231375791935215 treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a_rle_crop_3697147006_0.png resize: (91, 141) 1341438249 -1.5186529884266018 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147035_0.png resize: (196, 147) 1341438250 -1.229965195129946 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147027_0.png resize: (182, 185) 1341438251 -1.5026763544296888 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147040_0.png resize: (217, 257) 1341438252 -1.5094519351385427 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147014_0.png resize: (132, 159) 1341438253 -1.9425102770359517 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147021_0.png resize: (147, 140) 1341438254 -2.0468655288978166 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147043_0.png resize: (266, 164) 1341438255 -0.9034029998510028 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147041_0.png resize: (232, 415) 1341438257 -1.8906466976241267 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147038_0.png resize: (245, 148) 1341438258 -1.5221405112728712 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147044_0.png resize: (173, 177) 1341438260 -1.619864595815265 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147016_0.png resize: (123, 170) 1341438261 -1.3404429771253823 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147047_0.png resize: (196, 225) 1341438262 -2.7921770123360723 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147029_0.png resize: (170, 153) 1341438263 -1.3394861290603262 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147037_0.png resize: (99, 148) 1341438264 -2.3899712926217274 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147031_0.png resize: (174, 157) 1341438265 -1.699682431953638 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147013_0.png resize: (88, 87) 1341438266 -0.9031977291971175 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147030_0.png resize: (119, 84) 1341438267 -1.8943288729799603 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147032_0.png resize: (172, 74) 1341438268 0.10329228168447493 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147015_0.png resize: (172, 147) 1341438269 -3.6677029326873996 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147023_0.png resize: (57, 76) 1341438270 -1.2223746230223265 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147017_0.png resize: (101, 80) 1341438271 0.08958425970706041 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147028_0.png resize: (105, 168) 1341438272 -1.0014099498018272 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147024_0.png resize: (256, 140) 1341438273 -1.4353379218009008 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147022_0.png resize: (94, 76) 1341438274 -1.5846418302524343 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147034_0.png resize: (226, 227) 1341438275 -2.146060151870387 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147025_0.png resize: (242, 151) 1341438276 -2.602204870934085 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147019_0.png resize: (84, 80) 1341438277 0.9224410995984501 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147012_0.png resize: (358, 198) 1341438278 -2.5097623290035047 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147026_0.png resize: (179, 143) 1341438279 -2.027550399878775 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147046_0.png resize: (169, 176) 1341438281 -2.733270598961698 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147057_0.png resize: (770, 550) 1341438282 -0.9771816352493984 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147054_0.png resize: (250, 44) 1341438283 -2.439060532823791 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147065_0.png resize: (126, 150) 1341438284 -2.20085956377289 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147056_0.png resize: (203, 58) 1341438285 -2.7194239325327034 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147064_0.png resize: (163, 129) 1341438286 -3.107142384758156 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147071_0.png resize: (76, 123) 1341438287 -2.813909223310093 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147061_0.png resize: (362, 286) 1341438288 -3.2082244997780696 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147049_0.png resize: (208, 207) 1341438289 -2.6224095003135526 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147052_0.png resize: (190, 149) 1341438290 -3.923256717452886 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147062_0.png resize: (226, 166) 1341438291 -1.8616149205178394 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147060_0.png resize: (274, 315) 1341438292 -2.7834546528802893 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147069_0.png resize: (212, 287) 1341438293 -3.6304924630968114 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147063_0.png resize: (92, 96) 1341438294 -1.5752718073756444 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147067_0.png resize: (173, 143) 1341438295 -0.46458690069916625 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147073_0.png resize: (213, 111) 1341438296 -1.1092493218765145 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147059_0.png resize: (112, 117) 1341438297 -1.1930669458069525 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147068_0.png resize: (243, 251) 1341438298 -0.7195256126381808 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147051_0.png resize: (90, 134) 1341438299 -1.9086531263405317 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147058_0.png resize: (484, 522) 1341438300 -3.4907302094322747 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147072_0.png resize: (128, 218) 1341438301 -1.9419774695469885 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147053_0.png resize: (111, 50) 1341438302 -0.7681322137353367 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147066_0.png resize: (79, 147) 1341438303 -2.580729726279021 treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147083_0.png resize: (87, 61) 1341438304 -1.9192603219576603 treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147084_0.png resize: (166, 64) 1341438305 -2.8310763407185973 treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147079_0.png resize: (123, 98) 1341438306 -0.5087606583193169 treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147081_0.png resize: (116, 110) 1341438307 -0.9266731714219448 treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147090_0.png resize: (101, 204) 1341438311 -1.658937739629851 treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147085_0.png resize: (125, 183) 1341438312 -2.3887257651596157 treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147077_0.png resize: (134, 98) 1341438313 -1.5297240529454446 treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147078_0.png resize: (106, 107) 1341438314 -1.405818628710332 treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147088_0.png resize: (112, 122) 1341438315 0.2227834571672333 treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147076_0.png resize: (165, 278) 1341438316 -1.8336593141804698 treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147093_0.png resize: (392, 648) 1341438317 -1.419592331933629 treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147094_0.png resize: (156, 104) 1341438318 -1.4447480783511042 treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147102_0.png resize: (355, 905) 1341438319 -0.6485326411157069 treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147092_0.png resize: (202, 224) 1341438321 -1.81446662861532 treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147096_0.png resize: (186, 127) 1341438322 -2.5517811577504834 treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147101_0.png resize: (363, 243) 1341438323 -1.837323853000076 treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147099_0.png resize: (207, 170) 1341438324 -1.8370076080674171 treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147098_0.png resize: (222, 247) 1341438325 -1.4259091065923808 treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147095_0.png resize: (321, 252) 1341438326 1.0500022684478372 treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147097_0.png resize: (94, 82) 1341438327 0.748378976734108 treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147103_0.png resize: (94, 157) 1341438328 -1.485881986850831 treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147105_0.png resize: (348, 209) 1341438329 -2.113739708311731 treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147108_0.png resize: (100, 95) 1341438330 1.5545713068101528 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147110_0.png resize: (263, 217) 1341438331 -1.9197715021027126 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147109_0.png resize: (114, 199) 1341438332 -0.7801435425742136 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147130_0.png resize: (280, 155) 1341438333 -2.428345091369559 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147114_0.png resize: (192, 142) 1341438334 -2.410404518194078 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147115_0.png resize: (125, 108) 1341438335 -2.1631524927057355 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147126_0.png resize: (154, 69) 1341438336 -0.3915744722708125 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147128_0.png resize: (80, 103) 1341438337 -1.1274711997825992 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147129_0.png resize: (118, 73) 1341438338 -1.3973097352234045 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147125_0.png resize: (166, 107) 1341438339 -1.794663812309638 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147113_0.png resize: (157, 168) 1341438340 -1.7720384145255073 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147116_0.png resize: (210, 198) 1341438341 -2.770739978384003 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147124_0.png resize: (168, 223) 1341438342 -0.5488413645477014 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147117_0.png resize: (95, 95) 1341438343 -0.15077743216550293 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147120_0.png resize: (93, 135) 1341438344 -0.9178539380302257 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147112_0.png resize: (169, 225) 1341438345 -1.4073153829636773 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147127_0.png resize: (99, 113) 1341438346 -0.5630525753294822 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147123_0.png resize: (122, 266) 1341438347 -2.6254771956364342 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147118_0.png resize: (238, 255) 1341438348 -1.3832403414484005 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147111_0.png resize: (60, 112) 1341438349 1.2880765821435403 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147122_0.png resize: (75, 109) 1341438350 -0.07163383489052468 treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147135_0.png resize: (453, 468) 1341438351 -1.7200542558041876 treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147141_0.png resize: (357, 285) 1341438352 -2.099781262766956 treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147136_0.png resize: (191, 148) 1341438353 -0.732160142859114 treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147134_0.png resize: (325, 155) 1341438354 -2.3698629564527596 treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147138_0.png resize: (291, 388) 1341438355 -2.2054456157664575 treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147143_0.png resize: (148, 135) 1341438356 -2.2011060205005704 treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147137_0.png resize: (117, 114) 1341438357 -0.9302565809588621 treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147145_0.png resize: (73, 154) 1341438358 2.62871884471725 treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147139_0.png resize: (66, 119) 1341438360 -2.1080016014798884 treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147140_0.png resize: (511, 215) 1341438361 -2.8169061151530714 treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147131_0.png resize: (124, 76) 1341438362 -1.2806835762585613 treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146991_0.png resize: (744, 370) 1341438372 -2.439491664103844 treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146988_0.png resize: (97, 195) 1341438373 -0.4647015968915431 treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a_rle_crop_3697147001_0.png resize: (143, 177) 1341438374 -1.7906108626691952 treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a_rle_crop_3697147007_0.png resize: (120, 171) 1341438375 -1.597346252165622 treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a_rle_crop_3697147011_0.png resize: (601, 911) 1341438376 -3.33644717129569 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147045_0.png resize: (306, 643) 1341438377 -2.3919289225511298 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147042_0.png resize: (178, 84) 1341438378 -0.9116691040327177 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147018_0.png resize: (290, 323) 1341438379 -1.759545363230822 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147036_0.png resize: (108, 99) 1341438380 -0.2924455220640515 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147048_0.png resize: (98, 100) 1341438381 -0.30899519999378594 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147050_0.png resize: (114, 104) 1341438382 -2.6240336891260645 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147055_0.png resize: (178, 117) 1341438383 -2.3058988775052214 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147074_0.png resize: (645, 1002) 1341438384 -1.7816031847255367 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147070_0.png resize: (190, 278) 1341438386 -1.1742327121457787 treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147075_0.png resize: (377, 263) 1341438387 -2.63681812981061 treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147082_0.png resize: (494, 817) 1341438388 -1.5334231632523947 treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147086_0.png resize: (323, 202) 1341438389 -1.0797030861349448 treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147080_0.png resize: (730, 359) 1341438390 -1.5287197242627895 treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147107_0.png resize: (600, 1028) 1341438391 -0.2787242956600017 treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147100_0.png resize: (122, 195) 1341438392 -0.7697320664074938 treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147104_0.png resize: (136, 102) 1341438393 -0.6277313053183682 treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147106_0.png resize: (673, 722) 1341438394 1.7126649464721526 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147121_0.png resize: (77, 150) 1341438395 -0.971958635513625 treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147119_0.png resize: (175, 186) 1341438396 -1.3655422408526352 treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147142_0.png resize: (319, 358) 1341438398 -1.229852846383621 treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147133_0.png resize: (142, 93) 1341438399 3.9038336002059237 treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147132_0.png resize: (139, 193) 1341438400 -0.8030158949817499 treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147146_0.png resize: (118, 148) 1341438401 -2.568987742584006 treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147089_0.png resize: (123, 101) 1341438405 -2.1026441111142167 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147020_0.png resize: (261, 226) 1341438418 -3.2871728402714613 treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147091_0.png resize: (284, 607) 1341438419 -1.5768044072499314 treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147087_0.png resize: (160, 156) 1341438420 -4.388456669227227 treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147144_0.png resize: (300, 291) 1341438421 -2.9983782267988004 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147039_0.png resize: (266, 90) 1341438425 -2.0292493639532903 treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147147_0.png resize: (170, 238) 1341438426 -1.6791560598568191 treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147033_0.png resize: (168, 169) 1341438431 -2.440787025798677 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 171 time used for this insertion : 0.02327728271484375 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 171 time used for this insertion : 0.029981136322021484 save missing photos in datou_result : time spend for datou_step_exec : 34.05105447769165 time spend to save output : 0.059578895568847656 total time spend for step 6 : 34.1106333732605 step7:brightness Fri Mar 7 11:15:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072.jpg treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a.jpg treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd.jpg treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f.jpg treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001.jpg treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98.jpg treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1.jpg treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a.jpg treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146992_0.png treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697147000_0.png treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146990_0.png treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146999_0.png treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146986_0.png treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146989_0.png treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146997_0.png treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146987_0.png treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146993_0.png treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146985_0.png treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146995_0.png treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146996_0.png treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146994_0.png treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146998_0.png treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a_rle_crop_3697147009_0.png treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a_rle_crop_3697147010_0.png treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a_rle_crop_3697147005_0.png treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a_rle_crop_3697147003_0.png treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a_rle_crop_3697147004_0.png treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a_rle_crop_3697147002_0.png treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a_rle_crop_3697147008_0.png treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a_rle_crop_3697147006_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147035_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147027_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147040_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147014_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147021_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147043_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147041_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147038_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147044_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147016_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147047_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147029_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147037_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147031_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147013_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147030_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147032_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147015_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147023_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147017_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147028_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147024_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147022_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147034_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147025_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147019_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147012_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147026_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147046_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147057_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147054_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147065_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147056_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147064_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147071_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147061_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147049_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147052_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147062_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147060_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147069_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147063_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147067_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147073_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147059_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147068_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147051_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147058_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147072_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147053_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147066_0.png treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147083_0.png treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147084_0.png treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147079_0.png treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147081_0.png treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147090_0.png treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147085_0.png treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147077_0.png treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147078_0.png treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147088_0.png treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147076_0.png treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147093_0.png treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147094_0.png treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147102_0.png treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147092_0.png treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147096_0.png treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147101_0.png treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147099_0.png treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147098_0.png treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147095_0.png treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147097_0.png treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147103_0.png treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147105_0.png treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147108_0.png treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147110_0.png treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147109_0.png treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147130_0.png treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147114_0.png treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147115_0.png treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147126_0.png treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147128_0.png treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147129_0.png treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147125_0.png treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147113_0.png treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147116_0.png treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147124_0.png treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147117_0.png treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147120_0.png treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147112_0.png treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147127_0.png treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147123_0.png treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147118_0.png treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147111_0.png treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147122_0.png treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147135_0.png treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147141_0.png treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147136_0.png treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147134_0.png treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147138_0.png treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147143_0.png treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147137_0.png treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147145_0.png treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147139_0.png treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147140_0.png treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147131_0.png treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146991_0.png treat image : temp/1741342226_2310830_1341420440_1ecaa36f6322d8cfdba0e6d93da08072_rle_crop_3697146988_0.png treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a_rle_crop_3697147001_0.png treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a_rle_crop_3697147007_0.png treat image : temp/1741342226_2310830_1341420423_92db57446b68a1a21cd21c8bcfebae3a_rle_crop_3697147011_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147045_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147042_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147018_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147036_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147048_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147050_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147055_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147074_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147070_0.png treat image : temp/1741342226_2310830_1341420398_f5b9fe6585e53796008053d162bb081f_rle_crop_3697147075_0.png treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147082_0.png treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147086_0.png treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147080_0.png treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147107_0.png treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147100_0.png treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147104_0.png treat image : temp/1741342226_2310830_1341420387_e4d5066b246a453fc9f65104ef9eda98_rle_crop_3697147106_0.png treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147121_0.png treat image : temp/1741342226_2310830_1341420297_30138c006c19315852af510746be00f1_rle_crop_3697147119_0.png treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147142_0.png treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147133_0.png treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147132_0.png treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147146_0.png treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147089_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147020_0.png treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147091_0.png treat image : temp/1741342226_2310830_1341420396_51db2dd6c3ba67f3ac785e287bec5001_rle_crop_3697147087_0.png treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147144_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147039_0.png treat image : temp/1741342226_2310830_1341420294_454840082bb140a70b2f076f14e9a88a_rle_crop_3697147147_0.png treat image : temp/1741342226_2310830_1341420419_0e6d049504dc292689f652ba8d4a90dd_rle_crop_3697147033_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 171 time used for this insertion : 0.018991947174072266 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 171 time used for this insertion : 0.03240084648132324 save missing photos in datou_result : time spend for datou_step_exec : 8.129241466522217 time spend to save output : 0.05699563026428223 total time spend for step 7 : 8.186237096786499 step8:velours_tree Fri Mar 7 11:15:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.28215694427490234 time spend to save output : 5.7220458984375e-05 total time spend for step 8 : 0.2822141647338867 step9:send_mail_cod Fri Mar 7 11:15:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P21139334_07-03-2025_11_15_54.pdf 21139598 imagette211395981741342554 21139599 change filename to text .change filename to text .imagette211395991741342554 21139600 change filename to text .imagette211396001741342554 21139602 imagette211396021741342554 21139603 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211396031741342554 21139604 change filename to text .change filename to text .change filename to text .change filename to text .imagette211396041741342555 21139605 imagette211396051741342555 21139606 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211396061741342555 21139607 imagette211396071741342556 21139608 change filename to text .imagette211396081741342556 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21139334 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21139598,21139599,21139600,21139601,21139602,21139603,21139604,21139605,21139606,21139607,21139608?tags=background,autre,metal,environnement,mal_croppe,carton,pet_clair,flou,papier,pehd,pet_fonce args[1341420440] : ((1341420440, -2.712575787665785, 492609224), (1341420440, -0.40201983890681364, 496442774), '0.10974511151393432') We are sending mail with results at report@fotonower.com args[1341420423] : ((1341420423, -3.4152653956166734, 492609224), (1341420423, -0.05062855976836387, 2107752395), '0.10974511151393432') We are sending mail with results at report@fotonower.com args[1341420419] : ((1341420419, -3.594867800541558, 492609224), (1341420419, -0.24933800394051728, 496442774), '0.10974511151393432') We are sending mail with results at report@fotonower.com args[1341420398] : ((1341420398, -3.7910693018676804, 492609224), (1341420398, -0.12379230955826304, 496442774), '0.10974511151393432') We are sending mail with results at report@fotonower.com args[1341420396] : ((1341420396, -2.7753133372104415, 492609224), (1341420396, -0.2284348541398553, 496442774), '0.10974511151393432') We are sending mail with results at report@fotonower.com args[1341420387] : ((1341420387, -0.464800901978285, 492688767), (1341420387, -0.14693230165719773, 496442774), '0.10974511151393432') We are sending mail with results at report@fotonower.com args[1341420297] : ((1341420297, -1.6366347872715343, 492688767), (1341420297, -0.06466710608639477, 2107752395), '0.10974511151393432') We are sending mail with results at report@fotonower.com args[1341420294] : ((1341420294, -2.0151916478539897, 492609224), (1341420294, -0.0487393791959576, 2107752395), '0.10974511151393432') We are sending mail with results at report@fotonower.com refus_total : 0.10974511151393432 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21139334 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1341420294,1341420297,1341420387,1341420396,1341420398,1341420419,1341420423,1341420440) Found this number of photos: 8 begin to download photo : 1341420294 begin to download photo : 1341420387 begin to download photo : 1341420398 begin to download photo : 1341420423 download finish for photo 1341420294 begin to download photo : 1341420297 download finish for photo 1341420398 begin to download photo : 1341420419 download finish for photo 1341420423 begin to download photo : 1341420440 download finish for photo 1341420387 begin to download photo : 1341420396 download finish for photo 1341420297 download finish for photo 1341420440 download finish for photo 1341420396 download finish for photo 1341420419 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21139334_07-03-2025_11_15_54.pdf results_Auto_P21139334_07-03-2025_11_15_54.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21139334_07-03-2025_11_15_54.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','21139334','results_Auto_P21139334_07-03-2025_11_15_54.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21139334_07-03-2025_11_15_54.pdf','pdf','','0.54','0.10974511151393432') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/21139334

https://www.fotonower.com/image?json=false&list_photos_id=1341420440
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1341420423
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1341420419
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1341420398
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1341420396
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1341420387
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1341420297
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1341420294
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 10.97%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/21139599?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/21139600?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/21139603?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/21139604?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/21139606?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/21139608?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21139334_07-03-2025_11_15_54.pdf.

Lien vers velours :https://www.fotonower.com/velours/21139598,21139599,21139600,21139601,21139602,21139603,21139604,21139605,21139606,21139607,21139608?tags=background,autre,metal,environnement,mal_croppe,carton,pet_clair,flou,papier,pehd,pet_fonce.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 07 Mar 2025 10:16:01 GMT Content-Length: 0 Connection: close X-Message-Id: mpRr8XCUSj2fgqpJoIywgw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1341420440, 1341420423, 1341420419, 1341420398, 1341420396, 1341420387, 1341420297, 1341420294] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420440', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420423', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420419', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420398', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420396', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420387', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420297', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420294', None, None, None, None, None, '2648027') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.012708425521850586 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.9990785121917725 time spend to save output : 0.01292276382446289 total time spend for step 9 : 7.012001276016235 step10:split_time_score Fri Mar 7 11:16:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('09', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 07032025 21139334 Nombre de photos uploadées : 8 / 23040 (0%) 07032025 21139334 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 07032025 21139334 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 2.6226043701171875e-06 elapsed_time : order_list_meta_photo_and_scores 8.106231689453125e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0007426738739013672 elapsed_time : insert_dashboard_record_day_entry 0.022972583770751953 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.06901780564613035 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21137167_07-03-2025_09_30_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21137167 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21137167 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21139331 order by id desc limit 1 Qualite : 0.26713232457334796 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21139333_07-03-2025_11_10_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21139333 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21139333 AND mptpi.`type`=3594 To do Qualite : 0.10974511151393432 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21139334_07-03-2025_11_15_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21139334 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21139334 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'07032025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1341420440, 1341420423, 1341420419, 1341420398, 1341420396, 1341420387, 1341420297, 1341420294] Looping around the photos to save general results len do output : 1 /21139334Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420440', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420423', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420419', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420398', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420396', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420387', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420297', None, None, None, None, None, '2648027') ('3318', None, None, None, None, None, None, None, '2648027') ('3318', '21139334', '1341420294', None, None, None, None, None, '2648027') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01365971565246582 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.2954165935516357 time spend to save output : 0.013872861862182617 total time spend for step 10 : 1.3092894554138184 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 131.85user 134.84system 5:38.11elapsed 78%CPU (0avgtext+0avgdata 5535200maxresident)k 852784inputs+85872outputs (16524major+13696789minor)pagefaults 0swaps