python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 909083 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2580678'] with mtr_portfolio_ids : ['20491208'] and first list_photo_ids : [] new path : /proc/909083/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.5349349975585938 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Feb 12 21:10:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10553 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-12 21:10:33.098155: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-12 21:10:33.123068: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-12 21:10:33.124538: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f3c44000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-12 21:10:33.124562: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-12 21:10:33.127488: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-12 21:10:33.260504: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1abc01f0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-12 21:10:33.260551: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-12 21:10:33.261325: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-12 21:10:33.261678: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-12 21:10:33.263695: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-12 21:10:33.265757: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-12 21:10:33.266089: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-12 21:10:33.268235: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-12 21:10:33.269239: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-12 21:10:33.273476: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-12 21:10:33.274999: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-12 21:10:33.275085: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-12 21:10:33.275895: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-12 21:10:33.275911: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-12 21:10:33.275921: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-12 21:10:33.277233: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9633 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-12 21:10:33.543005: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-12 21:10:33.543096: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-12 21:10:33.543113: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-12 21:10:33.543128: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-12 21:10:33.543143: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-12 21:10:33.543157: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-12 21:10:33.543172: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-12 21:10:33.543187: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-12 21:10:33.544478: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-12 21:10:33.545687: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-12 21:10:33.545757: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-12 21:10:33.545774: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-12 21:10:33.545789: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-12 21:10:33.545803: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-12 21:10:33.545818: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-12 21:10:33.545832: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-12 21:10:33.545846: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-12 21:10:33.547154: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-12 21:10:33.547186: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-12 21:10:33.547195: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-12 21:10:33.547203: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-12 21:10:33.548528: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9633 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-12 21:10:46.190475: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-12 21:10:46.396615: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-12 21:10:47.709073: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:47.709764: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.014467: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.014552: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-02-12 21:10:49.092532: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.092622: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-12 21:10:49.094171: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.094205: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-12 21:10:49.101436: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.101496: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-12 21:10:49.102239: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.102255: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-12 21:10:49.124981: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.125034: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 19.91MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-12 21:10:49.125045: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-02-12 21:10:49.125790: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.125806: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-12 21:10:49.126564: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.126580: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-12 21:10:49.133706: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.133763: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-12 21:10:49.134562: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.134579: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-12 21:10:49.135404: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.135422: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-12 21:10:49.136212: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.144303: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.145032: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.161118: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.162187: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.163244: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.164233: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.169114: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.170404: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.171635: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.172854: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.174769: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.185214: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.186402: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.196333: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.197299: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.198765: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.200338: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.201821: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:10:49.203228: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 65 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 54 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 46 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 42 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 68 Detection mask done ! Trying to reset tf kernel 909522 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9360 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10553 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0018241405487060547 nb_pixel_total : 46338 time to create 1 rle with old method : 0.0464475154876709 length of segment : 281 time for calcul the mask position with numpy : 0.0003788471221923828 nb_pixel_total : 14346 time to create 1 rle with old method : 0.015192031860351562 length of segment : 143 time for calcul the mask position with numpy : 0.0005884170532226562 nb_pixel_total : 27865 time to create 1 rle with old method : 0.02928638458251953 length of segment : 207 time for calcul the mask position with numpy : 0.0008914470672607422 nb_pixel_total : 30366 time to create 1 rle with old method : 0.032407283782958984 length of segment : 228 time for calcul the mask position with numpy : 0.0015459060668945312 nb_pixel_total : 61436 time to create 1 rle with old method : 0.0628204345703125 length of segment : 300 time for calcul the mask position with numpy : 0.0005872249603271484 nb_pixel_total : 23550 time to create 1 rle with old method : 0.024472713470458984 length of segment : 195 time for calcul the mask position with numpy : 0.00036263465881347656 nb_pixel_total : 16646 time to create 1 rle with old method : 0.01731133460998535 length of segment : 200 time for calcul the mask position with numpy : 0.0004222393035888672 nb_pixel_total : 18944 time to create 1 rle with old method : 0.02016472816467285 length of segment : 135 time for calcul the mask position with numpy : 0.0008580684661865234 nb_pixel_total : 20205 time to create 1 rle with old method : 0.021770715713500977 length of segment : 205 time for calcul the mask position with numpy : 0.0006914138793945312 nb_pixel_total : 19542 time to create 1 rle with old method : 0.02035832405090332 length of segment : 285 time for calcul the mask position with numpy : 0.0036313533782958984 nb_pixel_total : 99708 time to create 1 rle with old method : 0.1027374267578125 length of segment : 368 time for calcul the mask position with numpy : 0.0007433891296386719 nb_pixel_total : 26867 time to create 1 rle with old method : 0.029185056686401367 length of segment : 229 time for calcul the mask position with numpy : 0.00011539459228515625 nb_pixel_total : 2452 time to create 1 rle with old method : 0.002859354019165039 length of segment : 53 time for calcul the mask position with numpy : 0.0005662441253662109 nb_pixel_total : 23691 time to create 1 rle with old method : 0.025423526763916016 length of segment : 181 time for calcul the mask position with numpy : 0.0007827281951904297 nb_pixel_total : 25784 time to create 1 rle with old method : 0.02741408348083496 length of segment : 207 time for calcul the mask position with numpy : 0.001310110092163086 nb_pixel_total : 45238 time to create 1 rle with old method : 0.04784846305847168 length of segment : 292 time for calcul the mask position with numpy : 0.007547855377197266 nb_pixel_total : 115938 time to create 1 rle with old method : 0.11933422088623047 length of segment : 538 time for calcul the mask position with numpy : 0.00019431114196777344 nb_pixel_total : 3626 time to create 1 rle with old method : 0.003848552703857422 length of segment : 89 time for calcul the mask position with numpy : 0.003042459487915039 nb_pixel_total : 38823 time to create 1 rle with old method : 0.04001975059509277 length of segment : 249 time for calcul the mask position with numpy : 0.0004265308380126953 nb_pixel_total : 7238 time to create 1 rle with old method : 0.007928133010864258 length of segment : 97 time for calcul the mask position with numpy : 0.00012230873107910156 nb_pixel_total : 2142 time to create 1 rle with old method : 0.0024261474609375 length of segment : 81 time for calcul the mask position with numpy : 0.00015997886657714844 nb_pixel_total : 4062 time to create 1 rle with old method : 0.004606723785400391 length of segment : 98 time for calcul the mask position with numpy : 0.001079559326171875 nb_pixel_total : 17175 time to create 1 rle with old method : 0.019235610961914062 length of segment : 152 time for calcul the mask position with numpy : 0.002157449722290039 nb_pixel_total : 25487 time to create 1 rle with old method : 0.02718353271484375 length of segment : 298 time for calcul the mask position with numpy : 0.002493143081665039 nb_pixel_total : 18789 time to create 1 rle with old method : 0.0198819637298584 length of segment : 295 time for calcul the mask position with numpy : 0.0005977153778076172 nb_pixel_total : 2137 time to create 1 rle with old method : 0.002694368362426758 length of segment : 79 time for calcul the mask position with numpy : 0.001239776611328125 nb_pixel_total : 20381 time to create 1 rle with old method : 0.021841049194335938 length of segment : 189 time for calcul the mask position with numpy : 0.0010657310485839844 nb_pixel_total : 35786 time to create 1 rle with old method : 0.03769326210021973 length of segment : 321 time for calcul the mask position with numpy : 0.00013136863708496094 nb_pixel_total : 4885 time to create 1 rle with old method : 0.005338907241821289 length of segment : 81 time for calcul the mask position with numpy : 0.001966714859008789 nb_pixel_total : 30345 time to create 1 rle with old method : 0.03143906593322754 length of segment : 177 time for calcul the mask position with numpy : 0.0008137226104736328 nb_pixel_total : 7976 time to create 1 rle with old method : 0.008643388748168945 length of segment : 142 time for calcul the mask position with numpy : 0.0010106563568115234 nb_pixel_total : 40439 time to create 1 rle with old method : 0.04273271560668945 length of segment : 363 time for calcul the mask position with numpy : 0.00021123886108398438 nb_pixel_total : 9786 time to create 1 rle with old method : 0.010351181030273438 length of segment : 115 time for calcul the mask position with numpy : 0.0042383670806884766 nb_pixel_total : 168741 time to create 1 rle with new method : 0.010061025619506836 length of segment : 467 time for calcul the mask position with numpy : 0.00032711029052734375 nb_pixel_total : 18508 time to create 1 rle with old method : 0.020066022872924805 length of segment : 105 time for calcul the mask position with numpy : 0.00031256675720214844 nb_pixel_total : 13287 time to create 1 rle with old method : 0.014961481094360352 length of segment : 88 time for calcul the mask position with numpy : 0.0005593299865722656 nb_pixel_total : 29013 time to create 1 rle with old method : 0.03184366226196289 length of segment : 195 time for calcul the mask position with numpy : 0.0001919269561767578 nb_pixel_total : 11104 time to create 1 rle with old method : 0.0128173828125 length of segment : 81 time for calcul the mask position with numpy : 0.0002868175506591797 nb_pixel_total : 12808 time to create 1 rle with old method : 0.014150857925415039 length of segment : 195 time for calcul the mask position with numpy : 0.00024771690368652344 nb_pixel_total : 14958 time to create 1 rle with old method : 0.016663312911987305 length of segment : 155 time for calcul the mask position with numpy : 0.0007636547088623047 nb_pixel_total : 35426 time to create 1 rle with old method : 0.037172794342041016 length of segment : 443 time for calcul the mask position with numpy : 0.0012156963348388672 nb_pixel_total : 91337 time to create 1 rle with old method : 0.0968942642211914 length of segment : 412 time for calcul the mask position with numpy : 0.0005233287811279297 nb_pixel_total : 28887 time to create 1 rle with old method : 0.03194832801818848 length of segment : 219 time for calcul the mask position with numpy : 0.00039076805114746094 nb_pixel_total : 20978 time to create 1 rle with old method : 0.02353978157043457 length of segment : 323 time for calcul the mask position with numpy : 0.004918575286865234 nb_pixel_total : 193659 time to create 1 rle with new method : 0.010626077651977539 length of segment : 809 time for calcul the mask position with numpy : 0.00026345252990722656 nb_pixel_total : 14493 time to create 1 rle with old method : 0.016028165817260742 length of segment : 144 time for calcul the mask position with numpy : 0.00035691261291503906 nb_pixel_total : 10934 time to create 1 rle with old method : 0.01250457763671875 length of segment : 143 time for calcul the mask position with numpy : 0.0012040138244628906 nb_pixel_total : 60311 time to create 1 rle with old method : 0.06580972671508789 length of segment : 311 time for calcul the mask position with numpy : 0.0004119873046875 nb_pixel_total : 24537 time to create 1 rle with old method : 0.02732086181640625 length of segment : 287 time for calcul the mask position with numpy : 0.002336740493774414 nb_pixel_total : 166989 time to create 1 rle with new method : 0.007686614990234375 length of segment : 361 time for calcul the mask position with numpy : 0.0007610321044921875 nb_pixel_total : 33311 time to create 1 rle with old method : 0.03683733940124512 length of segment : 326 time for calcul the mask position with numpy : 0.00040721893310546875 nb_pixel_total : 20681 time to create 1 rle with old method : 0.023242473602294922 length of segment : 172 time for calcul the mask position with numpy : 0.0020623207092285156 nb_pixel_total : 62333 time to create 1 rle with old method : 0.06751799583435059 length of segment : 524 time for calcul the mask position with numpy : 0.0055539608001708984 nb_pixel_total : 215299 time to create 1 rle with new method : 0.010426044464111328 length of segment : 473 time for calcul the mask position with numpy : 0.002568960189819336 nb_pixel_total : 141887 time to create 1 rle with old method : 0.14901089668273926 length of segment : 711 time for calcul the mask position with numpy : 0.0013878345489501953 nb_pixel_total : 45736 time to create 1 rle with old method : 0.05158495903015137 length of segment : 455 time for calcul the mask position with numpy : 0.0010669231414794922 nb_pixel_total : 65197 time to create 1 rle with old method : 0.06951665878295898 length of segment : 303 time for calcul the mask position with numpy : 0.002675294876098633 nb_pixel_total : 138766 time to create 1 rle with old method : 0.15153980255126953 length of segment : 374 time for calcul the mask position with numpy : 0.0011255741119384766 nb_pixel_total : 47800 time to create 1 rle with old method : 0.05944252014160156 length of segment : 272 time for calcul the mask position with numpy : 0.002577066421508789 nb_pixel_total : 99440 time to create 1 rle with old method : 0.10935783386230469 length of segment : 625 time for calcul the mask position with numpy : 0.0004837512969970703 nb_pixel_total : 26252 time to create 1 rle with old method : 0.02987837791442871 length of segment : 132 time for calcul the mask position with numpy : 0.0026934146881103516 nb_pixel_total : 175509 time to create 1 rle with new method : 0.01001596450805664 length of segment : 538 time for calcul the mask position with numpy : 0.0015251636505126953 nb_pixel_total : 83753 time to create 1 rle with old method : 0.0965573787689209 length of segment : 306 time for calcul the mask position with numpy : 0.0002682209014892578 nb_pixel_total : 15325 time to create 1 rle with old method : 0.01678752899169922 length of segment : 112 time for calcul the mask position with numpy : 0.0069866180419921875 nb_pixel_total : 393763 time to create 1 rle with new method : 0.02134847640991211 length of segment : 707 time for calcul the mask position with numpy : 0.0003726482391357422 nb_pixel_total : 13622 time to create 1 rle with old method : 0.015700817108154297 length of segment : 146 time for calcul the mask position with numpy : 0.0008907318115234375 nb_pixel_total : 56482 time to create 1 rle with old method : 0.06005859375 length of segment : 319 time for calcul the mask position with numpy : 0.0009176731109619141 nb_pixel_total : 36046 time to create 1 rle with old method : 0.039846181869506836 length of segment : 307 time for calcul the mask position with numpy : 0.0004923343658447266 nb_pixel_total : 28897 time to create 1 rle with old method : 0.031717777252197266 length of segment : 217 time for calcul the mask position with numpy : 0.00026702880859375 nb_pixel_total : 11816 time to create 1 rle with old method : 0.013083219528198242 length of segment : 238 time for calcul the mask position with numpy : 0.0001373291015625 nb_pixel_total : 6262 time to create 1 rle with old method : 0.007292509078979492 length of segment : 84 time for calcul the mask position with numpy : 0.0022368431091308594 nb_pixel_total : 150214 time to create 1 rle with new method : 0.006425380706787109 length of segment : 434 time for calcul the mask position with numpy : 0.00024175643920898438 nb_pixel_total : 8922 time to create 1 rle with old method : 0.009816408157348633 length of segment : 172 time for calcul the mask position with numpy : 0.0035712718963623047 nb_pixel_total : 255551 time to create 1 rle with new method : 0.012331247329711914 length of segment : 901 time for calcul the mask position with numpy : 0.0005235671997070312 nb_pixel_total : 15385 time to create 1 rle with old method : 0.017520666122436523 length of segment : 246 time for calcul the mask position with numpy : 0.0006182193756103516 nb_pixel_total : 28886 time to create 1 rle with old method : 0.03200268745422363 length of segment : 302 time for calcul the mask position with numpy : 0.0006155967712402344 nb_pixel_total : 39689 time to create 1 rle with old method : 0.04239797592163086 length of segment : 177 time for calcul the mask position with numpy : 0.0007269382476806641 nb_pixel_total : 39726 time to create 1 rle with old method : 0.04376530647277832 length of segment : 317 time for calcul the mask position with numpy : 0.012572288513183594 nb_pixel_total : 638588 time to create 1 rle with new method : 0.03389883041381836 length of segment : 831 time for calcul the mask position with numpy : 0.0012085437774658203 nb_pixel_total : 61756 time to create 1 rle with old method : 0.06537127494812012 length of segment : 401 time for calcul the mask position with numpy : 0.00037097930908203125 nb_pixel_total : 17312 time to create 1 rle with old method : 0.019037961959838867 length of segment : 218 time for calcul the mask position with numpy : 0.0001919269561767578 nb_pixel_total : 9870 time to create 1 rle with old method : 0.010937690734863281 length of segment : 96 time for calcul the mask position with numpy : 0.005829811096191406 nb_pixel_total : 167427 time to create 1 rle with new method : 0.024946212768554688 length of segment : 894 time for calcul the mask position with numpy : 0.002001523971557617 nb_pixel_total : 107625 time to create 1 rle with old method : 0.11334085464477539 length of segment : 456 time for calcul the mask position with numpy : 0.001026153564453125 nb_pixel_total : 48217 time to create 1 rle with old method : 0.05066990852355957 length of segment : 311 time for calcul the mask position with numpy : 0.0003864765167236328 nb_pixel_total : 14461 time to create 1 rle with old method : 0.01534128189086914 length of segment : 208 time for calcul the mask position with numpy : 0.0007596015930175781 nb_pixel_total : 43361 time to create 1 rle with old method : 0.047676801681518555 length of segment : 215 time for calcul the mask position with numpy : 0.0002770423889160156 nb_pixel_total : 13160 time to create 1 rle with old method : 0.014306783676147461 length of segment : 134 time for calcul the mask position with numpy : 0.0011386871337890625 nb_pixel_total : 71594 time to create 1 rle with old method : 0.07329344749450684 length of segment : 444 time for calcul the mask position with numpy : 0.0005857944488525391 nb_pixel_total : 31057 time to create 1 rle with old method : 0.03287482261657715 length of segment : 202 time for calcul the mask position with numpy : 0.00232696533203125 nb_pixel_total : 160127 time to create 1 rle with new method : 0.0071430206298828125 length of segment : 490 time for calcul the mask position with numpy : 0.0004956722259521484 nb_pixel_total : 22659 time to create 1 rle with old method : 0.025714635848999023 length of segment : 135 time for calcul the mask position with numpy : 0.0019106864929199219 nb_pixel_total : 111552 time to create 1 rle with old method : 0.11490058898925781 length of segment : 583 time for calcul the mask position with numpy : 0.0008661746978759766 nb_pixel_total : 39773 time to create 1 rle with old method : 0.04272723197937012 length of segment : 288 time for calcul the mask position with numpy : 0.00040030479431152344 nb_pixel_total : 22707 time to create 1 rle with old method : 0.024494647979736328 length of segment : 215 time for calcul the mask position with numpy : 0.0020499229431152344 nb_pixel_total : 121674 time to create 1 rle with old method : 0.12676119804382324 length of segment : 579 time for calcul the mask position with numpy : 0.00037860870361328125 nb_pixel_total : 17413 time to create 1 rle with old method : 0.018121719360351562 length of segment : 137 time for calcul the mask position with numpy : 0.0010051727294921875 nb_pixel_total : 48452 time to create 1 rle with old method : 0.05034589767456055 length of segment : 378 time for calcul the mask position with numpy : 0.0004146099090576172 nb_pixel_total : 15959 time to create 1 rle with old method : 0.016874313354492188 length of segment : 199 time for calcul the mask position with numpy : 0.0015273094177246094 nb_pixel_total : 99318 time to create 1 rle with old method : 0.11116909980773926 length of segment : 352 time for calcul the mask position with numpy : 0.0020542144775390625 nb_pixel_total : 108162 time to create 1 rle with old method : 0.113922119140625 length of segment : 400 time for calcul the mask position with numpy : 0.0008351802825927734 nb_pixel_total : 46324 time to create 1 rle with old method : 0.04939985275268555 length of segment : 271 time for calcul the mask position with numpy : 0.00042557716369628906 nb_pixel_total : 19745 time to create 1 rle with old method : 0.02173638343811035 length of segment : 221 time for calcul the mask position with numpy : 0.00040221214294433594 nb_pixel_total : 19812 time to create 1 rle with old method : 0.023004531860351562 length of segment : 157 time for calcul the mask position with numpy : 0.0004897117614746094 nb_pixel_total : 20137 time to create 1 rle with old method : 0.021977901458740234 length of segment : 269 time for calcul the mask position with numpy : 0.0032312870025634766 nb_pixel_total : 104080 time to create 1 rle with old method : 0.11397862434387207 length of segment : 692 time for calcul the mask position with numpy : 0.00033783912658691406 nb_pixel_total : 16358 time to create 1 rle with old method : 0.0183260440826416 length of segment : 139 time for calcul the mask position with numpy : 0.005208253860473633 nb_pixel_total : 112690 time to create 1 rle with old method : 0.12765932083129883 length of segment : 542 time for calcul the mask position with numpy : 0.0009605884552001953 nb_pixel_total : 23942 time to create 1 rle with old method : 0.026122093200683594 length of segment : 151 time for calcul the mask position with numpy : 0.0006301403045654297 nb_pixel_total : 11795 time to create 1 rle with old method : 0.013708353042602539 length of segment : 105 time for calcul the mask position with numpy : 0.00026917457580566406 nb_pixel_total : 16010 time to create 1 rle with old method : 0.01773810386657715 length of segment : 160 time for calcul the mask position with numpy : 0.0004317760467529297 nb_pixel_total : 10117 time to create 1 rle with old method : 0.011899232864379883 length of segment : 84 time for calcul the mask position with numpy : 0.001672506332397461 nb_pixel_total : 103377 time to create 1 rle with old method : 0.11484599113464355 length of segment : 275 time for calcul the mask position with numpy : 0.0006198883056640625 nb_pixel_total : 28844 time to create 1 rle with old method : 0.03194308280944824 length of segment : 279 time for calcul the mask position with numpy : 0.0013680458068847656 nb_pixel_total : 37271 time to create 1 rle with old method : 0.04188394546508789 length of segment : 150 time for calcul the mask position with numpy : 0.002464771270751953 nb_pixel_total : 65323 time to create 1 rle with old method : 0.07200789451599121 length of segment : 421 time for calcul the mask position with numpy : 0.0004363059997558594 nb_pixel_total : 8518 time to create 1 rle with old method : 0.011433124542236328 length of segment : 93 time for calcul the mask position with numpy : 0.00022864341735839844 nb_pixel_total : 10098 time to create 1 rle with old method : 0.010928153991699219 length of segment : 80 time for calcul the mask position with numpy : 0.000732421875 nb_pixel_total : 13031 time to create 1 rle with old method : 0.014458417892456055 length of segment : 170 time for calcul the mask position with numpy : 0.0026667118072509766 nb_pixel_total : 44902 time to create 1 rle with old method : 0.0485684871673584 length of segment : 331 time for calcul the mask position with numpy : 0.0008451938629150391 nb_pixel_total : 32984 time to create 1 rle with old method : 0.03477644920349121 length of segment : 258 time for calcul the mask position with numpy : 0.000469207763671875 nb_pixel_total : 12892 time to create 1 rle with old method : 0.013962268829345703 length of segment : 140 time for calcul the mask position with numpy : 0.0010137557983398438 nb_pixel_total : 27644 time to create 1 rle with old method : 0.02882218360900879 length of segment : 185 time for calcul the mask position with numpy : 0.00030112266540527344 nb_pixel_total : 18564 time to create 1 rle with old method : 0.020601749420166016 length of segment : 169 time for calcul the mask position with numpy : 0.00010013580322265625 nb_pixel_total : 2738 time to create 1 rle with old method : 0.0032796859741210938 length of segment : 79 time for calcul the mask position with numpy : 0.00025653839111328125 nb_pixel_total : 10844 time to create 1 rle with old method : 0.011697053909301758 length of segment : 112 time for calcul the mask position with numpy : 0.0007233619689941406 nb_pixel_total : 28990 time to create 1 rle with old method : 0.031705617904663086 length of segment : 308 time for calcul the mask position with numpy : 0.0002989768981933594 nb_pixel_total : 16795 time to create 1 rle with old method : 0.02241373062133789 length of segment : 149 time for calcul the mask position with numpy : 0.001283407211303711 nb_pixel_total : 74838 time to create 1 rle with old method : 0.07969474792480469 length of segment : 293 time for calcul the mask position with numpy : 0.0009276866912841797 nb_pixel_total : 23267 time to create 1 rle with old method : 0.0264739990234375 length of segment : 182 time for calcul the mask position with numpy : 9.799003601074219e-05 nb_pixel_total : 3825 time to create 1 rle with old method : 0.0045261383056640625 length of segment : 59 time for calcul the mask position with numpy : 0.0002193450927734375 nb_pixel_total : 7949 time to create 1 rle with old method : 0.009033918380737305 length of segment : 117 time for calcul the mask position with numpy : 0.00045490264892578125 nb_pixel_total : 8951 time to create 1 rle with old method : 0.010550975799560547 length of segment : 80 time for calcul the mask position with numpy : 0.0004134178161621094 nb_pixel_total : 26198 time to create 1 rle with old method : 0.029969215393066406 length of segment : 188 time for calcul the mask position with numpy : 0.000301361083984375 nb_pixel_total : 17381 time to create 1 rle with old method : 0.019087553024291992 length of segment : 198 time for calcul the mask position with numpy : 0.00022363662719726562 nb_pixel_total : 13951 time to create 1 rle with old method : 0.015610694885253906 length of segment : 129 time for calcul the mask position with numpy : 0.00023746490478515625 nb_pixel_total : 14029 time to create 1 rle with old method : 0.015723705291748047 length of segment : 97 time for calcul the mask position with numpy : 0.00024509429931640625 nb_pixel_total : 12862 time to create 1 rle with old method : 0.01451563835144043 length of segment : 113 time for calcul the mask position with numpy : 0.0002086162567138672 nb_pixel_total : 9561 time to create 1 rle with old method : 0.010934829711914062 length of segment : 94 time for calcul the mask position with numpy : 0.0003857612609863281 nb_pixel_total : 21961 time to create 1 rle with old method : 0.024161815643310547 length of segment : 156 time for calcul the mask position with numpy : 0.0002765655517578125 nb_pixel_total : 10767 time to create 1 rle with old method : 0.012706756591796875 length of segment : 130 time for calcul the mask position with numpy : 0.0004909038543701172 nb_pixel_total : 19874 time to create 1 rle with old method : 0.021922826766967773 length of segment : 345 time for calcul the mask position with numpy : 0.0002257823944091797 nb_pixel_total : 13422 time to create 1 rle with old method : 0.014945507049560547 length of segment : 171 time for calcul the mask position with numpy : 0.00033974647521972656 nb_pixel_total : 14729 time to create 1 rle with old method : 0.015611886978149414 length of segment : 232 time for calcul the mask position with numpy : 0.0002396106719970703 nb_pixel_total : 13779 time to create 1 rle with old method : 0.015198945999145508 length of segment : 132 time for calcul the mask position with numpy : 0.00011777877807617188 nb_pixel_total : 3700 time to create 1 rle with old method : 0.004354000091552734 length of segment : 91 time for calcul the mask position with numpy : 0.0007801055908203125 nb_pixel_total : 50486 time to create 1 rle with old method : 0.0542910099029541 length of segment : 288 time for calcul the mask position with numpy : 0.0002944469451904297 nb_pixel_total : 15289 time to create 1 rle with old method : 0.017328739166259766 length of segment : 138 time for calcul the mask position with numpy : 0.0009627342224121094 nb_pixel_total : 47517 time to create 1 rle with old method : 0.050717830657958984 length of segment : 445 time for calcul the mask position with numpy : 0.0009961128234863281 nb_pixel_total : 19371 time to create 1 rle with old method : 0.020624876022338867 length of segment : 155 time for calcul the mask position with numpy : 0.0004565715789794922 nb_pixel_total : 6460 time to create 1 rle with old method : 0.006910800933837891 length of segment : 117 time for calcul the mask position with numpy : 0.0011065006256103516 nb_pixel_total : 17907 time to create 1 rle with old method : 0.01979851722717285 length of segment : 261 time for calcul the mask position with numpy : 0.0011031627655029297 nb_pixel_total : 16769 time to create 1 rle with old method : 0.019074440002441406 length of segment : 173 time for calcul the mask position with numpy : 0.005358219146728516 nb_pixel_total : 120649 time to create 1 rle with old method : 0.1397695541381836 length of segment : 311 time for calcul the mask position with numpy : 0.0019109249114990234 nb_pixel_total : 27193 time to create 1 rle with old method : 0.02848076820373535 length of segment : 257 time for calcul the mask position with numpy : 0.0017943382263183594 nb_pixel_total : 22220 time to create 1 rle with old method : 0.02402973175048828 length of segment : 219 time for calcul the mask position with numpy : 0.001108407974243164 nb_pixel_total : 21546 time to create 1 rle with old method : 0.023752450942993164 length of segment : 204 time for calcul the mask position with numpy : 0.0016028881072998047 nb_pixel_total : 25676 time to create 1 rle with old method : 0.02865433692932129 length of segment : 181 time for calcul the mask position with numpy : 0.0003502368927001953 nb_pixel_total : 5725 time to create 1 rle with old method : 0.0065119266510009766 length of segment : 123 time for calcul the mask position with numpy : 0.0004017353057861328 nb_pixel_total : 5238 time to create 1 rle with old method : 0.005919456481933594 length of segment : 122 time for calcul the mask position with numpy : 0.0007112026214599609 nb_pixel_total : 14784 time to create 1 rle with old method : 0.016834497451782227 length of segment : 190 time for calcul the mask position with numpy : 0.0024290084838867188 nb_pixel_total : 44505 time to create 1 rle with old method : 0.05074453353881836 length of segment : 310 time for calcul the mask position with numpy : 0.001329660415649414 nb_pixel_total : 34531 time to create 1 rle with old method : 0.03853106498718262 length of segment : 221 time for calcul the mask position with numpy : 0.002990245819091797 nb_pixel_total : 36034 time to create 1 rle with old method : 0.03915596008300781 length of segment : 281 time for calcul the mask position with numpy : 0.0011866092681884766 nb_pixel_total : 21125 time to create 1 rle with old method : 0.023436546325683594 length of segment : 368 time for calcul the mask position with numpy : 0.0003027915954589844 nb_pixel_total : 5432 time to create 1 rle with old method : 0.006496906280517578 length of segment : 87 time for calcul the mask position with numpy : 0.0016109943389892578 nb_pixel_total : 36163 time to create 1 rle with old method : 0.04015088081359863 length of segment : 224 time for calcul the mask position with numpy : 0.0004322528839111328 nb_pixel_total : 11949 time to create 1 rle with old method : 0.013765096664428711 length of segment : 165 time for calcul the mask position with numpy : 0.0010879039764404297 nb_pixel_total : 13742 time to create 1 rle with old method : 0.01506495475769043 length of segment : 240 time for calcul the mask position with numpy : 0.0014231204986572266 nb_pixel_total : 20737 time to create 1 rle with old method : 0.022772550582885742 length of segment : 229 time for calcul the mask position with numpy : 0.0018224716186523438 nb_pixel_total : 28122 time to create 1 rle with old method : 0.030817747116088867 length of segment : 365 time for calcul the mask position with numpy : 0.000518798828125 nb_pixel_total : 9458 time to create 1 rle with old method : 0.010831594467163086 length of segment : 153 time for calcul the mask position with numpy : 0.0010187625885009766 nb_pixel_total : 20492 time to create 1 rle with old method : 0.02284717559814453 length of segment : 253 time for calcul the mask position with numpy : 0.0006906986236572266 nb_pixel_total : 7788 time to create 1 rle with old method : 0.008678913116455078 length of segment : 131 time for calcul the mask position with numpy : 0.000896453857421875 nb_pixel_total : 15908 time to create 1 rle with old method : 0.020186662673950195 length of segment : 184 time for calcul the mask position with numpy : 0.000274658203125 nb_pixel_total : 1605 time to create 1 rle with old method : 0.0022084712982177734 length of segment : 56 time for calcul the mask position with numpy : 0.0005769729614257812 nb_pixel_total : 5714 time to create 1 rle with old method : 0.007463216781616211 length of segment : 118 time for calcul the mask position with numpy : 0.0006861686706542969 nb_pixel_total : 12420 time to create 1 rle with old method : 0.0161592960357666 length of segment : 116 time for calcul the mask position with numpy : 0.0004994869232177734 nb_pixel_total : 6510 time to create 1 rle with old method : 0.008315324783325195 length of segment : 71 time for calcul the mask position with numpy : 0.0017087459564208984 nb_pixel_total : 24325 time to create 1 rle with old method : 0.030089616775512695 length of segment : 209 time for calcul the mask position with numpy : 0.0018455982208251953 nb_pixel_total : 27132 time to create 1 rle with old method : 0.03300929069519043 length of segment : 210 time for calcul the mask position with numpy : 0.010012149810791016 nb_pixel_total : 140184 time to create 1 rle with old method : 0.17526578903198242 length of segment : 666 time for calcul the mask position with numpy : 0.0014162063598632812 nb_pixel_total : 30112 time to create 1 rle with old method : 0.03846096992492676 length of segment : 257 time for calcul the mask position with numpy : 0.0036284923553466797 nb_pixel_total : 60406 time to create 1 rle with old method : 0.07905220985412598 length of segment : 293 time for calcul the mask position with numpy : 0.003473997116088867 nb_pixel_total : 18576 time to create 1 rle with old method : 0.0238494873046875 length of segment : 434 time for calcul the mask position with numpy : 0.0010123252868652344 nb_pixel_total : 20746 time to create 1 rle with old method : 0.02593374252319336 length of segment : 141 time for calcul the mask position with numpy : 0.001337289810180664 nb_pixel_total : 18370 time to create 1 rle with old method : 0.02266240119934082 length of segment : 182 time for calcul the mask position with numpy : 0.0012989044189453125 nb_pixel_total : 34679 time to create 1 rle with old method : 0.04396677017211914 length of segment : 266 time for calcul the mask position with numpy : 0.00022721290588378906 nb_pixel_total : 6294 time to create 1 rle with old method : 0.008610010147094727 length of segment : 83 time for calcul the mask position with numpy : 0.001653432846069336 nb_pixel_total : 30455 time to create 1 rle with old method : 0.04090261459350586 length of segment : 264 time for calcul the mask position with numpy : 0.0031592845916748047 nb_pixel_total : 40428 time to create 1 rle with old method : 0.05228710174560547 length of segment : 292 time for calcul the mask position with numpy : 0.000209808349609375 nb_pixel_total : 4115 time to create 1 rle with old method : 0.005300045013427734 length of segment : 82 time spent for convertir_results : 13.385474443435669 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 192 chid ids of type : 3594 Number RLEs to save : 48599 save missing photos in datou_result : time spend for datou_step_exec : 86.99574995040894 time spend to save output : 2.991978883743286 total time spend for step 1 : 89.98772883415222 step2:crop_condition Wed Feb 12 21:12:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 192 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 135 About to insert : list_path_to_insert length 135 new photo from crops ! About to upload 135 photos upload in portfolio : 3736932 init cache_photo without model_param we have 135 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739391142_909083 we have uploaded 135 photos in the portfolio 3736932 time of upload the photos Elapsed time : 39.83740210533142 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 37 About to insert : list_path_to_insert length 37 new photo from crops ! About to upload 37 photos upload in portfolio : 3736932 init cache_photo without model_param we have 37 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739391193_909083 we have uploaded 37 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.215705394744873 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739391202_909083 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7476766109466553 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 13 About to insert : list_path_to_insert length 13 new photo from crops ! About to upload 13 photos upload in portfolio : 3736932 init cache_photo without model_param we have 13 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739391210_909083 we have uploaded 13 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.2577593326568604 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739391215_909083 we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.3828887939453125 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739391217_909083 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6622240543365479 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1337140778, 1337140774, 1337140597, 1337140593, 1337140588, 1337140578, 1337140570, 1337140340] Looping around the photos to save general results len do output : 192 /1337182966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337182999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337183469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140778', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140774', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140597', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140593', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140588', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140578', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140570', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140340', None, None, None, None, None, '2580678') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 584 time used for this insertion : 0.03318619728088379 save_final save missing photos in datou_result : time spend for datou_step_exec : 97.47697710990906 time spend to save output : 0.03836846351623535 total time spend for step 2 : 97.5153455734253 step3:rle_unique_nms_with_priority Wed Feb 12 21:13:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 192 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 31 nb_hashtags : 3 time to prepare the origin masks : 3.2468338012695312 time for calcul the mask position with numpy : 0.07149195671081543 nb_pixel_total : 6215463 time to create 1 rle with new method : 2.4511396884918213 time for calcul the mask position with numpy : 0.028007030487060547 nb_pixel_total : 23550 time to create 1 rle with old method : 0.026134252548217773 time for calcul the mask position with numpy : 0.029877662658691406 nb_pixel_total : 25487 time to create 1 rle with old method : 0.03117060661315918 time for calcul the mask position with numpy : 0.02956223487854004 nb_pixel_total : 27865 time to create 1 rle with old method : 0.031887054443359375 time for calcul the mask position with numpy : 0.028754472732543945 nb_pixel_total : 30345 time to create 1 rle with old method : 0.03390359878540039 time for calcul the mask position with numpy : 0.027968406677246094 nb_pixel_total : 18789 time to create 1 rle with old method : 0.02175617218017578 time for calcul the mask position with numpy : 0.029477596282958984 nb_pixel_total : 20381 time to create 1 rle with old method : 0.023131847381591797 time for calcul the mask position with numpy : 0.030041933059692383 nb_pixel_total : 99708 time to create 1 rle with old method : 0.11167192459106445 time for calcul the mask position with numpy : 0.02850794792175293 nb_pixel_total : 17175 time to create 1 rle with old method : 0.019486427307128906 time for calcul the mask position with numpy : 0.02978682518005371 nb_pixel_total : 30366 time to create 1 rle with old method : 0.03286480903625488 time for calcul the mask position with numpy : 0.028558731079101562 nb_pixel_total : 38823 time to create 1 rle with old method : 0.042260169982910156 time for calcul the mask position with numpy : 0.028804779052734375 nb_pixel_total : 26867 time to create 1 rle with old method : 0.03216290473937988 time for calcul the mask position with numpy : 0.02850341796875 nb_pixel_total : 23691 time to create 1 rle with old method : 0.026004314422607422 time for calcul the mask position with numpy : 0.028043270111083984 nb_pixel_total : 7238 time to create 1 rle with old method : 0.008148431777954102 time for calcul the mask position with numpy : 0.028095006942749023 nb_pixel_total : 18944 time to create 1 rle with old method : 0.020391464233398438 time for calcul the mask position with numpy : 0.028501272201538086 nb_pixel_total : 115938 time to create 1 rle with old method : 0.12071800231933594 time for calcul the mask position with numpy : 0.02740025520324707 nb_pixel_total : 20205 time to create 1 rle with old method : 0.021718502044677734 time for calcul the mask position with numpy : 0.026987075805664062 nb_pixel_total : 2137 time to create 1 rle with old method : 0.002206563949584961 time for calcul the mask position with numpy : 0.02675628662109375 nb_pixel_total : 19542 time to create 1 rle with old method : 0.020487546920776367 time for calcul the mask position with numpy : 0.027357816696166992 nb_pixel_total : 46338 time to create 1 rle with old method : 0.05144977569580078 time for calcul the mask position with numpy : 0.03134322166442871 nb_pixel_total : 7976 time to create 1 rle with old method : 0.008949756622314453 time for calcul the mask position with numpy : 0.02854013442993164 nb_pixel_total : 1077 time to create 1 rle with old method : 0.0012412071228027344 time for calcul the mask position with numpy : 0.029018402099609375 nb_pixel_total : 2452 time to create 1 rle with old method : 0.0028803348541259766 time for calcul the mask position with numpy : 0.028666019439697266 nb_pixel_total : 45238 time to create 1 rle with old method : 0.04861950874328613 time for calcul the mask position with numpy : 0.028050899505615234 nb_pixel_total : 14346 time to create 1 rle with old method : 0.01620316505432129 time for calcul the mask position with numpy : 0.028421878814697266 nb_pixel_total : 25784 time to create 1 rle with old method : 0.028990983963012695 time for calcul the mask position with numpy : 0.02864217758178711 nb_pixel_total : 61436 time to create 1 rle with old method : 0.06747126579284668 time for calcul the mask position with numpy : 0.02896857261657715 nb_pixel_total : 16646 time to create 1 rle with old method : 0.01830458641052246 time for calcul the mask position with numpy : 0.02841329574584961 nb_pixel_total : 35786 time to create 1 rle with old method : 0.03928685188293457 time for calcul the mask position with numpy : 0.02803182601928711 nb_pixel_total : 4879 time to create 1 rle with old method : 0.0056841373443603516 time for calcul the mask position with numpy : 0.028325557708740234 nb_pixel_total : 3626 time to create 1 rle with old method : 0.004067897796630859 time for calcul the mask position with numpy : 0.028316259384155273 nb_pixel_total : 2142 time to create 1 rle with old method : 0.0025043487548828125 create new chi : 4.347984313964844 time to delete rle : 0.014116048812866211 batch 1 Loaded 63 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 14825 TO DO : save crop sub photo not yet done ! save time : 0.9154846668243408 nb_obj : 15 nb_hashtags : 4 time to prepare the origin masks : 6.411978483200073 time for calcul the mask position with numpy : 0.49333715438842773 nb_pixel_total : 6350738 time to create 1 rle with new method : 0.8556859493255615 time for calcul the mask position with numpy : 0.02144789695739746 nb_pixel_total : 10571 time to create 1 rle with old method : 0.012063980102539062 time for calcul the mask position with numpy : 0.023058652877807617 nb_pixel_total : 193659 time to create 1 rle with new method : 0.952606201171875 time for calcul the mask position with numpy : 0.026528596878051758 nb_pixel_total : 20978 time to create 1 rle with old method : 0.0247189998626709 time for calcul the mask position with numpy : 0.023263931274414062 nb_pixel_total : 28887 time to create 1 rle with old method : 0.031187057495117188 time for calcul the mask position with numpy : 0.026144742965698242 nb_pixel_total : 91337 time to create 1 rle with old method : 0.10152482986450195 time for calcul the mask position with numpy : 0.027813434600830078 nb_pixel_total : 35426 time to create 1 rle with old method : 0.0399627685546875 time for calcul the mask position with numpy : 0.024523496627807617 nb_pixel_total : 14958 time to create 1 rle with old method : 0.017487764358520508 time for calcul the mask position with numpy : 0.023104429244995117 nb_pixel_total : 12808 time to create 1 rle with old method : 0.014528036117553711 time for calcul the mask position with numpy : 0.022688865661621094 nb_pixel_total : 11104 time to create 1 rle with old method : 0.012487173080444336 time for calcul the mask position with numpy : 0.02287912368774414 nb_pixel_total : 29013 time to create 1 rle with old method : 0.03229784965515137 time for calcul the mask position with numpy : 0.0259549617767334 nb_pixel_total : 13287 time to create 1 rle with old method : 0.01473093032836914 time for calcul the mask position with numpy : 0.026186227798461914 nb_pixel_total : 18508 time to create 1 rle with old method : 0.0215456485748291 time for calcul the mask position with numpy : 0.027477502822875977 nb_pixel_total : 168741 time to create 1 rle with new method : 0.8962373733520508 time for calcul the mask position with numpy : 0.02451920509338379 nb_pixel_total : 9786 time to create 1 rle with old method : 0.010865211486816406 time for calcul the mask position with numpy : 0.02123403549194336 nb_pixel_total : 40439 time to create 1 rle with old method : 0.045711517333984375 create new chi : 4.025353908538818 time to delete rle : 0.0019366741180419922 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 10296 TO DO : save crop sub photo not yet done ! save time : 0.665496826171875 nb_obj : 18 nb_hashtags : 4 time to prepare the origin masks : 6.812739849090576 time for calcul the mask position with numpy : 0.6252193450927734 nb_pixel_total : 5657005 time to create 1 rle with new method : 0.9958643913269043 time for calcul the mask position with numpy : 0.021767616271972656 nb_pixel_total : 15325 time to create 1 rle with old method : 0.01709747314453125 time for calcul the mask position with numpy : 0.025417804718017578 nb_pixel_total : 83753 time to create 1 rle with old method : 0.09477567672729492 time for calcul the mask position with numpy : 0.02385091781616211 nb_pixel_total : 175509 time to create 1 rle with new method : 0.7956762313842773 time for calcul the mask position with numpy : 0.023944616317749023 nb_pixel_total : 26252 time to create 1 rle with old method : 0.029371261596679688 time for calcul the mask position with numpy : 0.024122238159179688 nb_pixel_total : 99440 time to create 1 rle with old method : 0.10960054397583008 time for calcul the mask position with numpy : 0.028209209442138672 nb_pixel_total : 6975 time to create 1 rle with old method : 0.008456945419311523 time for calcul the mask position with numpy : 0.027261734008789062 nb_pixel_total : 138766 time to create 1 rle with old method : 0.15075373649597168 time for calcul the mask position with numpy : 0.022959470748901367 nb_pixel_total : 65197 time to create 1 rle with old method : 0.07319474220275879 time for calcul the mask position with numpy : 0.021877527236938477 nb_pixel_total : 45736 time to create 1 rle with old method : 0.05443000793457031 time for calcul the mask position with numpy : 0.024065017700195312 nb_pixel_total : 141887 time to create 1 rle with old method : 0.15166258811950684 time for calcul the mask position with numpy : 0.024233102798461914 nb_pixel_total : 215299 time to create 1 rle with new method : 0.5970702171325684 time for calcul the mask position with numpy : 0.02264404296875 nb_pixel_total : 62333 time to create 1 rle with old method : 0.06880569458007812 time for calcul the mask position with numpy : 0.024115562438964844 nb_pixel_total : 20681 time to create 1 rle with old method : 0.023302555084228516 time for calcul the mask position with numpy : 0.023684263229370117 nb_pixel_total : 33311 time to create 1 rle with old method : 0.0367436408996582 time for calcul the mask position with numpy : 0.024013996124267578 nb_pixel_total : 166989 time to create 1 rle with new method : 0.6378133296966553 time for calcul the mask position with numpy : 0.022527456283569336 nb_pixel_total : 24537 time to create 1 rle with old method : 0.026554346084594727 time for calcul the mask position with numpy : 0.021528959274291992 nb_pixel_total : 60311 time to create 1 rle with old method : 0.0647428035736084 time for calcul the mask position with numpy : 0.021396398544311523 nb_pixel_total : 10934 time to create 1 rle with old method : 0.012796878814697266 create new chi : 5.105970859527588 time to delete rle : 0.0022077560424804688 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 14721 TO DO : save crop sub photo not yet done ! save time : 1.1797270774841309 nb_obj : 19 nb_hashtags : 5 time to prepare the origin masks : 6.017899990081787 time for calcul the mask position with numpy : 0.3818790912628174 nb_pixel_total : 5075576 time to create 1 rle with new method : 0.5684800148010254 time for calcul the mask position with numpy : 0.023350000381469727 nb_pixel_total : 166537 time to create 1 rle with new method : 0.4658334255218506 time for calcul the mask position with numpy : 0.03371453285217285 nb_pixel_total : 8820 time to create 1 rle with old method : 0.01035165786743164 time for calcul the mask position with numpy : 0.03081679344177246 nb_pixel_total : 17312 time to create 1 rle with old method : 0.018418073654174805 time for calcul the mask position with numpy : 0.03274106979370117 nb_pixel_total : 61756 time to create 1 rle with old method : 0.06600761413574219 time for calcul the mask position with numpy : 0.030045032501220703 nb_pixel_total : 638588 time to create 1 rle with new method : 0.594104528427124 time for calcul the mask position with numpy : 0.019651174545288086 nb_pixel_total : 39726 time to create 1 rle with old method : 0.042482852935791016 time for calcul the mask position with numpy : 0.020578622817993164 nb_pixel_total : 39689 time to create 1 rle with old method : 0.04407453536987305 time for calcul the mask position with numpy : 0.02049422264099121 nb_pixel_total : 28886 time to create 1 rle with old method : 0.030674457550048828 time for calcul the mask position with numpy : 0.019921302795410156 nb_pixel_total : 15385 time to create 1 rle with old method : 0.01690053939819336 time for calcul the mask position with numpy : 0.02234792709350586 nb_pixel_total : 255551 time to create 1 rle with new method : 0.5074968338012695 time for calcul the mask position with numpy : 0.020804882049560547 nb_pixel_total : 8922 time to create 1 rle with old method : 0.009835243225097656 time for calcul the mask position with numpy : 0.02205801010131836 nb_pixel_total : 149792 time to create 1 rle with old method : 0.15625810623168945 time for calcul the mask position with numpy : 0.020311594009399414 nb_pixel_total : 4200 time to create 1 rle with old method : 0.004740238189697266 time for calcul the mask position with numpy : 0.021625041961669922 nb_pixel_total : 11816 time to create 1 rle with old method : 0.01354527473449707 time for calcul the mask position with numpy : 0.020895957946777344 nb_pixel_total : 27771 time to create 1 rle with old method : 0.03045797348022461 time for calcul the mask position with numpy : 0.022316932678222656 nb_pixel_total : 36046 time to create 1 rle with old method : 0.03862333297729492 time for calcul the mask position with numpy : 0.02155470848083496 nb_pixel_total : 56482 time to create 1 rle with old method : 0.05945754051208496 time for calcul the mask position with numpy : 0.021805763244628906 nb_pixel_total : 13622 time to create 1 rle with old method : 0.01502370834350586 time for calcul the mask position with numpy : 0.023075580596923828 nb_pixel_total : 393763 time to create 1 rle with new method : 0.480090856552124 create new chi : 4.133768320083618 time to delete rle : 0.0022535324096679688 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 15848 TO DO : save crop sub photo not yet done ! save time : 0.9813516139984131 nb_obj : 23 nb_hashtags : 2 time to prepare the origin masks : 6.290446043014526 time for calcul the mask position with numpy : 0.46646690368652344 nb_pixel_total : 5857555 time to create 1 rle with new method : 0.5683927536010742 time for calcul the mask position with numpy : 0.020756959915161133 nb_pixel_total : 98383 time to create 1 rle with old method : 0.1105799674987793 time for calcul the mask position with numpy : 0.02065753936767578 nb_pixel_total : 20137 time to create 1 rle with old method : 0.022055625915527344 time for calcul the mask position with numpy : 0.020154953002929688 nb_pixel_total : 19812 time to create 1 rle with old method : 0.022518396377563477 time for calcul the mask position with numpy : 0.02120351791381836 nb_pixel_total : 19745 time to create 1 rle with old method : 0.021593809127807617 time for calcul the mask position with numpy : 0.02210235595703125 nb_pixel_total : 46324 time to create 1 rle with old method : 0.05035996437072754 time for calcul the mask position with numpy : 0.02170085906982422 nb_pixel_total : 108162 time to create 1 rle with old method : 0.11717987060546875 time for calcul the mask position with numpy : 0.02147388458251953 nb_pixel_total : 99318 time to create 1 rle with old method : 0.1072244644165039 time for calcul the mask position with numpy : 0.02122187614440918 nb_pixel_total : 15959 time to create 1 rle with old method : 0.017824649810791016 time for calcul the mask position with numpy : 0.0207977294921875 nb_pixel_total : 48452 time to create 1 rle with old method : 0.05047798156738281 time for calcul the mask position with numpy : 0.019696474075317383 nb_pixel_total : 17413 time to create 1 rle with old method : 0.018666982650756836 time for calcul the mask position with numpy : 0.020169973373413086 nb_pixel_total : 12687 time to create 1 rle with old method : 0.013922691345214844 time for calcul the mask position with numpy : 0.020879507064819336 nb_pixel_total : 22707 time to create 1 rle with old method : 0.02521800994873047 time for calcul the mask position with numpy : 0.020522594451904297 nb_pixel_total : 39773 time to create 1 rle with old method : 0.043332815170288086 time for calcul the mask position with numpy : 0.02151179313659668 nb_pixel_total : 111552 time to create 1 rle with old method : 0.11873579025268555 time for calcul the mask position with numpy : 0.021381378173828125 nb_pixel_total : 22659 time to create 1 rle with old method : 0.025160789489746094 time for calcul the mask position with numpy : 0.022272109985351562 nb_pixel_total : 160127 time to create 1 rle with new method : 0.7818624973297119 time for calcul the mask position with numpy : 0.02167034149169922 nb_pixel_total : 31057 time to create 1 rle with old method : 0.03424978256225586 time for calcul the mask position with numpy : 0.021325349807739258 nb_pixel_total : 71594 time to create 1 rle with old method : 0.0770101547241211 time for calcul the mask position with numpy : 0.020654916763305664 nb_pixel_total : 13160 time to create 1 rle with old method : 0.014681339263916016 time for calcul the mask position with numpy : 0.02084207534790039 nb_pixel_total : 43361 time to create 1 rle with old method : 0.04736471176147461 time for calcul the mask position with numpy : 0.02457141876220703 nb_pixel_total : 14461 time to create 1 rle with old method : 0.016501903533935547 time for calcul the mask position with numpy : 0.021343469619750977 nb_pixel_total : 48217 time to create 1 rle with old method : 0.05204939842224121 time for calcul the mask position with numpy : 0.02063727378845215 nb_pixel_total : 107625 time to create 1 rle with old method : 0.11276364326477051 create new chi : 3.486668825149536 time to delete rle : 0.0024101734161376953 batch 1 Loaded 47 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 16142 TO DO : save crop sub photo not yet done ! save time : 1.0962374210357666 nb_obj : 27 nb_hashtags : 3 time to prepare the origin masks : 3.3716554641723633 time for calcul the mask position with numpy : 0.08331155776977539 nb_pixel_total : 6299947 time to create 1 rle with new method : 0.350006103515625 time for calcul the mask position with numpy : 0.028482675552368164 nb_pixel_total : 112690 time to create 1 rle with old method : 0.12161874771118164 time for calcul the mask position with numpy : 0.02721691131591797 nb_pixel_total : 65323 time to create 1 rle with old method : 0.06935286521911621 time for calcul the mask position with numpy : 0.02613091468811035 nb_pixel_total : 8951 time to create 1 rle with old method : 0.009888648986816406 time for calcul the mask position with numpy : 0.026208162307739258 nb_pixel_total : 10117 time to create 1 rle with old method : 0.010925054550170898 time for calcul the mask position with numpy : 0.026587486267089844 nb_pixel_total : 13031 time to create 1 rle with old method : 0.014028072357177734 time for calcul the mask position with numpy : 0.02736210823059082 nb_pixel_total : 11795 time to create 1 rle with old method : 0.013988733291625977 time for calcul the mask position with numpy : 0.02741098403930664 nb_pixel_total : 12892 time to create 1 rle with old method : 0.014026641845703125 time for calcul the mask position with numpy : 0.026613235473632812 nb_pixel_total : 23942 time to create 1 rle with old method : 0.025705575942993164 time for calcul the mask position with numpy : 0.026177167892456055 nb_pixel_total : 44902 time to create 1 rle with old method : 0.04731488227844238 time for calcul the mask position with numpy : 0.027115821838378906 nb_pixel_total : 27644 time to create 1 rle with old method : 0.028411388397216797 time for calcul the mask position with numpy : 0.0286252498626709 nb_pixel_total : 23267 time to create 1 rle with old method : 0.026310443878173828 time for calcul the mask position with numpy : 0.03130316734313965 nb_pixel_total : 8518 time to create 1 rle with old method : 0.009647846221923828 time for calcul the mask position with numpy : 0.0275881290435791 nb_pixel_total : 423 time to create 1 rle with old method : 0.0006146430969238281 time for calcul the mask position with numpy : 0.027869462966918945 nb_pixel_total : 37271 time to create 1 rle with old method : 0.04061174392700195 time for calcul the mask position with numpy : 0.027506589889526367 nb_pixel_total : 32984 time to create 1 rle with old method : 0.03530383110046387 time for calcul the mask position with numpy : 0.027757883071899414 nb_pixel_total : 28990 time to create 1 rle with old method : 0.032282114028930664 time for calcul the mask position with numpy : 0.0280911922454834 nb_pixel_total : 4751 time to create 1 rle with old method : 0.005765199661254883 time for calcul the mask position with numpy : 0.028229713439941406 nb_pixel_total : 18564 time to create 1 rle with old method : 0.02035808563232422 time for calcul the mask position with numpy : 0.02848029136657715 nb_pixel_total : 7404 time to create 1 rle with old method : 0.00807332992553711 time for calcul the mask position with numpy : 0.028172731399536133 nb_pixel_total : 3825 time to create 1 rle with old method : 0.004327297210693359 time for calcul the mask position with numpy : 0.03708148002624512 nb_pixel_total : 2738 time to create 1 rle with old method : 0.003296375274658203 time for calcul the mask position with numpy : 0.028685569763183594 nb_pixel_total : 16010 time to create 1 rle with old method : 0.0175628662109375 time for calcul the mask position with numpy : 0.02815842628479004 nb_pixel_total : 74838 time to create 1 rle with old method : 0.0803070068359375 time for calcul the mask position with numpy : 0.028342008590698242 nb_pixel_total : 16358 time to create 1 rle with old method : 0.01781916618347168 time for calcul the mask position with numpy : 0.028080224990844727 nb_pixel_total : 28844 time to create 1 rle with old method : 0.03013777732849121 time for calcul the mask position with numpy : 0.02779245376586914 nb_pixel_total : 103377 time to create 1 rle with old method : 0.10969209671020508 time for calcul the mask position with numpy : 0.02768564224243164 nb_pixel_total : 10844 time to create 1 rle with old method : 0.012142419815063477 create new chi : 2.0217862129211426 time to delete rle : 0.0018339157104492188 batch 1 Loaded 55 chid ids of type : 3594 +++++++++++++++++++++++++++++++++Number RLEs to save : 12017 TO DO : save crop sub photo not yet done ! save time : 0.7800023555755615 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 3.472661018371582 time for calcul the mask position with numpy : 0.44601941108703613 nb_pixel_total : 6747206 time to create 1 rle with new method : 0.6852240562438965 time for calcul the mask position with numpy : 0.02032780647277832 nb_pixel_total : 45045 time to create 1 rle with old method : 0.04714465141296387 time for calcul the mask position with numpy : 0.020050525665283203 nb_pixel_total : 15289 time to create 1 rle with old method : 0.01650404930114746 time for calcul the mask position with numpy : 0.02039313316345215 nb_pixel_total : 50486 time to create 1 rle with old method : 0.05489969253540039 time for calcul the mask position with numpy : 0.019567012786865234 nb_pixel_total : 3700 time to create 1 rle with old method : 0.004094839096069336 time for calcul the mask position with numpy : 0.019884347915649414 nb_pixel_total : 13779 time to create 1 rle with old method : 0.014558553695678711 time for calcul the mask position with numpy : 0.020013093948364258 nb_pixel_total : 14729 time to create 1 rle with old method : 0.015817642211914062 time for calcul the mask position with numpy : 0.02103567123413086 nb_pixel_total : 13422 time to create 1 rle with old method : 0.014362573623657227 time for calcul the mask position with numpy : 0.01985311508178711 nb_pixel_total : 19874 time to create 1 rle with old method : 0.021528959274291992 time for calcul the mask position with numpy : 0.020204782485961914 nb_pixel_total : 10767 time to create 1 rle with old method : 0.011008501052856445 time for calcul the mask position with numpy : 0.021758317947387695 nb_pixel_total : 21961 time to create 1 rle with old method : 0.022701740264892578 time for calcul the mask position with numpy : 0.020850181579589844 nb_pixel_total : 9561 time to create 1 rle with old method : 0.01025080680847168 time for calcul the mask position with numpy : 0.020541906356811523 nb_pixel_total : 12862 time to create 1 rle with old method : 0.01424551010131836 time for calcul the mask position with numpy : 0.02167057991027832 nb_pixel_total : 14029 time to create 1 rle with old method : 0.015069961547851562 time for calcul the mask position with numpy : 0.020741701126098633 nb_pixel_total : 13951 time to create 1 rle with old method : 0.014860391616821289 time for calcul the mask position with numpy : 0.021179676055908203 nb_pixel_total : 17381 time to create 1 rle with old method : 0.018636465072631836 time for calcul the mask position with numpy : 0.021292686462402344 nb_pixel_total : 26198 time to create 1 rle with old method : 0.027349472045898438 create new chi : 1.8183014392852783 time to delete rle : 0.0012292861938476562 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 7962 TO DO : save crop sub photo not yet done ! save time : 0.5088951587677002 nb_obj : 43 nb_hashtags : 3 time to prepare the origin masks : 3.7650630474090576 time for calcul the mask position with numpy : 0.07579922676086426 nb_pixel_total : 5964207 time to create 1 rle with new method : 0.7494392395019531 time for calcul the mask position with numpy : 0.028766870498657227 nb_pixel_total : 6510 time to create 1 rle with old method : 0.008011817932128906 time for calcul the mask position with numpy : 0.028830289840698242 nb_pixel_total : 20746 time to create 1 rle with old method : 0.02402329444885254 time for calcul the mask position with numpy : 0.028987884521484375 nb_pixel_total : 18576 time to create 1 rle with old method : 0.022230148315429688 time for calcul the mask position with numpy : 0.029237985610961914 nb_pixel_total : 13742 time to create 1 rle with old method : 0.016128063201904297 time for calcul the mask position with numpy : 0.02808547019958496 nb_pixel_total : 27132 time to create 1 rle with old method : 0.0312952995300293 time for calcul the mask position with numpy : 0.02747797966003418 nb_pixel_total : 9458 time to create 1 rle with old method : 0.011199712753295898 time for calcul the mask position with numpy : 0.0281069278717041 nb_pixel_total : 20492 time to create 1 rle with old method : 0.02406144142150879 time for calcul the mask position with numpy : 0.029444217681884766 nb_pixel_total : 27193 time to create 1 rle with old method : 0.03190493583679199 time for calcul the mask position with numpy : 0.028897762298583984 nb_pixel_total : 36034 time to create 1 rle with old method : 0.0395965576171875 time for calcul the mask position with numpy : 0.028450727462768555 nb_pixel_total : 12420 time to create 1 rle with old method : 0.013876199722290039 time for calcul the mask position with numpy : 0.027795076370239258 nb_pixel_total : 5432 time to create 1 rle with old method : 0.006275177001953125 time for calcul the mask position with numpy : 0.027913570404052734 nb_pixel_total : 6460 time to create 1 rle with old method : 0.00716853141784668 time for calcul the mask position with numpy : 0.02702927589416504 nb_pixel_total : 60406 time to create 1 rle with old method : 0.06323766708374023 time for calcul the mask position with numpy : 0.02754950523376465 nb_pixel_total : 5714 time to create 1 rle with old method : 0.006437540054321289 time for calcul the mask position with numpy : 0.02754831314086914 nb_pixel_total : 25676 time to create 1 rle with old method : 0.027410507202148438 time for calcul the mask position with numpy : 0.027318239212036133 nb_pixel_total : 40428 time to create 1 rle with old method : 0.04374861717224121 time for calcul the mask position with numpy : 0.027413368225097656 nb_pixel_total : 30112 time to create 1 rle with old method : 0.032393693923950195 time for calcul the mask position with numpy : 0.026847362518310547 nb_pixel_total : 24325 time to create 1 rle with old method : 0.027382373809814453 time for calcul the mask position with numpy : 0.027634382247924805 nb_pixel_total : 140184 time to create 1 rle with old method : 0.1440117359161377 time for calcul the mask position with numpy : 0.02657151222229004 nb_pixel_total : 16769 time to create 1 rle with old method : 0.017873764038085938 time for calcul the mask position with numpy : 0.0276339054107666 nb_pixel_total : 20737 time to create 1 rle with old method : 0.021648168563842773 time for calcul the mask position with numpy : 0.026273012161254883 nb_pixel_total : 15908 time to create 1 rle with old method : 0.017312049865722656 time for calcul the mask position with numpy : 0.026546955108642578 nb_pixel_total : 30455 time to create 1 rle with old method : 0.033586740493774414 time for calcul the mask position with numpy : 0.026952505111694336 nb_pixel_total : 3281 time to create 1 rle with old method : 0.0035581588745117188 time for calcul the mask position with numpy : 0.027083158493041992 nb_pixel_total : 7788 time to create 1 rle with old method : 0.008516311645507812 time for calcul the mask position with numpy : 0.027309179306030273 nb_pixel_total : 17907 time to create 1 rle with old method : 0.018761157989501953 time for calcul the mask position with numpy : 0.026698589324951172 nb_pixel_total : 19371 time to create 1 rle with old method : 0.020425796508789062 time for calcul the mask position with numpy : 0.027580976486206055 nb_pixel_total : 5723 time to create 1 rle with old method : 0.006294727325439453 time for calcul the mask position with numpy : 0.02700328826904297 nb_pixel_total : 14784 time to create 1 rle with old method : 0.016269207000732422 time for calcul the mask position with numpy : 0.02842879295349121 nb_pixel_total : 22220 time to create 1 rle with old method : 0.029595136642456055 time for calcul the mask position with numpy : 0.03277230262756348 nb_pixel_total : 34531 time to create 1 rle with old method : 0.03761625289916992 time for calcul the mask position with numpy : 0.0283815860748291 nb_pixel_total : 4825 time to create 1 rle with old method : 0.006160259246826172 time for calcul the mask position with numpy : 0.02933478355407715 nb_pixel_total : 28122 time to create 1 rle with old method : 0.030274152755737305 time for calcul the mask position with numpy : 0.028339624404907227 nb_pixel_total : 11949 time to create 1 rle with old method : 0.013465404510498047 time for calcul the mask position with numpy : 0.027888059616088867 nb_pixel_total : 17868 time to create 1 rle with old method : 0.021001100540161133 time for calcul the mask position with numpy : 0.028743505477905273 nb_pixel_total : 44505 time to create 1 rle with old method : 0.048757076263427734 time for calcul the mask position with numpy : 0.02774786949157715 nb_pixel_total : 36163 time to create 1 rle with old method : 0.04036593437194824 time for calcul the mask position with numpy : 0.02855515480041504 nb_pixel_total : 5238 time to create 1 rle with old method : 0.0060710906982421875 time for calcul the mask position with numpy : 0.02869129180908203 nb_pixel_total : 1605 time to create 1 rle with old method : 0.0017917156219482422 time for calcul the mask position with numpy : 0.028366804122924805 nb_pixel_total : 21546 time to create 1 rle with old method : 0.023236751556396484 time for calcul the mask position with numpy : 0.028166532516479492 nb_pixel_total : 34679 time to create 1 rle with old method : 0.03898906707763672 time for calcul the mask position with numpy : 0.029050588607788086 nb_pixel_total : 120649 time to create 1 rle with old method : 0.12611007690429688 time for calcul the mask position with numpy : 0.02814650535583496 nb_pixel_total : 18370 time to create 1 rle with old method : 0.019589662551879883 create new chi : 3.2373297214508057 time to delete rle : 0.002687215805053711 batch 1 Loaded 87 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 20433 TO DO : save crop sub photo not yet done ! save time : 1.4769368171691895 map_output_result : {1337140778: (0.0, 'Should be the crop_list due to order', 0.0), 1337140774: (0.0, 'Should be the crop_list due to order', 0.0), 1337140597: (0.0, 'Should be the crop_list due to order', 0.0), 1337140593: (0.0, 'Should be the crop_list due to order', 0.0), 1337140588: (0.0, 'Should be the crop_list due to order', 0.0), 1337140578: (0.0, 'Should be the crop_list due to order', 0.0), 1337140570: (0.0, 'Should be the crop_list due to order', 0.0), 1337140340: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1337140778, 1337140774, 1337140597, 1337140593, 1337140588, 1337140578, 1337140570, 1337140340] Looping around the photos to save general results len do output : 8 /1337140778.Didn't retrieve data . /1337140774.Didn't retrieve data . /1337140597.Didn't retrieve data . /1337140593.Didn't retrieve data . /1337140588.Didn't retrieve data . /1337140578.Didn't retrieve data . /1337140570.Didn't retrieve data . /1337140340.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140778', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140774', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140597', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140593', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140588', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140578', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140570', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140340', None, None, None, None, None, '2580678') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.17781376838684082 save_final save missing photos in datou_result : time spend for datou_step_exec : 76.04598045349121 time spend to save output : 0.17818689346313477 total time spend for step 3 : 76.22416734695435 step4:ventilate_hashtags_in_portfolio Wed Feb 12 21:14:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20491208 get user id for portfolio 20491208 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20491208 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','carton','pet_fonce','flou','metal','autre','pehd','environnement','mal_croppe','papier','background')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20491208 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','carton','pet_fonce','flou','metal','autre','pehd','environnement','mal_croppe','papier','background')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20491208 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','carton','pet_fonce','flou','metal','autre','pehd','environnement','mal_croppe','papier','background')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/20491661,20491662,20491663,20491664,20491665,20491666,20491667,20491668,20491669,20491670,20491671?tags=pet_clair,carton,pet_fonce,flou,metal,autre,pehd,environnement,mal_croppe,papier,background Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1337140778, 1337140774, 1337140597, 1337140593, 1337140588, 1337140578, 1337140570, 1337140340] Looping around the photos to save general results len do output : 1 /20491208. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140778', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140774', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140597', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140593', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140588', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140578', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140570', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140340', None, None, None, None, None, '2580678') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014985084533691406 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.110396385192871 time spend to save output : 0.015235424041748047 total time spend for step 4 : 2.125631809234619 step5:final Wed Feb 12 21:14:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1337140778: ('0.14599189176538674',), 1337140774: ('0.14599189176538674',), 1337140597: ('0.14599189176538674',), 1337140593: ('0.14599189176538674',), 1337140588: ('0.14599189176538674',), 1337140578: ('0.14599189176538674',), 1337140570: ('0.14599189176538674',), 1337140340: ('0.14599189176538674',)} new output for save of step final : {1337140778: ('0.14599189176538674',), 1337140774: ('0.14599189176538674',), 1337140597: ('0.14599189176538674',), 1337140593: ('0.14599189176538674',), 1337140588: ('0.14599189176538674',), 1337140578: ('0.14599189176538674',), 1337140570: ('0.14599189176538674',), 1337140340: ('0.14599189176538674',)} [1337140778, 1337140774, 1337140597, 1337140593, 1337140588, 1337140578, 1337140570, 1337140340] Looping around the photos to save general results len do output : 8 /1337140778.Didn't retrieve data . /1337140774.Didn't retrieve data . /1337140597.Didn't retrieve data . /1337140593.Didn't retrieve data . /1337140588.Didn't retrieve data . /1337140578.Didn't retrieve data . /1337140570.Didn't retrieve data . /1337140340.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140778', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140774', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140597', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140593', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140588', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140578', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140570', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140340', None, None, None, None, None, '2580678') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.015274286270141602 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1010439395904541 time spend to save output : 0.01581549644470215 total time spend for step 5 : 0.11685943603515625 step6:blur_detection Wed Feb 12 21:14:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4.jpg resize: (2160, 3264) 1337140778 -4.4151363771332175 treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332.jpg resize: (2160, 3264) 1337140774 -3.0979438301200704 treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6.jpg resize: (2160, 3264) 1337140597 -3.5770457397993014 treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2.jpg resize: (2160, 3264) 1337140593 -5.178271686250246 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec.jpg resize: (2160, 3264) 1337140588 -0.8646484097344074 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c.jpg resize: (2160, 3264) 1337140578 -2.4974742144196966 treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571.jpg resize: (2160, 3264) 1337140570 -4.247118972145156 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128.jpg resize: (2160, 3264) 1337140340 -7.146846823655551 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244744_0.png resize: (201, 182) 1337182966 -2.635760608154518 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244764_0.png resize: (137, 206) 1337182967 -2.0711002603801147 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244760_0.png resize: (239, 243) 1337182968 -3.193057021605366 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244767_0.png resize: (93, 117) 1337182969 -3.4742303356319293 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244761_0.png resize: (97, 104) 1337182970 -1.4231797013033067 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244758_0.png resize: (453, 391) 1337182971 -3.9610270715311042 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244754_0.png resize: (53, 83) 1337182972 -3.6887879102467527 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244763_0.png resize: (95, 58) 1337182973 -3.2522961539543536 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244752_0.png resize: (355, 407) 1337182974 -2.8797002897161876 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244749_0.png resize: (133, 182) 1337182975 -0.4314409318642859 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244769_0.png resize: (291, 235) 1337182976 -4.149183658633536 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244770_0.png resize: (81, 79) 1337182977 -2.8122898912242027 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244751_0.png resize: (216, 142) 1337182978 -2.3608054834639876 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244762_0.png resize: (62, 50) 1337182979 -1.873274168150051 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244759_0.png resize: (89, 55) 1337182980 -4.712420120085682 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244742_0.png resize: (227, 305) 1337182981 -2.69920305380114 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244757_0.png resize: (280, 237) 1337182982 -2.957103798603454 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244768_0.png resize: (189, 157) 1337182983 -3.128611597780232 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244746_0.png resize: (297, 310) 1337182984 -1.6355144155122499 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244750_0.png resize: (205, 220) 1337182985 -2.0514600074740126 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244766_0.png resize: (169, 236) 1337182986 -0.5021414202263264 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244743_0.png resize: (143, 174) 1337182987 -2.9835011331137573 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244755_0.png resize: (168, 204) 1337182988 -0.9965695344909969 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244756_0.png resize: (201, 166) 1337182989 -2.0333731060688756 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244753_0.png resize: (203, 205) 1337182990 -2.5796465757247753 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244771_0.png resize: (177, 299) 1337182991 -1.7666409881224359 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244772_0.png resize: (142, 103) 1337182992 -2.6290468122553787 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244747_0.png resize: (193, 176) 1337182993 -1.3953950333385512 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244765_0.png resize: (287, 139) 1337182994 -1.6921779300263422 treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244777_0.png resize: (85, 236) 1337182995 -3.4754852136570715 treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244780_0.png resize: (193, 123) 1337182996 -2.67931849364574 treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244781_0.png resize: (155, 141) 1337182997 -4.606587511224415 treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244773_0.png resize: (315, 290) 1337182998 -1.836735299383786 treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244775_0.png resize: (394, 612) 1337182999 -2.7177889127072223 treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244774_0.png resize: (115, 116) 1337183001 0.8806219796542081 treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244785_0.png resize: (228, 152) 1337183003 -3.739334938953054 treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244779_0.png resize: (76, 194) 1337183005 -1.8489790664268124 treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244784_0.png resize: (191, 261) 1337183008 -2.2055935052504005 treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244801_0.png resize: (408, 558) 1337183011 -1.3052976182573552 treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244790_0.png resize: (286, 118) 1337183015 -2.2209460313602696 treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244792_0.png resize: (291, 229) 1337183018 -3.111513027422474 treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244794_0.png resize: (326, 427) 1337183021 -2.8230115157148568 treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244797_0.png resize: (265, 306) 1337183024 -3.646588421824891 treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244800_0.png resize: (258, 310) 1337183027 -2.8943904733857853 treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244799_0.png resize: (352, 540) 1337183030 -3.7224307808662167 treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244805_0.png resize: (109, 190) 1337183033 -1.0606903802537841 treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244811_0.png resize: (134, 150) 1337183037 -4.0279795698387835 treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244812_0.png resize: (84, 97) 1337183040 -1.8764053433736907 treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244822_0.png resize: (218, 119) 1337183044 -4.652566260637271 treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244814_0.png resize: (145, 94) 1337183048 -4.252247653393628 treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244808_0.png resize: (314, 228) 1337183052 -3.2563444749465393 treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244817_0.png resize: (220, 212) 1337183055 -5.447692417551516 treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244823_0.png resize: (90, 145) 1337183058 -3.2307249027478373 treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244807_0.png resize: (146, 154) 1337183059 -2.655605116523701 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244834_0.png resize: (342, 579) 1337183060 -1.0576989409097959 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244838_0.png resize: (127, 203) 1337183061 -0.9833811993330269 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244827_0.png resize: (208, 112) 1337183062 -0.7053925975177007 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244840_0.png resize: (179, 183) 1337183063 -1.2410350704646758 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244835_0.png resize: (233, 242) 1337183064 3.1207836143756134 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244830_0.png resize: (444, 220) 1337183065 1.6808939235291904 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244847_0.png resize: (517, 365) 1337183066 -0.5973705054255616 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244844_0.png resize: (221, 176) 1337183067 -2.3439158902035224 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244833_0.png resize: (132, 245) 1337183068 -0.5707396655913038 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244825_0.png resize: (389, 468) 1337183069 -0.6161433707005584 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244839_0.png resize: (376, 264) 1337183070 -2.053473625365359 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244842_0.png resize: (315, 555) 1337183071 -2.071492534408677 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244846_0.png resize: (264, 135) 1337183072 -1.563418035949087 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244828_0.png resize: (196, 336) 1337183073 -1.547860540207562 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244836_0.png resize: (210, 146) 1337183074 -1.3780717639233513 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244863_0.png resize: (137, 128) 1337183075 -0.9961285573689324 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244860_0.png resize: (169, 118) 1337183076 -2.8370382797730898 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244874_0.png resize: (79, 157) 1337183077 -1.3024247844011194 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244851_0.png resize: (101, 172) 1337183078 -1.297902381362589 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244868_0.png resize: (207, 257) 1337183079 -2.575471824847657 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244857_0.png resize: (383, 292) 1337183080 -2.1199068605917417 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244873_0.png resize: (115, 92) 1337183081 -1.9039849571989829 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244862_0.png resize: (249, 168) 1337183082 -1.5299087176636097 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244865_0.png resize: (168, 150) 1337183083 -1.2737722014205606 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244871_0.png resize: (182, 181) 1337183084 -1.5011680836959485 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244849_0.png resize: (525, 425) 1337183085 -2.242820370220972 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244848_0.png resize: (139, 167) 1337183086 -2.39706090439767 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244850_0.png resize: (149, 216) 1337183087 -0.07604503674239797 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244867_0.png resize: (112, 167) 1337183088 -2.7740732501357406 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244872_0.png resize: (59, 89) 1337183089 -2.051523455692082 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244861_0.png resize: (294, 259) 1337183090 -1.0989469323241088 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244866_0.png resize: (52, 84) 1337183091 -3.1343206105952426 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244855_0.png resize: (219, 208) 1337183092 -4.231867349598584 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244852_0.png resize: (157, 123) 1337183093 -1.522371551303168 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244853_0.png resize: (84, 152) 1337183094 -0.6023246200360194 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244854_0.png resize: (265, 523) 1337183095 -0.9615095988380098 treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244884_0.png resize: (170, 96) 1337183096 0.8671523091260485 treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244879_0.png resize: (113, 175) 1337183097 -2.5599198030893318 treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244886_0.png resize: (131, 140) 1337183098 -3.5202739806157055 treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244885_0.png resize: (232, 99) 1337183099 -2.561632041782175 treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244876_0.png resize: (182, 139) 1337183100 -2.5208327513482134 treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244887_0.png resize: (88, 70) 1337183102 -3.2564771548742755 treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244890_0.png resize: (307, 398) 1337183103 -3.406492583649975 treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244877_0.png resize: (129, 142) 1337183104 -2.323420836061287 treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244889_0.png resize: (138, 181) 1337183105 -0.8628738566895081 treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244878_0.png resize: (97, 185) 1337183106 -2.351644471570039 treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244875_0.png resize: (188, 221) 1337183107 -2.4719921165777903 treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244883_0.png resize: (345, 170) 1337183108 -2.3163158593364055 treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244882_0.png resize: (153, 187) 1337183109 -1.8046880730536319 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244920_0.png resize: (71, 123) 1337183110 -2.246017054465231 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244922_0.png resize: (210, 166) 1337183111 -4.51803862777444 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244891_0.png resize: (149, 177) 1337183112 -4.4815249883671315 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244916_0.png resize: (184, 111) 1337183113 -4.785896196514376 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244902_0.png resize: (188, 106) 1337183114 -6.203792420831623 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244915_0.png resize: (131, 104) 1337183115 -2.547904805286318 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244906_0.png resize: (200, 197) 1337183116 -4.999327168625117 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244930_0.png resize: (81, 130) 1337183117 -3.8233521919207734 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244932_0.png resize: (226, 290) 1337183118 -6.173044845668357 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244901_0.png resize: (119, 56) 1337183119 -4.395815403944953 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244912_0.png resize: (339, 167) 1337183120 -3.811441491958537 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244905_0.png resize: (280, 264) 1337183121 -4.0482095957483 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244903_0.png resize: (261, 286) 1337183122 -4.887216920861318 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244911_0.png resize: (171, 185) 1337183123 -5.645018037300909 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244914_0.png resize: (238, 124) 1337183124 -5.141870060298514 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244897_0.png resize: (213, 223) 1337183125 -3.6863808170574544 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244910_0.png resize: (212, 114) 1337183126 -4.138613739789332 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244898_0.png resize: (204, 199) 1337183127 -4.623720665933404 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244909_0.png resize: (163, 115) 1337183128 -3.3954303947484874 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244893_0.png resize: (170, 171) 1337183129 -2.9055345144000997 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244926_0.png resize: (406, 196) 1337183130 -4.087573769741978 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244904_0.png resize: (206, 198) 1337183131 -4.910365139597674 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244908_0.png resize: (208, 241) 1337183132 -5.289210140360599 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244924_0.png resize: (250, 158) 1337183133 -5.332154870340154 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244900_0.png resize: (117, 99) 1337183134 -3.053148279473379 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244933_0.png resize: (80, 82) 1337183135 -4.49785910163684 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244923_0.png resize: (653, 386) 1337183136 -5.7551796572261145 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244899_0.png resize: (181, 248) 1337183137 -5.3809246805039725 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244913_0.png resize: (153, 91) 1337183138 -1.150475934908184 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244896_0.png resize: (257, 155) 1337183139 -4.614896478693461 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244925_0.png resize: (274, 304) 1337183140 -4.572387078286837 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244919_0.png resize: (113, 170) 1337183141 -2.8769622717461263 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244745_0.png resize: (224, 191) 1337183157 -1.482705793695915 treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244778_0.png resize: (182, 221) 1337183158 -1.659503914972943 treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244783_0.png resize: (348, 354) 1337183159 -4.024654436038448 treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244786_0.png resize: (557, 543) 1337183160 -2.5113783756006307 treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244776_0.png resize: (98, 238) 1337183161 -1.4158243777972404 treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244791_0.png resize: (359, 592) 1337183162 -2.093126620856617 treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244789_0.png resize: (289, 297) 1337183163 -3.2331301238902888 treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244798_0.png resize: (302, 321) 1337183164 -3.2002943878915104 treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244788_0.png resize: (139, 227) 1337183165 -3.4161575649634552 treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244803_0.png resize: (538, 504) 1337183166 -1.4062054848602041 treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244796_0.png resize: (510, 411) 1337183167 -2.250948554278059 treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244793_0.png resize: (171, 226) 1337183168 -3.17435031154055 treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244809_0.png resize: (298, 271) 1337183169 -4.401189752767039 treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244806_0.png resize: (583, 943) 1337183171 -5.513963055839447 treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244815_0.png resize: (867, 338) 1337183172 -1.2186281236298073 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244837_0.png resize: (358, 571) 1337183173 -1.050500185825436 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244841_0.png resize: (314, 451) 1337183174 -2.0026421262451453 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244829_0.png resize: (134, 139) 1337183175 0.26590421339085063 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244826_0.png resize: (311, 293) 1337183176 -1.4669916265965244 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244843_0.png resize: (243, 267) 1337183177 -2.1035913183407704 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244832_0.png resize: (388, 619) 1337183178 -2.130084843604393 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244831_0.png resize: (184, 285) 1337183179 -3.084574911658384 treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244845_0.png resize: (108, 284) 1337183180 -3.33706027380756 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244870_0.png resize: (292, 420) 1337183181 -1.8334651626809193 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244869_0.png resize: (134, 178) 1337183182 -1.5643907721770083 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244859_0.png resize: (80, 162) 1337183183 0.17241953836147506 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244856_0.png resize: (149, 394) 1337183184 -1.8478825006621322 treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244880_0.png resize: (94, 135) 1337183185 -0.4179902443350952 treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244881_0.png resize: (149, 229) 1337183186 -2.742447660598752 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244892_0.png resize: (117, 81) 1337183187 -4.660410135036975 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244918_0.png resize: (112, 93) 1337183188 -5.191303767450819 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244907_0.png resize: (87, 90) 1337183189 -3.192557772046927 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244917_0.png resize: (54, 35) 1337183190 -4.3917310883080685 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244927_0.png resize: (125, 262) 1337183191 -3.058034857583886 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244931_0.png resize: (259, 224) 1337183192 -4.191997450338031 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244921_0.png resize: (207, 183) 1337183193 -4.51829953296492 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244894_0.png resize: (164, 170) 1337183194 -2.5806424872382454 treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244787_0.png resize: (144, 143) 1337183196 -4.020201625136137 treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244748_0.png resize: (174, 124) 1337183351 -3.6465227034688175 treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244782_0.png resize: (439, 112) 1337183353 -3.658983777803262 treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244795_0.png resize: (471, 571) 1337183355 -2.692779812537436 treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244804_0.png resize: (295, 473) 1337183357 -2.695678019705073 treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244813_0.png resize: (434, 455) 1337183359 -3.2762648453895746 treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244821_0.png resize: (354, 294) 1337183361 -3.1511337036489615 treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244819_0.png resize: (274, 205) 1337183363 -3.9625736556502758 treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244820_0.png resize: (773, 1019) 1337183365 -3.1069657263935273 treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244824_0.png resize: (849, 590) 1337183367 -4.293377431673363 treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244816_0.png resize: (237, 150) 1337183369 -2.4152082145309097 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244928_0.png resize: (182, 121) 1337183371 -4.014886477617716 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244895_0.png resize: (303, 540) 1337183373 -4.179034966469361 treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244929_0.png resize: (262, 175) 1337183375 -2.509893562788129 treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244802_0.png resize: (126, 331) 1337183428 -4.662214858500592 treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244818_0.png resize: (173, 290) 1337183430 -3.842397079304389 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244858_0.png resize: (93, 116) 1337183432 -0.8386156928669344 treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244864_0.png resize: (184, 188) 1337183434 -3.2837027861405663 treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244888_0.png resize: (288, 250) 1337183436 -1.9792702719679438 treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244810_0.png resize: (208, 177) 1337183469 -4.864356645374358 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 200 time used for this insertion : 0.019954681396484375 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 200 time used for this insertion : 0.04210829734802246 save missing photos in datou_result : time spend for datou_step_exec : 24.569011211395264 time spend to save output : 0.06687641143798828 total time spend for step 6 : 24.635887622833252 step7:brightness Wed Feb 12 21:15:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4.jpg treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332.jpg treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6.jpg treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2.jpg treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec.jpg treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c.jpg treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571.jpg treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128.jpg treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244744_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244764_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244760_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244767_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244761_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244758_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244754_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244763_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244752_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244749_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244769_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244770_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244751_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244762_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244759_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244742_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244757_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244768_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244746_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244750_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244766_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244743_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244755_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244756_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244753_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244771_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244772_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244747_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244765_0.png treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244777_0.png treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244780_0.png treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244781_0.png treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244773_0.png treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244775_0.png treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244774_0.png treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244785_0.png treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244779_0.png treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244784_0.png treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244801_0.png treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244790_0.png treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244792_0.png treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244794_0.png treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244797_0.png treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244800_0.png treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244799_0.png treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244805_0.png treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244811_0.png treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244812_0.png treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244822_0.png treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244814_0.png treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244808_0.png treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244817_0.png treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244823_0.png treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244807_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244834_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244838_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244827_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244840_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244835_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244830_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244847_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244844_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244833_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244825_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244839_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244842_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244846_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244828_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244836_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244863_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244860_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244874_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244851_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244868_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244857_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244873_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244862_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244865_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244871_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244849_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244848_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244850_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244867_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244872_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244861_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244866_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244855_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244852_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244853_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244854_0.png treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244884_0.png treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244879_0.png treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244886_0.png treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244885_0.png treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244876_0.png treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244887_0.png treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244890_0.png treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244877_0.png treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244889_0.png treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244878_0.png treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244875_0.png treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244883_0.png treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244882_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244920_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244922_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244891_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244916_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244902_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244915_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244906_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244930_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244932_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244901_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244912_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244905_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244903_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244911_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244914_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244897_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244910_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244898_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244909_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244893_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244926_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244904_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244908_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244924_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244900_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244933_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244923_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244899_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244913_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244896_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244925_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244919_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244745_0.png treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244778_0.png treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244783_0.png treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244786_0.png treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244776_0.png treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244791_0.png treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244789_0.png treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244798_0.png treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244788_0.png treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244803_0.png treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244796_0.png treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244793_0.png treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244809_0.png treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244806_0.png treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244815_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244837_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244841_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244829_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244826_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244843_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244832_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244831_0.png treat image : temp/1739391028_909083_1337140588_3f521085c685efc655e5c04a624376ec_rle_crop_3672244845_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244870_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244869_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244859_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244856_0.png treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244880_0.png treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244881_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244892_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244918_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244907_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244917_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244927_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244931_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244921_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244894_0.png treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244787_0.png treat image : temp/1739391028_909083_1337140778_4e3197988002034ab49c709c751ad7d4_rle_crop_3672244748_0.png treat image : temp/1739391028_909083_1337140774_7e8d07a084efe8685f6949cf25cf0332_rle_crop_3672244782_0.png treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244795_0.png treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244804_0.png treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244813_0.png treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244821_0.png treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244819_0.png treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244820_0.png treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244824_0.png treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244816_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244928_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244895_0.png treat image : temp/1739391028_909083_1337140340_49f4dbe1acfc6183c2973e3b7cd39128_rle_crop_3672244929_0.png treat image : temp/1739391028_909083_1337140597_220f487ae36b5a724bdbbbebea75b4f6_rle_crop_3672244802_0.png treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244818_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244858_0.png treat image : temp/1739391028_909083_1337140578_ed19ef3e7c8ae2fc6c9b467829c7d66c_rle_crop_3672244864_0.png treat image : temp/1739391028_909083_1337140570_87de4d8b37f185aaa5eecc6a560bc571_rle_crop_3672244888_0.png treat image : temp/1739391028_909083_1337140593_3348b14a0086ada53d130a1bb09ae4f2_rle_crop_3672244810_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 200 time used for this insertion : 0.022591590881347656 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 200 time used for this insertion : 0.0403590202331543 save missing photos in datou_result : time spend for datou_step_exec : 8.144243717193604 time spend to save output : 0.06883430480957031 total time spend for step 7 : 8.213078022003174 step8:velours_tree Wed Feb 12 21:15:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.3905215263366699 time spend to save output : 3.123283386230469e-05 total time spend for step 8 : 0.3905527591705322 step9:send_mail_cod Wed Feb 12 21:15:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P20491208_12-02-2025_21_15_29.pdf 20491661 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204916611739391329 20491662 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204916621739391330 20491663 change filename to text .imagette204916631739391331 20491664 imagette204916641739391331 20491665 change filename to text .imagette204916651739391331 20491666 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204916661739391331 20491667 imagette204916671739391332 20491669 imagette204916691739391332 20491670 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204916701739391332 20491671 imagette204916711739391333 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20491208 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20491661,20491662,20491663,20491664,20491665,20491666,20491667,20491668,20491669,20491670,20491671?tags=pet_clair,carton,pet_fonce,flou,metal,autre,pehd,environnement,mal_croppe,papier,background args[1337140778] : ((1337140778, -4.4151363771332175, 492609224), (1337140778, -0.46919722635920097, 496442774), '0.14599189176538674') apple ((1337140778, -4.4151363771332175, 492609224), (1337140778, -0.46919722635920097, 496442774), '0.14599189176538674') We are sending mail with results at report@fotonower.com args[1337140774] : ((1337140774, -3.0979438301200704, 492609224), (1337140774, -0.4912693415254977, 501862349), '0.14599189176538674') apple ((1337140774, -3.0979438301200704, 492609224), (1337140774, -0.4912693415254977, 501862349), '0.14599189176538674') We are sending mail with results at report@fotonower.com args[1337140597] : ((1337140597, -3.5770457397993014, 492609224), (1337140597, -0.3931217881005814, 496442774), '0.14599189176538674') apple ((1337140597, -3.5770457397993014, 492609224), (1337140597, -0.3931217881005814, 496442774), '0.14599189176538674') We are sending mail with results at report@fotonower.com args[1337140593] : ((1337140593, -5.178271686250246, 492609224), (1337140593, -0.43525200626240396, 496442774), '0.14599189176538674') apple ((1337140593, -5.178271686250246, 492609224), (1337140593, -0.43525200626240396, 496442774), '0.14599189176538674') We are sending mail with results at report@fotonower.com args[1337140588] : ((1337140588, -0.8646484097344074, 492688767), (1337140588, -0.403945134846195, 496442774), '0.14599189176538674') apple ((1337140588, -0.8646484097344074, 492688767), (1337140588, -0.403945134846195, 496442774), '0.14599189176538674') We are sending mail with results at report@fotonower.com args[1337140578] : ((1337140578, -2.4974742144196966, 492609224), (1337140578, -0.37708110828236974, 496442774), '0.14599189176538674') apple ((1337140578, -2.4974742144196966, 492609224), (1337140578, -0.37708110828236974, 496442774), '0.14599189176538674') We are sending mail with results at report@fotonower.com args[1337140570] : ((1337140570, -4.247118972145156, 492609224), (1337140570, -0.435198639845307, 496442774), '0.14599189176538674') apple ((1337140570, -4.247118972145156, 492609224), (1337140570, -0.435198639845307, 496442774), '0.14599189176538674') We are sending mail with results at report@fotonower.com args[1337140340] : ((1337140340, -7.146846823655551, 492609224), (1337140340, -0.532061054585272, 501862349), '0.14599189176538674') apple ((1337140340, -7.146846823655551, 492609224), (1337140340, -0.532061054585272, 501862349), '0.14599189176538674') We are sending mail with results at report@fotonower.com refus_total : 0.14599189176538674 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20491208 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1337140593,1337140340,1337140570,1337140578,1337140588,1337140597,1337140774,1337140778) Found this number of photos: 8 begin to download photo : 1337140593 begin to download photo : 1337140570 begin to download photo : 1337140588 begin to download photo : 1337140774 download finish for photo 1337140588 begin to download photo : 1337140597 download finish for photo 1337140570 begin to download photo : 1337140578 download finish for photo 1337140774 begin to download photo : 1337140778 download finish for photo 1337140593 begin to download photo : 1337140340 download finish for photo 1337140597 download finish for photo 1337140578 download finish for photo 1337140778 download finish for photo 1337140340 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20491208_12-02-2025_21_15_29.pdf results_Auto_P20491208_12-02-2025_21_15_29.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20491208_12-02-2025_21_15_29.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','20491208','results_Auto_P20491208_12-02-2025_21_15_29.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20491208_12-02-2025_21_15_29.pdf','pdf','','0.65','0.14599189176538674') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/20491208

https://www.fotonower.com/image?json=false&list_photos_id=1337140778
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337140774
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337140597
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337140593
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337140588
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337140578
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337140570
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337140340
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 14.60%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/20491661?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/20491662?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/20491663?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/20491665?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/20491666?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/20491670?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20491208_12-02-2025_21_15_29.pdf.

Lien vers velours :https://www.fotonower.com/velours/20491661,20491662,20491663,20491664,20491665,20491666,20491667,20491668,20491669,20491670,20491671?tags=pet_clair,carton,pet_fonce,flou,metal,autre,pehd,environnement,mal_croppe,papier,background.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 12 Feb 2025 20:15:36 GMT Content-Length: 0 Connection: close X-Message-Id: FRTRrkiAS4eARId_sY96HA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1337140778, 1337140774, 1337140597, 1337140593, 1337140588, 1337140578, 1337140570, 1337140340] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140778', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140774', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140597', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140593', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140588', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140578', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140570', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140340', None, None, None, None, None, '2580678') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.018193483352661133 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.502028465270996 time spend to save output : 0.018391132354736328 total time spend for step 9 : 6.520419597625732 step10:split_time_score Wed Feb 12 21:15:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 12022025 20491208 Nombre de photos uploadées : 8 / 23040 (0%) 12022025 20491208 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 12022025 20491208 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 1.1920928955078125e-06 elapsed_time : order_list_meta_photo_and_scores 4.76837158203125e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0004222393035888672 elapsed_time : insert_dashboard_record_day_entry 0.029597759246826172 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.14334913679276415 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20470042_12-02-2025_11_44_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20470042 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20470042 AND mptpi.`type`=3594 To do Qualite : 0.14901726105004293 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20478686_12-02-2025_15_27_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20478686 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20478686 AND mptpi.`type`=3594 To do Qualite : 0.1178983505053256 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20478687_12-02-2025_15_36_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20478687 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20478687 AND mptpi.`type`=3594 To do Qualite : 0.06949440218668829 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20491195_12-02-2025_21_04_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20491195 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20491195 AND mptpi.`type`=3726 To do Qualite : 0.1400311589077504 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20478698_12-02-2025_15_32_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20478698 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20478698 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20491196 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20491205 order by id desc limit 1 Qualite : 0.14599189176538674 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20491208_12-02-2025_21_15_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20491208 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20491208 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20491209 order by id desc limit 1 Qualite : 0.057692279913422656 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20491210_12-02-2025_21_06_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20491210 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20491210 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'12022025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1337140778, 1337140774, 1337140597, 1337140593, 1337140588, 1337140578, 1337140570, 1337140340] Looping around the photos to save general results len do output : 1 /20491208Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140778', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140774', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140597', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140593', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140588', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140578', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140570', None, None, None, None, None, '2580678') ('3318', None, None, None, None, None, None, None, '2580678') ('3318', '20491208', '1337140340', None, None, None, None, None, '2580678') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014400720596313477 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.954277753829956 time spend to save output : 0.014597892761230469 total time spend for step 10 : 2.9688756465911865 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 146.69user 99.79system 5:14.07elapsed 78%CPU (0avgtext+0avgdata 6108628maxresident)k 549832inputs+124648outputs (2762major+13182619minor)pagefaults 0swaps