python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3447823 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2748458'] with mtr_portfolio_ids : ['22301301'] and first list_photo_ids : [] new path : /proc/3447823/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.3011465072631836 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Apr 22 13:20:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10372 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-04-22 13:20:31.325542: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-22 13:20:31.355168: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-22 13:20:31.357617: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fe460000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-22 13:20:31.357685: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-04-22 13:20:31.362085: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-04-22 13:20:31.628299: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2bce29e0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-04-22 13:20:31.628382: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-04-22 13:20:31.629990: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-22 13:20:31.630491: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-22 13:20:31.633351: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-22 13:20:31.636126: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-22 13:20:31.636565: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-22 13:20:31.639812: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-22 13:20:31.641172: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-22 13:20:31.646160: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-22 13:20:31.647771: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-22 13:20:31.647889: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-22 13:20:31.648749: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-22 13:20:31.648767: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-22 13:20:31.648777: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-22 13:20:31.650200: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9607 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-04-22 13:20:31.945126: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-22 13:20:31.945276: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-22 13:20:31.945299: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-22 13:20:31.945318: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-22 13:20:31.945334: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-22 13:20:31.945350: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-22 13:20:31.945364: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-22 13:20:31.945378: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-22 13:20:31.946692: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-22 13:20:31.948104: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-22 13:20:31.948141: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-22 13:20:31.948156: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-22 13:20:31.948170: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-22 13:20:31.948184: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-22 13:20:31.948197: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-22 13:20:31.948210: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-22 13:20:31.948223: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-22 13:20:31.949419: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-22 13:20:31.949462: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-22 13:20:31.949471: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-22 13:20:31.949478: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-22 13:20:31.950752: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9607 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-04-22 13:20:42.985910: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-22 13:20:43.167532: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 55 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 57 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 51.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 19 Detection mask done ! Trying to reset tf kernel 3448359 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 202 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.002600431442260742 nb_pixel_total : 38618 time to create 1 rle with old method : 0.05493950843811035 length of segment : 279 time for calcul the mask position with numpy : 0.001012563705444336 nb_pixel_total : 16193 time to create 1 rle with old method : 0.021315336227416992 length of segment : 226 time for calcul the mask position with numpy : 0.0008037090301513672 nb_pixel_total : 16833 time to create 1 rle with old method : 0.021490812301635742 length of segment : 189 time for calcul the mask position with numpy : 0.0008745193481445312 nb_pixel_total : 19747 time to create 1 rle with old method : 0.0233914852142334 length of segment : 178 time for calcul the mask position with numpy : 0.0029404163360595703 nb_pixel_total : 39029 time to create 1 rle with old method : 0.04707908630371094 length of segment : 172 time for calcul the mask position with numpy : 0.00934457778930664 nb_pixel_total : 174448 time to create 1 rle with new method : 0.025445222854614258 length of segment : 424 time for calcul the mask position with numpy : 0.0007340908050537109 nb_pixel_total : 15712 time to create 1 rle with old method : 0.018673419952392578 length of segment : 128 time for calcul the mask position with numpy : 0.0006463527679443359 nb_pixel_total : 15006 time to create 1 rle with old method : 0.021268844604492188 length of segment : 116 time for calcul the mask position with numpy : 0.038672447204589844 nb_pixel_total : 473585 time to create 1 rle with new method : 0.07793450355529785 length of segment : 885 time for calcul the mask position with numpy : 0.00044655799865722656 nb_pixel_total : 11766 time to create 1 rle with old method : 0.02009415626525879 length of segment : 103 time for calcul the mask position with numpy : 0.0014882087707519531 nb_pixel_total : 57093 time to create 1 rle with old method : 0.08063578605651855 length of segment : 300 time for calcul the mask position with numpy : 0.0009920597076416016 nb_pixel_total : 47592 time to create 1 rle with old method : 0.05406022071838379 length of segment : 182 time for calcul the mask position with numpy : 0.0003528594970703125 nb_pixel_total : 15406 time to create 1 rle with old method : 0.018027305603027344 length of segment : 140 time for calcul the mask position with numpy : 0.0035028457641601562 nb_pixel_total : 144946 time to create 1 rle with old method : 0.1931147575378418 length of segment : 458 time for calcul the mask position with numpy : 0.02520585060119629 nb_pixel_total : 408815 time to create 1 rle with new method : 0.08067774772644043 length of segment : 1467 time for calcul the mask position with numpy : 0.0056743621826171875 nb_pixel_total : 110543 time to create 1 rle with old method : 0.13631939888000488 length of segment : 268 time for calcul the mask position with numpy : 0.0014264583587646484 nb_pixel_total : 26398 time to create 1 rle with old method : 0.03003835678100586 length of segment : 116 time for calcul the mask position with numpy : 0.00084686279296875 nb_pixel_total : 17551 time to create 1 rle with old method : 0.020345687866210938 length of segment : 149 time for calcul the mask position with numpy : 0.0014157295227050781 nb_pixel_total : 31991 time to create 1 rle with old method : 0.03795456886291504 length of segment : 222 time for calcul the mask position with numpy : 0.0035278797149658203 nb_pixel_total : 218394 time to create 1 rle with new method : 0.009175777435302734 length of segment : 524 time for calcul the mask position with numpy : 0.004248380661010742 nb_pixel_total : 71221 time to create 1 rle with old method : 0.10645556449890137 length of segment : 362 time for calcul the mask position with numpy : 0.00524139404296875 nb_pixel_total : 122189 time to create 1 rle with old method : 0.13724756240844727 length of segment : 439 time for calcul the mask position with numpy : 0.0018117427825927734 nb_pixel_total : 32537 time to create 1 rle with old method : 0.03760361671447754 length of segment : 246 time for calcul the mask position with numpy : 0.0012824535369873047 nb_pixel_total : 22783 time to create 1 rle with old method : 0.028883934020996094 length of segment : 205 time for calcul the mask position with numpy : 0.004679203033447266 nb_pixel_total : 47744 time to create 1 rle with old method : 0.05863332748413086 length of segment : 365 time for calcul the mask position with numpy : 0.0010232925415039062 nb_pixel_total : 12887 time to create 1 rle with old method : 0.02183818817138672 length of segment : 133 time for calcul the mask position with numpy : 0.0007922649383544922 nb_pixel_total : 10502 time to create 1 rle with old method : 0.017858505249023438 length of segment : 83 time for calcul the mask position with numpy : 0.0004248619079589844 nb_pixel_total : 11970 time to create 1 rle with old method : 0.0155029296875 length of segment : 123 time for calcul the mask position with numpy : 0.006934404373168945 nb_pixel_total : 182702 time to create 1 rle with new method : 0.009491205215454102 length of segment : 530 time for calcul the mask position with numpy : 0.00043511390686035156 nb_pixel_total : 6509 time to create 1 rle with old method : 0.007884502410888672 length of segment : 95 time for calcul the mask position with numpy : 0.0006508827209472656 nb_pixel_total : 13356 time to create 1 rle with old method : 0.01577305793762207 length of segment : 153 time for calcul the mask position with numpy : 0.001068115234375 nb_pixel_total : 12495 time to create 1 rle with old method : 0.01677870750427246 length of segment : 114 time for calcul the mask position with numpy : 0.0014269351959228516 nb_pixel_total : 42499 time to create 1 rle with old method : 0.0549321174621582 length of segment : 228 time for calcul the mask position with numpy : 0.0006649494171142578 nb_pixel_total : 11530 time to create 1 rle with old method : 0.013814926147460938 length of segment : 98 time for calcul the mask position with numpy : 0.0008018016815185547 nb_pixel_total : 27791 time to create 1 rle with old method : 0.0358433723449707 length of segment : 211 time for calcul the mask position with numpy : 0.015796661376953125 nb_pixel_total : 611409 time to create 1 rle with new method : 0.04896974563598633 length of segment : 1110 time for calcul the mask position with numpy : 0.001554250717163086 nb_pixel_total : 25251 time to create 1 rle with old method : 0.02982783317565918 length of segment : 449 time for calcul the mask position with numpy : 0.0010716915130615234 nb_pixel_total : 31156 time to create 1 rle with old method : 0.03998899459838867 length of segment : 251 time for calcul the mask position with numpy : 0.00040268898010253906 nb_pixel_total : 7119 time to create 1 rle with old method : 0.009341239929199219 length of segment : 113 time for calcul the mask position with numpy : 0.005688667297363281 nb_pixel_total : 208382 time to create 1 rle with new method : 0.010944604873657227 length of segment : 429 time for calcul the mask position with numpy : 0.0011425018310546875 nb_pixel_total : 55502 time to create 1 rle with old method : 0.06703662872314453 length of segment : 201 time for calcul the mask position with numpy : 0.0003669261932373047 nb_pixel_total : 13608 time to create 1 rle with old method : 0.018288135528564453 length of segment : 142 time for calcul the mask position with numpy : 0.0003151893615722656 nb_pixel_total : 10113 time to create 1 rle with old method : 0.02065753936767578 length of segment : 104 time for calcul the mask position with numpy : 0.00036263465881347656 nb_pixel_total : 7205 time to create 1 rle with old method : 0.010516166687011719 length of segment : 114 time for calcul the mask position with numpy : 0.0039386749267578125 nb_pixel_total : 43680 time to create 1 rle with old method : 0.05264735221862793 length of segment : 319 time for calcul the mask position with numpy : 0.0010974407196044922 nb_pixel_total : 17401 time to create 1 rle with old method : 0.02536630630493164 length of segment : 202 time for calcul the mask position with numpy : 0.0009703636169433594 nb_pixel_total : 14291 time to create 1 rle with old method : 0.016717195510864258 length of segment : 177 time for calcul the mask position with numpy : 0.0019450187683105469 nb_pixel_total : 27579 time to create 1 rle with old method : 0.03547263145446777 length of segment : 207 time for calcul the mask position with numpy : 0.005592823028564453 nb_pixel_total : 83386 time to create 1 rle with old method : 0.09394431114196777 length of segment : 467 time for calcul the mask position with numpy : 0.0009222030639648438 nb_pixel_total : 11265 time to create 1 rle with old method : 0.014399051666259766 length of segment : 126 time for calcul the mask position with numpy : 0.0006787776947021484 nb_pixel_total : 12427 time to create 1 rle with old method : 0.020586490631103516 length of segment : 99 time for calcul the mask position with numpy : 0.003937482833862305 nb_pixel_total : 22943 time to create 1 rle with old method : 0.03298306465148926 length of segment : 226 time for calcul the mask position with numpy : 0.0023984909057617188 nb_pixel_total : 34605 time to create 1 rle with old method : 0.0440061092376709 length of segment : 224 time for calcul the mask position with numpy : 0.0009593963623046875 nb_pixel_total : 14521 time to create 1 rle with old method : 0.026645183563232422 length of segment : 132 time for calcul the mask position with numpy : 0.0029294490814208984 nb_pixel_total : 33594 time to create 1 rle with old method : 0.06654977798461914 length of segment : 198 time for calcul the mask position with numpy : 0.002835988998413086 nb_pixel_total : 19724 time to create 1 rle with old method : 0.026565074920654297 length of segment : 376 time for calcul the mask position with numpy : 0.010321378707885742 nb_pixel_total : 219139 time to create 1 rle with new method : 0.01436161994934082 length of segment : 635 time for calcul the mask position with numpy : 0.00713658332824707 nb_pixel_total : 73932 time to create 1 rle with old method : 0.11278486251831055 length of segment : 619 time for calcul the mask position with numpy : 0.0014688968658447266 nb_pixel_total : 25586 time to create 1 rle with old method : 0.02933192253112793 length of segment : 173 time for calcul the mask position with numpy : 0.005728721618652344 nb_pixel_total : 140101 time to create 1 rle with old method : 0.17315959930419922 length of segment : 340 time for calcul the mask position with numpy : 0.0017409324645996094 nb_pixel_total : 36993 time to create 1 rle with old method : 0.043271541595458984 length of segment : 312 time for calcul the mask position with numpy : 0.0019769668579101562 nb_pixel_total : 18693 time to create 1 rle with old method : 0.025458812713623047 length of segment : 239 time for calcul the mask position with numpy : 0.001444101333618164 nb_pixel_total : 14670 time to create 1 rle with old method : 0.016873598098754883 length of segment : 274 time for calcul the mask position with numpy : 0.0008053779602050781 nb_pixel_total : 13886 time to create 1 rle with old method : 0.01840949058532715 length of segment : 155 time for calcul the mask position with numpy : 0.0008444786071777344 nb_pixel_total : 15121 time to create 1 rle with old method : 0.017966270446777344 length of segment : 180 time for calcul the mask position with numpy : 0.0005276203155517578 nb_pixel_total : 11846 time to create 1 rle with old method : 0.014139652252197266 length of segment : 99 time for calcul the mask position with numpy : 0.0015935897827148438 nb_pixel_total : 32514 time to create 1 rle with old method : 0.0377805233001709 length of segment : 263 time for calcul the mask position with numpy : 0.0008976459503173828 nb_pixel_total : 21301 time to create 1 rle with old method : 0.027922391891479492 length of segment : 339 time for calcul the mask position with numpy : 0.0005204677581787109 nb_pixel_total : 9316 time to create 1 rle with old method : 0.010983943939208984 length of segment : 207 time for calcul the mask position with numpy : 0.0012450218200683594 nb_pixel_total : 24754 time to create 1 rle with old method : 0.028305530548095703 length of segment : 327 time for calcul the mask position with numpy : 0.00047469139099121094 nb_pixel_total : 10890 time to create 1 rle with old method : 0.012553930282592773 length of segment : 120 time for calcul the mask position with numpy : 0.0042002201080322266 nb_pixel_total : 108910 time to create 1 rle with old method : 0.12304329872131348 length of segment : 565 time for calcul the mask position with numpy : 0.0004980564117431641 nb_pixel_total : 8562 time to create 1 rle with old method : 0.010147809982299805 length of segment : 86 time for calcul the mask position with numpy : 0.002912759780883789 nb_pixel_total : 44603 time to create 1 rle with old method : 0.05156087875366211 length of segment : 391 time for calcul the mask position with numpy : 0.005364179611206055 nb_pixel_total : 100227 time to create 1 rle with old method : 0.14034342765808105 length of segment : 496 time for calcul the mask position with numpy : 0.003027200698852539 nb_pixel_total : 59904 time to create 1 rle with old method : 0.08124470710754395 length of segment : 359 time for calcul the mask position with numpy : 0.0005769729614257812 nb_pixel_total : 8900 time to create 1 rle with old method : 0.010758399963378906 length of segment : 148 time for calcul the mask position with numpy : 0.0013620853424072266 nb_pixel_total : 55520 time to create 1 rle with old method : 0.06361937522888184 length of segment : 356 time for calcul the mask position with numpy : 0.0005383491516113281 nb_pixel_total : 11688 time to create 1 rle with old method : 0.014150619506835938 length of segment : 113 time for calcul the mask position with numpy : 0.0003590583801269531 nb_pixel_total : 7191 time to create 1 rle with old method : 0.008704662322998047 length of segment : 96 time for calcul the mask position with numpy : 0.0005211830139160156 nb_pixel_total : 8337 time to create 1 rle with old method : 0.010040760040283203 length of segment : 117 time for calcul the mask position with numpy : 0.002737760543823242 nb_pixel_total : 92567 time to create 1 rle with old method : 0.10657835006713867 length of segment : 281 time for calcul the mask position with numpy : 0.004647731781005859 nb_pixel_total : 137315 time to create 1 rle with old method : 0.17305350303649902 length of segment : 584 time for calcul the mask position with numpy : 0.0025780200958251953 nb_pixel_total : 66024 time to create 1 rle with old method : 0.0793154239654541 length of segment : 347 time for calcul the mask position with numpy : 0.0007190704345703125 nb_pixel_total : 10056 time to create 1 rle with old method : 0.011940479278564453 length of segment : 122 time for calcul the mask position with numpy : 0.0009965896606445312 nb_pixel_total : 17379 time to create 1 rle with old method : 0.023835182189941406 length of segment : 169 time for calcul the mask position with numpy : 0.009677886962890625 nb_pixel_total : 256606 time to create 1 rle with new method : 0.02112126350402832 length of segment : 585 time for calcul the mask position with numpy : 0.0017848014831542969 nb_pixel_total : 34027 time to create 1 rle with old method : 0.03993558883666992 length of segment : 342 time for calcul the mask position with numpy : 0.010210037231445312 nb_pixel_total : 253767 time to create 1 rle with new method : 0.013985633850097656 length of segment : 661 time for calcul the mask position with numpy : 0.00048732757568359375 nb_pixel_total : 6425 time to create 1 rle with old method : 0.007653236389160156 length of segment : 133 time for calcul the mask position with numpy : 0.0007727146148681641 nb_pixel_total : 18405 time to create 1 rle with old method : 0.022329330444335938 length of segment : 138 time for calcul the mask position with numpy : 0.002746105194091797 nb_pixel_total : 71276 time to create 1 rle with old method : 0.08187079429626465 length of segment : 325 time for calcul the mask position with numpy : 0.0005481243133544922 nb_pixel_total : 8192 time to create 1 rle with old method : 0.009654998779296875 length of segment : 154 time for calcul the mask position with numpy : 0.009540081024169922 nb_pixel_total : 252265 time to create 1 rle with new method : 0.010788679122924805 length of segment : 735 time for calcul the mask position with numpy : 0.0009906291961669922 nb_pixel_total : 23904 time to create 1 rle with old method : 0.028832674026489258 length of segment : 241 time for calcul the mask position with numpy : 0.0008652210235595703 nb_pixel_total : 11847 time to create 1 rle with old method : 0.014324665069580078 length of segment : 144 time for calcul the mask position with numpy : 0.0010612010955810547 nb_pixel_total : 32089 time to create 1 rle with old method : 0.0388181209564209 length of segment : 186 time for calcul the mask position with numpy : 0.0005230903625488281 nb_pixel_total : 11279 time to create 1 rle with old method : 0.013685464859008789 length of segment : 123 time for calcul the mask position with numpy : 0.022284507751464844 nb_pixel_total : 340253 time to create 1 rle with new method : 0.0814359188079834 length of segment : 1152 time for calcul the mask position with numpy : 0.0021543502807617188 nb_pixel_total : 47038 time to create 1 rle with old method : 0.05484962463378906 length of segment : 243 time for calcul the mask position with numpy : 0.0010635852813720703 nb_pixel_total : 24366 time to create 1 rle with old method : 0.028057098388671875 length of segment : 147 time for calcul the mask position with numpy : 0.002567768096923828 nb_pixel_total : 61286 time to create 1 rle with old method : 0.07033252716064453 length of segment : 295 time for calcul the mask position with numpy : 0.0030117034912109375 nb_pixel_total : 60548 time to create 1 rle with old method : 0.0742642879486084 length of segment : 266 time for calcul the mask position with numpy : 0.002185821533203125 nb_pixel_total : 64239 time to create 1 rle with old method : 0.0782470703125 length of segment : 288 time for calcul the mask position with numpy : 0.002105712890625 nb_pixel_total : 49603 time to create 1 rle with old method : 0.062896728515625 length of segment : 265 time for calcul the mask position with numpy : 0.0024106502532958984 nb_pixel_total : 64797 time to create 1 rle with old method : 0.07524275779724121 length of segment : 309 time for calcul the mask position with numpy : 0.005249500274658203 nb_pixel_total : 141793 time to create 1 rle with old method : 0.20755982398986816 length of segment : 985 time for calcul the mask position with numpy : 0.0033321380615234375 nb_pixel_total : 45250 time to create 1 rle with old method : 0.0563051700592041 length of segment : 318 time for calcul the mask position with numpy : 0.0071370601654052734 nb_pixel_total : 119133 time to create 1 rle with old method : 0.1375293731689453 length of segment : 849 time for calcul the mask position with numpy : 0.001984834671020508 nb_pixel_total : 33489 time to create 1 rle with old method : 0.04735445976257324 length of segment : 260 time for calcul the mask position with numpy : 0.0005922317504882812 nb_pixel_total : 9551 time to create 1 rle with old method : 0.013157129287719727 length of segment : 104 time for calcul the mask position with numpy : 0.0008184909820556641 nb_pixel_total : 22251 time to create 1 rle with old method : 0.027173280715942383 length of segment : 127 time for calcul the mask position with numpy : 0.001222848892211914 nb_pixel_total : 27530 time to create 1 rle with old method : 0.03311562538146973 length of segment : 170 time for calcul the mask position with numpy : 0.02034616470336914 nb_pixel_total : 444688 time to create 1 rle with new method : 0.0588831901550293 length of segment : 2092 time for calcul the mask position with numpy : 0.018929719924926758 nb_pixel_total : 467015 time to create 1 rle with new method : 0.06216239929199219 length of segment : 1330 time for calcul the mask position with numpy : 0.0014393329620361328 nb_pixel_total : 35114 time to create 1 rle with old method : 0.040680885314941406 length of segment : 307 time for calcul the mask position with numpy : 0.0034487247467041016 nb_pixel_total : 110527 time to create 1 rle with old method : 0.1250460147857666 length of segment : 350 time for calcul the mask position with numpy : 0.002806425094604492 nb_pixel_total : 75039 time to create 1 rle with old method : 0.08496737480163574 length of segment : 237 time for calcul the mask position with numpy : 0.0006778240203857422 nb_pixel_total : 12937 time to create 1 rle with old method : 0.01709890365600586 length of segment : 103 time for calcul the mask position with numpy : 0.00058746337890625 nb_pixel_total : 14743 time to create 1 rle with old method : 0.017760276794433594 length of segment : 105 time for calcul the mask position with numpy : 0.0013365745544433594 nb_pixel_total : 33129 time to create 1 rle with old method : 0.03950381278991699 length of segment : 163 time for calcul the mask position with numpy : 0.0007102489471435547 nb_pixel_total : 24127 time to create 1 rle with old method : 0.03315305709838867 length of segment : 127 time for calcul the mask position with numpy : 0.0033562183380126953 nb_pixel_total : 111907 time to create 1 rle with old method : 0.13152170181274414 length of segment : 481 time for calcul the mask position with numpy : 0.0005311965942382812 nb_pixel_total : 14652 time to create 1 rle with old method : 0.0174713134765625 length of segment : 193 time for calcul the mask position with numpy : 0.0094451904296875 nb_pixel_total : 159843 time to create 1 rle with new method : 0.016940832138061523 length of segment : 827 time for calcul the mask position with numpy : 0.0013060569763183594 nb_pixel_total : 25493 time to create 1 rle with old method : 0.03357362747192383 length of segment : 189 time for calcul the mask position with numpy : 0.001619100570678711 nb_pixel_total : 39223 time to create 1 rle with old method : 0.04958987236022949 length of segment : 307 time for calcul the mask position with numpy : 0.0018210411071777344 nb_pixel_total : 57675 time to create 1 rle with old method : 0.07225847244262695 length of segment : 318 time for calcul the mask position with numpy : 0.0015530586242675781 nb_pixel_total : 29309 time to create 1 rle with old method : 0.04881763458251953 length of segment : 276 time for calcul the mask position with numpy : 0.0015752315521240234 nb_pixel_total : 17362 time to create 1 rle with old method : 0.021678924560546875 length of segment : 184 time for calcul the mask position with numpy : 0.001354217529296875 nb_pixel_total : 27820 time to create 1 rle with old method : 0.033000946044921875 length of segment : 214 time for calcul the mask position with numpy : 0.004148721694946289 nb_pixel_total : 80096 time to create 1 rle with old method : 0.0956580638885498 length of segment : 224 time for calcul the mask position with numpy : 0.0030798912048339844 nb_pixel_total : 101570 time to create 1 rle with old method : 0.11507678031921387 length of segment : 565 time for calcul the mask position with numpy : 0.0043599605560302734 nb_pixel_total : 156990 time to create 1 rle with new method : 0.006775617599487305 length of segment : 292 time for calcul the mask position with numpy : 0.0009551048278808594 nb_pixel_total : 23874 time to create 1 rle with old method : 0.028146982192993164 length of segment : 156 time for calcul the mask position with numpy : 0.003989458084106445 nb_pixel_total : 115164 time to create 1 rle with old method : 0.132338285446167 length of segment : 480 time for calcul the mask position with numpy : 0.0014133453369140625 nb_pixel_total : 60191 time to create 1 rle with old method : 0.06885576248168945 length of segment : 378 time for calcul the mask position with numpy : 0.00667881965637207 nb_pixel_total : 271019 time to create 1 rle with new method : 0.012993812561035156 length of segment : 727 time for calcul the mask position with numpy : 0.0010232925415039062 nb_pixel_total : 25832 time to create 1 rle with old method : 0.03770184516906738 length of segment : 133 time for calcul the mask position with numpy : 0.022942066192626953 nb_pixel_total : 801089 time to create 1 rle with new method : 0.21520113945007324 length of segment : 876 time for calcul the mask position with numpy : 0.005535602569580078 nb_pixel_total : 209215 time to create 1 rle with new method : 0.009220361709594727 length of segment : 505 time for calcul the mask position with numpy : 0.0012421607971191406 nb_pixel_total : 30509 time to create 1 rle with old method : 0.03723430633544922 length of segment : 254 time for calcul the mask position with numpy : 0.0005240440368652344 nb_pixel_total : 21889 time to create 1 rle with old method : 0.0252988338470459 length of segment : 257 time spent for convertir_results : 16.433035612106323 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 143 chid ids of type : 3594 Number RLEs to save : 46284 save missing photos in datou_result : time spend for datou_step_exec : 83.48934412002563 time spend to save output : 2.727825403213501 total time spend for step 1 : 86.21716952323914 step2:crop_condition Tue Apr 22 13:21:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 143 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 88 About to insert : list_path_to_insert length 88 new photo from crops ! About to upload 88 photos upload in portfolio : 3736932 init cache_photo without model_param we have 88 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745320941_3447823 we have uploaded 88 photos in the portfolio 3736932 time of upload the photos Elapsed time : 33.1463463306427 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 3736932 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745320982_3447823 we have uploaded 21 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.762961149215698 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 29 About to insert : list_path_to_insert length 29 new photo from crops ! About to upload 29 photos upload in portfolio : 3736932 init cache_photo without model_param we have 29 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745321005_3447823 we have uploaded 29 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.827184677124023 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745321016_3447823 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.6023223400115967 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745321018_3447823 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.953131914138794 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745321021_3447823 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6586081981658936 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1352591871, 1352591868, 1352591834, 1352591829, 1352591809, 1352591652, 1352591650, 1352591645] Looping around the photos to save general results len do output : 143 /1352607874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352607997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352608630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591871', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591868', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591834', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591829', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591809', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591652', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591650', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591645', None, None, None, None, None, '2748458') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 437 time used for this insertion : 0.028982162475585938 save_final save missing photos in datou_result : time spend for datou_step_exec : 107.1607985496521 time spend to save output : 0.03546500205993652 total time spend for step 2 : 107.19626355171204 step3:rle_unique_nms_with_priority Tue Apr 22 13:23:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 143 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 34 nb_hashtags : 4 time to prepare the origin masks : 4.79358696937561 time for calcul the mask position with numpy : 0.4888582229614258 nb_pixel_total : 4611449 time to create 1 rle with new method : 0.7055459022521973 time for calcul the mask position with numpy : 0.029807567596435547 nb_pixel_total : 11530 time to create 1 rle with old method : 0.013922929763793945 time for calcul the mask position with numpy : 0.03050518035888672 nb_pixel_total : 182702 time to create 1 rle with new method : 0.7772221565246582 time for calcul the mask position with numpy : 0.029443025588989258 nb_pixel_total : 10502 time to create 1 rle with old method : 0.013657331466674805 time for calcul the mask position with numpy : 0.03196907043457031 nb_pixel_total : 215515 time to create 1 rle with new method : 0.6053664684295654 time for calcul the mask position with numpy : 0.02908611297607422 nb_pixel_total : 13356 time to create 1 rle with old method : 0.015434980392456055 time for calcul the mask position with numpy : 0.029788970947265625 nb_pixel_total : 174448 time to create 1 rle with new method : 0.6434688568115234 time for calcul the mask position with numpy : 0.029574155807495117 nb_pixel_total : 1402 time to create 1 rle with old method : 0.001737356185913086 time for calcul the mask position with numpy : 0.030241966247558594 nb_pixel_total : 122189 time to create 1 rle with old method : 0.13775944709777832 time for calcul the mask position with numpy : 0.030344486236572266 nb_pixel_total : 47744 time to create 1 rle with old method : 0.05406594276428223 time for calcul the mask position with numpy : 0.03143954277038574 nb_pixel_total : 408815 time to create 1 rle with new method : 0.5460693836212158 time for calcul the mask position with numpy : 0.03147697448730469 nb_pixel_total : 7634 time to create 1 rle with old method : 0.009921550750732422 time for calcul the mask position with numpy : 0.03307938575744629 nb_pixel_total : 11946 time to create 1 rle with old method : 0.019403696060180664 time for calcul the mask position with numpy : 0.033690690994262695 nb_pixel_total : 31991 time to create 1 rle with old method : 0.03827691078186035 time for calcul the mask position with numpy : 0.02997589111328125 nb_pixel_total : 1771 time to create 1 rle with old method : 0.002077817916870117 time for calcul the mask position with numpy : 0.030318498611450195 nb_pixel_total : 38618 time to create 1 rle with old method : 0.04490041732788086 time for calcul the mask position with numpy : 0.029690265655517578 nb_pixel_total : 39029 time to create 1 rle with old method : 0.0460662841796875 time for calcul the mask position with numpy : 0.030193090438842773 nb_pixel_total : 12495 time to create 1 rle with old method : 0.014368057250976562 time for calcul the mask position with numpy : 0.0302278995513916 nb_pixel_total : 17551 time to create 1 rle with old method : 0.01985955238342285 time for calcul the mask position with numpy : 0.030025959014892578 nb_pixel_total : 19747 time to create 1 rle with old method : 0.022487163543701172 time for calcul the mask position with numpy : 0.032058000564575195 nb_pixel_total : 15406 time to create 1 rle with old method : 0.0171663761138916 time for calcul the mask position with numpy : 0.030234813690185547 nb_pixel_total : 22783 time to create 1 rle with old method : 0.025854825973510742 time for calcul the mask position with numpy : 0.030290603637695312 nb_pixel_total : 32537 time to create 1 rle with old method : 0.03763413429260254 time for calcul the mask position with numpy : 0.03396010398864746 nb_pixel_total : 57093 time to create 1 rle with old method : 0.0650327205657959 time for calcul the mask position with numpy : 0.0355374813079834 nb_pixel_total : 473585 time to create 1 rle with new method : 0.8111085891723633 time for calcul the mask position with numpy : 0.03169608116149902 nb_pixel_total : 16833 time to create 1 rle with old method : 0.022203922271728516 time for calcul the mask position with numpy : 0.03396248817443848 nb_pixel_total : 144946 time to create 1 rle with old method : 0.2000257968902588 time for calcul the mask position with numpy : 0.036362409591674805 nb_pixel_total : 47592 time to create 1 rle with old method : 0.08476424217224121 time for calcul the mask position with numpy : 0.029244661331176758 nb_pixel_total : 16193 time to create 1 rle with old method : 0.018570899963378906 time for calcul the mask position with numpy : 0.03539752960205078 nb_pixel_total : 26398 time to create 1 rle with old method : 0.029011249542236328 time for calcul the mask position with numpy : 0.029317617416381836 nb_pixel_total : 71221 time to create 1 rle with old method : 0.07828760147094727 time for calcul the mask position with numpy : 0.030064821243286133 nb_pixel_total : 110543 time to create 1 rle with old method : 0.1316394805908203 time for calcul the mask position with numpy : 0.031667470932006836 nb_pixel_total : 12887 time to create 1 rle with old method : 0.01601719856262207 time for calcul the mask position with numpy : 0.03238272666931152 nb_pixel_total : 6077 time to create 1 rle with old method : 0.00832366943359375 time for calcul the mask position with numpy : 0.031249046325683594 nb_pixel_total : 15712 time to create 1 rle with old method : 0.01878952980041504 create new chi : 7.011444091796875 time to delete rle : 0.021710872650146484 batch 1 Loaded 69 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 20621 TO DO : save crop sub photo not yet done ! save time : 1.22922945022583 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 4.323074579238892 time for calcul the mask position with numpy : 1.166318416595459 nb_pixel_total : 6064835 time to create 1 rle with new method : 1.0240652561187744 time for calcul the mask position with numpy : 0.02168560028076172 nb_pixel_total : 7205 time to create 1 rle with old method : 0.00828099250793457 time for calcul the mask position with numpy : 0.03515315055847168 nb_pixel_total : 10113 time to create 1 rle with old method : 0.01182866096496582 time for calcul the mask position with numpy : 0.035332679748535156 nb_pixel_total : 1904 time to create 1 rle with old method : 0.0024309158325195312 time for calcul the mask position with numpy : 0.03673815727233887 nb_pixel_total : 55502 time to create 1 rle with old method : 0.06261634826660156 time for calcul the mask position with numpy : 0.03594255447387695 nb_pixel_total : 208382 time to create 1 rle with new method : 1.1356446743011475 time for calcul the mask position with numpy : 0.03389859199523926 nb_pixel_total : 7119 time to create 1 rle with old method : 0.008084774017333984 time for calcul the mask position with numpy : 0.02391529083251953 nb_pixel_total : 31156 time to create 1 rle with old method : 0.03600788116455078 time for calcul the mask position with numpy : 0.022673845291137695 nb_pixel_total : 24824 time to create 1 rle with old method : 0.02899336814880371 time for calcul the mask position with numpy : 0.028715848922729492 nb_pixel_total : 611409 time to create 1 rle with new method : 0.5247781276702881 time for calcul the mask position with numpy : 0.024091243743896484 nb_pixel_total : 27791 time to create 1 rle with old method : 0.0321805477142334 create new chi : 4.4222517013549805 time to delete rle : 0.002220630645751953 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 8307 TO DO : save crop sub photo not yet done ! save time : 0.5393402576446533 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 7.4160168170928955 time for calcul the mask position with numpy : 0.5983023643493652 nb_pixel_total : 6185867 time to create 1 rle with new method : 0.8875067234039307 time for calcul the mask position with numpy : 0.03507637977600098 nb_pixel_total : 14670 time to create 1 rle with old method : 0.016749858856201172 time for calcul the mask position with numpy : 0.03489255905151367 nb_pixel_total : 18693 time to create 1 rle with old method : 0.02098989486694336 time for calcul the mask position with numpy : 0.03459739685058594 nb_pixel_total : 36993 time to create 1 rle with old method : 0.046138763427734375 time for calcul the mask position with numpy : 0.038675546646118164 nb_pixel_total : 140101 time to create 1 rle with old method : 0.15540170669555664 time for calcul the mask position with numpy : 0.0390012264251709 nb_pixel_total : 25586 time to create 1 rle with old method : 0.02957439422607422 time for calcul the mask position with numpy : 0.032541751861572266 nb_pixel_total : 73932 time to create 1 rle with old method : 0.08161377906799316 time for calcul the mask position with numpy : 0.024855375289916992 nb_pixel_total : 219139 time to create 1 rle with new method : 0.7850720882415771 time for calcul the mask position with numpy : 0.023168325424194336 nb_pixel_total : 19567 time to create 1 rle with old method : 0.02248859405517578 time for calcul the mask position with numpy : 0.02443099021911621 nb_pixel_total : 33594 time to create 1 rle with old method : 0.03736162185668945 time for calcul the mask position with numpy : 0.023428678512573242 nb_pixel_total : 14521 time to create 1 rle with old method : 0.016637802124023438 time for calcul the mask position with numpy : 0.022381067276000977 nb_pixel_total : 34605 time to create 1 rle with old method : 0.03875589370727539 time for calcul the mask position with numpy : 0.023566007614135742 nb_pixel_total : 22943 time to create 1 rle with old method : 0.02520275115966797 time for calcul the mask position with numpy : 0.02308511734008789 nb_pixel_total : 12427 time to create 1 rle with old method : 0.013800859451293945 time for calcul the mask position with numpy : 0.023271560668945312 nb_pixel_total : 11265 time to create 1 rle with old method : 0.012636661529541016 time for calcul the mask position with numpy : 0.023427248001098633 nb_pixel_total : 83386 time to create 1 rle with old method : 0.093658447265625 time for calcul the mask position with numpy : 0.024407148361206055 nb_pixel_total : 27579 time to create 1 rle with old method : 0.030554771423339844 time for calcul the mask position with numpy : 0.03451037406921387 nb_pixel_total : 14291 time to create 1 rle with old method : 0.015943527221679688 time for calcul the mask position with numpy : 0.034560441970825195 nb_pixel_total : 17401 time to create 1 rle with old method : 0.019042491912841797 time for calcul the mask position with numpy : 0.0336153507232666 nb_pixel_total : 43680 time to create 1 rle with old method : 0.04868936538696289 create new chi : 3.6181559562683105 time to delete rle : 0.0019893646240234375 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++++++++++Number RLEs to save : 12790 TO DO : save crop sub photo not yet done ! save time : 0.8054561614990234 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 6.451777696609497 time for calcul the mask position with numpy : 0.6203954219818115 nb_pixel_total : 6565003 time to create 1 rle with new method : 0.8779711723327637 time for calcul the mask position with numpy : 0.04136252403259277 nb_pixel_total : 7191 time to create 1 rle with old method : 0.011689424514770508 time for calcul the mask position with numpy : 0.03977394104003906 nb_pixel_total : 11688 time to create 1 rle with old method : 0.013170242309570312 time for calcul the mask position with numpy : 0.037998199462890625 nb_pixel_total : 1218 time to create 1 rle with old method : 0.0020630359649658203 time for calcul the mask position with numpy : 0.03591632843017578 nb_pixel_total : 8900 time to create 1 rle with old method : 0.010018110275268555 time for calcul the mask position with numpy : 0.03700852394104004 nb_pixel_total : 59904 time to create 1 rle with old method : 0.06830930709838867 time for calcul the mask position with numpy : 0.03570127487182617 nb_pixel_total : 100227 time to create 1 rle with old method : 0.11701083183288574 time for calcul the mask position with numpy : 0.03691697120666504 nb_pixel_total : 44603 time to create 1 rle with old method : 0.05086994171142578 time for calcul the mask position with numpy : 0.03666114807128906 nb_pixel_total : 8562 time to create 1 rle with old method : 0.00978398323059082 time for calcul the mask position with numpy : 0.0361018180847168 nb_pixel_total : 108910 time to create 1 rle with old method : 0.12558197975158691 time for calcul the mask position with numpy : 0.0351712703704834 nb_pixel_total : 10890 time to create 1 rle with old method : 0.012314558029174805 time for calcul the mask position with numpy : 0.03482699394226074 nb_pixel_total : 24754 time to create 1 rle with old method : 0.02773451805114746 time for calcul the mask position with numpy : 0.036370277404785156 nb_pixel_total : 9316 time to create 1 rle with old method : 0.01073765754699707 time for calcul the mask position with numpy : 0.03768277168273926 nb_pixel_total : 15707 time to create 1 rle with old method : 0.024712085723876953 time for calcul the mask position with numpy : 0.04048514366149902 nb_pixel_total : 32514 time to create 1 rle with old method : 0.06086587905883789 time for calcul the mask position with numpy : 0.04336953163146973 nb_pixel_total : 11846 time to create 1 rle with old method : 0.015978336334228516 time for calcul the mask position with numpy : 0.06939578056335449 nb_pixel_total : 15121 time to create 1 rle with old method : 0.06596112251281738 time for calcul the mask position with numpy : 0.05152750015258789 nb_pixel_total : 13886 time to create 1 rle with old method : 0.015834569931030273 create new chi : 2.872260808944702 time to delete rle : 0.0021326541900634766 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 10048 TO DO : save crop sub photo not yet done ! save time : 0.7622463703155518 nb_obj : 18 nb_hashtags : 2 time to prepare the origin masks : 6.610299825668335 time for calcul the mask position with numpy : 0.4443998336791992 nb_pixel_total : 5744228 time to create 1 rle with new method : 0.894127607345581 time for calcul the mask position with numpy : 0.04374098777770996 nb_pixel_total : 5531 time to create 1 rle with old method : 0.0066111087799072266 time for calcul the mask position with numpy : 0.04068779945373535 nb_pixel_total : 32089 time to create 1 rle with old method : 0.039745330810546875 time for calcul the mask position with numpy : 0.03662514686584473 nb_pixel_total : 11847 time to create 1 rle with old method : 0.013429880142211914 time for calcul the mask position with numpy : 0.03874397277832031 nb_pixel_total : 23904 time to create 1 rle with old method : 0.028003454208374023 time for calcul the mask position with numpy : 0.039298057556152344 nb_pixel_total : 252265 time to create 1 rle with new method : 0.9280133247375488 time for calcul the mask position with numpy : 0.03461718559265137 nb_pixel_total : 8192 time to create 1 rle with old method : 0.009142398834228516 time for calcul the mask position with numpy : 0.035036325454711914 nb_pixel_total : 71276 time to create 1 rle with old method : 0.08808612823486328 time for calcul the mask position with numpy : 0.04091501235961914 nb_pixel_total : 18405 time to create 1 rle with old method : 0.03081679344177246 time for calcul the mask position with numpy : 0.03765988349914551 nb_pixel_total : 6425 time to create 1 rle with old method : 0.0073010921478271484 time for calcul the mask position with numpy : 0.03963518142700195 nb_pixel_total : 253767 time to create 1 rle with new method : 0.6938228607177734 time for calcul the mask position with numpy : 0.04311776161193848 nb_pixel_total : 34027 time to create 1 rle with old method : 0.04309344291687012 time for calcul the mask position with numpy : 0.044072866439819336 nb_pixel_total : 256606 time to create 1 rle with new method : 0.6397254467010498 time for calcul the mask position with numpy : 0.03607988357543945 nb_pixel_total : 17379 time to create 1 rle with old method : 0.019796371459960938 time for calcul the mask position with numpy : 0.036193132400512695 nb_pixel_total : 10056 time to create 1 rle with old method : 0.011518001556396484 time for calcul the mask position with numpy : 0.0401616096496582 nb_pixel_total : 66024 time to create 1 rle with old method : 0.1059718132019043 time for calcul the mask position with numpy : 0.03625774383544922 nb_pixel_total : 137315 time to create 1 rle with old method : 0.15718388557434082 time for calcul the mask position with numpy : 0.034536123275756836 nb_pixel_total : 92567 time to create 1 rle with old method : 0.10385847091674805 time for calcul the mask position with numpy : 0.03200864791870117 nb_pixel_total : 8337 time to create 1 rle with old method : 0.009426593780517578 create new chi : 5.084186315536499 time to delete rle : 0.003312826156616211 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 12774 TO DO : save crop sub photo not yet done ! save time : 0.7899894714355469 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 6.699484348297119 time for calcul the mask position with numpy : 0.5422065258026123 nb_pixel_total : 5494425 time to create 1 rle with new method : 0.7808499336242676 time for calcul the mask position with numpy : 0.03155636787414551 nb_pixel_total : 444688 time to create 1 rle with new method : 0.6084949970245361 time for calcul the mask position with numpy : 0.03454232215881348 nb_pixel_total : 27530 time to create 1 rle with old method : 0.03838348388671875 time for calcul the mask position with numpy : 0.03966093063354492 nb_pixel_total : 22251 time to create 1 rle with old method : 0.03168439865112305 time for calcul the mask position with numpy : 0.03388047218322754 nb_pixel_total : 9551 time to create 1 rle with old method : 0.01052093505859375 time for calcul the mask position with numpy : 0.03802680969238281 nb_pixel_total : 33489 time to create 1 rle with old method : 0.039388179779052734 time for calcul the mask position with numpy : 0.03807520866394043 nb_pixel_total : 119133 time to create 1 rle with old method : 0.12835073471069336 time for calcul the mask position with numpy : 0.03443646430969238 nb_pixel_total : 45250 time to create 1 rle with old method : 0.050821542739868164 time for calcul the mask position with numpy : 0.025318622589111328 nb_pixel_total : 141793 time to create 1 rle with old method : 0.16030216217041016 time for calcul the mask position with numpy : 0.02505803108215332 nb_pixel_total : 64797 time to create 1 rle with old method : 0.07359600067138672 time for calcul the mask position with numpy : 0.024002552032470703 nb_pixel_total : 49603 time to create 1 rle with old method : 0.055104970932006836 time for calcul the mask position with numpy : 0.02280282974243164 nb_pixel_total : 64239 time to create 1 rle with old method : 0.07351446151733398 time for calcul the mask position with numpy : 0.022366762161254883 nb_pixel_total : 60548 time to create 1 rle with old method : 0.07109618186950684 time for calcul the mask position with numpy : 0.023827075958251953 nb_pixel_total : 61286 time to create 1 rle with old method : 0.08281135559082031 time for calcul the mask position with numpy : 0.024222373962402344 nb_pixel_total : 24366 time to create 1 rle with old method : 0.030021190643310547 time for calcul the mask position with numpy : 0.02191019058227539 nb_pixel_total : 47038 time to create 1 rle with old method : 0.05339837074279785 time for calcul the mask position with numpy : 0.024668455123901367 nb_pixel_total : 340253 time to create 1 rle with new method : 0.9856929779052734 create new chi : 4.367339372634888 time to delete rle : 0.004712820053100586 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 17900 TO DO : save crop sub photo not yet done ! save time : 1.1966240406036377 nb_obj : 18 nb_hashtags : 4 time to prepare the origin masks : 8.375075101852417 time for calcul the mask position with numpy : 0.2888815402984619 nb_pixel_total : 5716429 time to create 1 rle with new method : 0.780921220779419 time for calcul the mask position with numpy : 0.04098391532897949 nb_pixel_total : 77896 time to create 1 rle with old method : 0.08792662620544434 time for calcul the mask position with numpy : 0.03972768783569336 nb_pixel_total : 27820 time to create 1 rle with old method : 0.03412485122680664 time for calcul the mask position with numpy : 0.038073062896728516 nb_pixel_total : 17362 time to create 1 rle with old method : 0.028734445571899414 time for calcul the mask position with numpy : 0.02345895767211914 nb_pixel_total : 29309 time to create 1 rle with old method : 0.03800034523010254 time for calcul the mask position with numpy : 0.02585601806640625 nb_pixel_total : 57675 time to create 1 rle with old method : 0.08743453025817871 time for calcul the mask position with numpy : 0.037665605545043945 nb_pixel_total : 39223 time to create 1 rle with old method : 0.04762101173400879 time for calcul the mask position with numpy : 0.03768467903137207 nb_pixel_total : 25493 time to create 1 rle with old method : 0.029622554779052734 time for calcul the mask position with numpy : 0.0369720458984375 nb_pixel_total : 159843 time to create 1 rle with new method : 0.882502555847168 time for calcul the mask position with numpy : 0.03719663619995117 nb_pixel_total : 14652 time to create 1 rle with old method : 0.0174558162689209 time for calcul the mask position with numpy : 0.03985238075256348 nb_pixel_total : 111907 time to create 1 rle with old method : 0.13117337226867676 time for calcul the mask position with numpy : 0.0348200798034668 nb_pixel_total : 24127 time to create 1 rle with old method : 0.0275418758392334 time for calcul the mask position with numpy : 0.03337883949279785 nb_pixel_total : 33129 time to create 1 rle with old method : 0.0414121150970459 time for calcul the mask position with numpy : 0.021540164947509766 nb_pixel_total : 14743 time to create 1 rle with old method : 0.01682758331298828 time for calcul the mask position with numpy : 0.022544384002685547 nb_pixel_total : 12937 time to create 1 rle with old method : 0.01576542854309082 time for calcul the mask position with numpy : 0.02275538444519043 nb_pixel_total : 75039 time to create 1 rle with old method : 0.08634018898010254 time for calcul the mask position with numpy : 0.024154186248779297 nb_pixel_total : 110527 time to create 1 rle with old method : 0.13397216796875 time for calcul the mask position with numpy : 0.026423931121826172 nb_pixel_total : 35114 time to create 1 rle with old method : 0.04802298545837402 time for calcul the mask position with numpy : 0.026232242584228516 nb_pixel_total : 467015 time to create 1 rle with new method : 0.6129827499389648 create new chi : 4.1074278354644775 time to delete rle : 0.0022559165954589844 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 13974 TO DO : save crop sub photo not yet done ! save time : 0.8323373794555664 nb_obj : 11 nb_hashtags : 2 time to prepare the origin masks : 3.8204152584075928 time for calcul the mask position with numpy : 0.6355628967285156 nb_pixel_total : 5232898 time to create 1 rle with new method : 0.8843724727630615 time for calcul the mask position with numpy : 0.021541357040405273 nb_pixel_total : 21889 time to create 1 rle with old method : 0.02492809295654297 time for calcul the mask position with numpy : 0.02303624153137207 nb_pixel_total : 30509 time to create 1 rle with old method : 0.034955739974975586 time for calcul the mask position with numpy : 0.02675938606262207 nb_pixel_total : 209215 time to create 1 rle with new method : 0.9575576782226562 time for calcul the mask position with numpy : 0.030939579010009766 nb_pixel_total : 801089 time to create 1 rle with new method : 0.513547420501709 time for calcul the mask position with numpy : 0.022782564163208008 nb_pixel_total : 25832 time to create 1 rle with old method : 0.02906322479248047 time for calcul the mask position with numpy : 0.02351546287536621 nb_pixel_total : 271019 time to create 1 rle with new method : 0.7306716442108154 time for calcul the mask position with numpy : 0.034807443618774414 nb_pixel_total : 60191 time to create 1 rle with old method : 0.06632447242736816 time for calcul the mask position with numpy : 0.03681015968322754 nb_pixel_total : 115164 time to create 1 rle with old method : 0.12899017333984375 time for calcul the mask position with numpy : 0.03709983825683594 nb_pixel_total : 23874 time to create 1 rle with old method : 0.038037776947021484 time for calcul the mask position with numpy : 0.039463043212890625 nb_pixel_total : 156990 time to create 1 rle with new method : 0.404573917388916 time for calcul the mask position with numpy : 0.03426814079284668 nb_pixel_total : 101570 time to create 1 rle with old method : 0.1120307445526123 create new chi : 5.024935960769653 time to delete rle : 0.0019228458404541016 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++Number RLEs to save : 11406 TO DO : save crop sub photo not yet done ! save time : 0.7053394317626953 map_output_result : {1352591871: (0.0, 'Should be the crop_list due to order', 0), 1352591868: (0.0, 'Should be the crop_list due to order', 0), 1352591834: (0.0, 'Should be the crop_list due to order', 0), 1352591829: (0.0, 'Should be the crop_list due to order', 0), 1352591809: (0.0, 'Should be the crop_list due to order', 0), 1352591652: (0.0, 'Should be the crop_list due to order', 0), 1352591650: (0.0, 'Should be the crop_list due to order', 0), 1352591645: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1352591871, 1352591868, 1352591834, 1352591829, 1352591809, 1352591652, 1352591650, 1352591645] Looping around the photos to save general results len do output : 8 /1352591871.Didn't retrieve data . /1352591868.Didn't retrieve data . /1352591834.Didn't retrieve data . /1352591829.Didn't retrieve data . /1352591809.Didn't retrieve data . /1352591652.Didn't retrieve data . /1352591650.Didn't retrieve data . /1352591645.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591871', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591868', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591834', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591829', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591809', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591652', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591650', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591645', None, None, None, None, None, '2748458') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.013771533966064453 save_final save missing photos in datou_result : time spend for datou_step_exec : 93.02327799797058 time spend to save output : 0.01427149772644043 total time spend for step 3 : 93.03754949569702 step4:ventilate_hashtags_in_portfolio Tue Apr 22 13:25:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22301301 get user id for portfolio 22301301 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22301301 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','flou','pet_fonce','metal','pet_clair','pehd','autre','background','papier','carton')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22301301 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','flou','pet_fonce','metal','pet_clair','pehd','autre','background','papier','carton')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22301301 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','flou','pet_fonce','metal','pet_clair','pehd','autre','background','papier','carton')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22301526,22301527,22301528,22301529,22301530,22301531,22301532,22301533,22301534,22301535,22301536?tags=environnement,mal_croppe,flou,pet_fonce,metal,pet_clair,pehd,autre,background,papier,carton Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1352591871, 1352591868, 1352591834, 1352591829, 1352591809, 1352591652, 1352591650, 1352591645] Looping around the photos to save general results len do output : 1 /22301301. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591871', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591868', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591834', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591829', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591809', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591652', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591650', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591645', None, None, None, None, None, '2748458') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.016780614852905273 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5709874629974365 time spend to save output : 0.01703500747680664 total time spend for step 4 : 1.5880224704742432 step5:final Tue Apr 22 13:25:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1352591871: ('0.19124856033269796',), 1352591868: ('0.19124856033269796',), 1352591834: ('0.19124856033269796',), 1352591829: ('0.19124856033269796',), 1352591809: ('0.19124856033269796',), 1352591652: ('0.19124856033269796',), 1352591650: ('0.19124856033269796',), 1352591645: ('0.19124856033269796',)} new output for save of step final : {1352591871: ('0.19124856033269796',), 1352591868: ('0.19124856033269796',), 1352591834: ('0.19124856033269796',), 1352591829: ('0.19124856033269796',), 1352591809: ('0.19124856033269796',), 1352591652: ('0.19124856033269796',), 1352591650: ('0.19124856033269796',), 1352591645: ('0.19124856033269796',)} [1352591871, 1352591868, 1352591834, 1352591829, 1352591809, 1352591652, 1352591650, 1352591645] Looping around the photos to save general results len do output : 8 /1352591871.Didn't retrieve data . /1352591868.Didn't retrieve data . /1352591834.Didn't retrieve data . /1352591829.Didn't retrieve data . /1352591809.Didn't retrieve data . /1352591652.Didn't retrieve data . /1352591650.Didn't retrieve data . /1352591645.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591871', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591868', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591834', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591829', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591809', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591652', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591650', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591645', None, None, None, None, None, '2748458') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.012598991394042969 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1431291103363037 time spend to save output : 0.013049840927124023 total time spend for step 5 : 0.15617895126342773 step6:blur_detection Tue Apr 22 13:25:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c.jpg resize: (2160, 3264) 1352591871 -0.6220093881178226 treat image : temp/1745320827_3447823_1352591868_4c3ae3c8066d9ff818ecafdb89b3edd8.jpg resize: (2160, 3264) 1352591868 0.5777677087261339 treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d.jpg resize: (2160, 3264) 1352591834 -2.354672844214787 treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34.jpg resize: (2160, 3264) 1352591829 -2.1927105771337443 treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352.jpg resize: (2160, 3264) 1352591809 -6.384175469385055 treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836.jpg resize: (2160, 3264) 1352591652 -5.911824097064907 treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e.jpg resize: (2160, 3264) 1352591650 -3.8285573386614846 treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087.jpg resize: (2160, 3264) 1352591645 -0.8187219622236703 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974421_0.png resize: (1091, 704) 1352607874 -1.314093440737532 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974437_0.png resize: (152, 149) 1352607878 -2.1235245482269116 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974411_0.png resize: (127, 500) 1352607884 -2.3266105602539016 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974431_0.png resize: (272, 346) 1352607888 -1.3466067253793752 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974439_0.png resize: (220, 233) 1352607891 0.6036272707229917 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974432_0.png resize: (103, 162) 1352607897 -2.295446453931232 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974413_0.png resize: (121, 175) 1352607901 -1.115050091014145 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974436_0.png resize: (89, 106) 1352607906 0.41760342003506257 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974416_0.png resize: (103, 175) 1352607911 -1.4202434931311319 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974407_0.png resize: (251, 225) 1352607915 -0.249859239998843 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974435_0.png resize: (471, 485) 1352607919 -0.867460220478629 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974430_0.png resize: (205, 178) 1352607924 -0.6598606588644771 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974422_0.png resize: (262, 581) 1352607929 -0.9391382337391496 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974427_0.png resize: (276, 568) 1352607933 -1.1608390927545955 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974410_0.png resize: (178, 157) 1352607937 0.05059044794455131 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974425_0.png resize: (221, 194) 1352607942 0.0308646625260635 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974424_0.png resize: (149, 157) 1352607947 0.23672490347344696 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974429_0.png resize: (246, 189) 1352607951 1.587752409669938 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974419_0.png resize: (140, 155) 1352607956 -0.16407794411371876 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974438_0.png resize: (135, 218) 1352607961 -1.9078932233058277 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974434_0.png resize: (122, 146) 1352607965 -0.5273796516850787 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974428_0.png resize: (439, 420) 1352607970 -1.440859965194953 treat image : temp/1745320827_3447823_1352591868_4c3ae3c8066d9ff818ecafdb89b3edd8_rle_crop_3762974448_0.png resize: (142, 140) 1352607975 -1.8326293795855721 treat image : temp/1745320827_3447823_1352591868_4c3ae3c8066d9ff818ecafdb89b3edd8_rle_crop_3762974443_0.png resize: (485, 142) 1352607979 -2.9961995334363474 treat image : temp/1745320827_3447823_1352591868_4c3ae3c8066d9ff818ecafdb89b3edd8_rle_crop_3762974441_0.png resize: (210, 174) 1352607983 -1.634122449558067 treat image : temp/1745320827_3447823_1352591868_4c3ae3c8066d9ff818ecafdb89b3edd8_rle_crop_3762974450_0.png resize: (114, 108) 1352607988 -1.217711005531807 treat image : temp/1745320827_3447823_1352591868_4c3ae3c8066d9ff818ecafdb89b3edd8_rle_crop_3762974445_0.png resize: (113, 78) 1352607993 0.4662249112275762 treat image : temp/1745320827_3447823_1352591868_4c3ae3c8066d9ff818ecafdb89b3edd8_rle_crop_3762974442_0.png resize: (1110, 745) 1352607997 0.6865569262574276 treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974453_0.png resize: (152, 130) 1352608002 -1.983626635011125 treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974464_0.png resize: (595, 287) 1352608006 -1.1494152581819688 treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974457_0.png resize: (79, 217) 1352608010 -2.4021115600347454 treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974456_0.png resize: (124, 172) 1352608016 -1.9614188141335778 treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974451_0.png resize: (319, 298) 1352608020 -1.3683173492578125 treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974469_0.png resize: (258, 99) 1352608025 -2.091234555443119 treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974455_0.png resize: (454, 402) 1352608029 -2.718340266102147 treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974465_0.png resize: (169, 197) 1352608034 -1.0455299068830124 treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974459_0.png resize: (220, 283) 1352608038 -0.1673552409454497 treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974468_0.png resize: (182, 217) 1352608042 -3.2070286756825577 treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974452_0.png resize: (201, 119) 1352608045 -3.9240481894371544 treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974454_0.png resize: (205, 234) 1352608050 -1.2811859444179463 treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974461_0.png resize: (182, 348) 1352608057 -1.123093250140367 treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974480_0.png resize: (343, 299) 1352608062 -1.7398653515699118 treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974471_0.png resize: (179, 159) 1352608069 -1.3291592297344197 treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974486_0.png resize: (95, 94) 1352608073 0.7090930630641139 treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974483_0.png resize: (147, 126) 1352608077 -2.3834573480167385 treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974474_0.png resize: (183, 177) 1352608079 -0.9288878643601247 treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974473_0.png resize: (263, 201) 1352608080 -0.8241721845361262 treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974470_0.png resize: (155, 149) 1352608081 -0.9434518863551967 treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974476_0.png resize: (299, 146) 1352608082 -1.1534224780999474 treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974482_0.png resize: (293, 365) 1352608084 -1.2555612515397971 treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974478_0.png resize: (563, 270) 1352608085 -1.7829165123190391 treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974479_0.png resize: (85, 140) 1352608086 -0.66829814906699 treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974499_0.png resize: (152, 77) 1352608088 -2.7819943875329014 treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974496_0.png resize: (132, 70) 1352608089 -2.3394059358649524 treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974502_0.png resize: (144, 124) 1352608090 -2.3626235205218338 treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974494_0.png resize: (341, 140) 1352608092 -3.06035055066515 treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974492_0.png resize: (169, 194) 1352608093 -2.6036917456806217 treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974497_0.png resize: (137, 209) 1352608094 -2.7384119114914505 treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974495_0.png resize: (578, 738) 1352608095 -2.959088014996492 treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974504_0.png resize: (123, 136) 1352608097 -2.4516494328626286 treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974488_0.png resize: (279, 428) 1352608098 -4.875688376397737 treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974501_0.png resize: (212, 147) 1352608099 -4.519603082642656 treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974487_0.png resize: (107, 146) 1352608101 -1.7129165042552048 treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974503_0.png resize: (186, 201) 1352608103 -4.5645466186975625 treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974491_0.png resize: (122, 126) 1352608104 -3.1250951913800935 treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974498_0.png resize: (317, 358) 1352608105 -5.240727032005747 treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974506_0.png resize: (238, 296) 1352608107 -2.1529146727139743 treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974512_0.png resize: (304, 271) 1352608108 -2.8955559069069245 treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974507_0.png resize: (145, 190) 1352608109 0.5426265342801745 treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974517_0.png resize: (104, 150) 1352608110 -2.7213130134717245 treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974518_0.png resize: (107, 248) 1352608113 -0.36231606579919834 treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974520_0.png resize: (1179, 641) 1352608114 -4.724890278510902 treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974514_0.png resize: (299, 290) 1352608115 -3.7090794413221593 treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974505_0.png resize: (1152, 576) 1352608117 -3.9624389105857136 treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974511_0.png resize: (243, 350) 1352608118 -4.392930900683046 treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974515_0.png resize: (617, 529) 1352608119 -4.477049535101882 treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974519_0.png resize: (164, 253) 1352608121 -2.492194334171045 treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974530_0.png resize: (177, 118) 1352608122 -2.1143976806749394 treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974525_0.png resize: (96, 211) 1352608123 -2.075565609922453 treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974538_0.png resize: (208, 730) 1352608124 -2.5646116708899394 treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974521_0.png resize: (1158, 730) 1352608126 -3.3839670874053613 treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974522_0.png resize: (257, 188) 1352608127 -2.716637718509362 treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087_rle_crop_3762974539_0.png resize: (561, 257) 1352608129 -0.06989486285920357 treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087_rle_crop_3762974542_0.png resize: (446, 364) 1352608131 -0.7121827601323861 treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087_rle_crop_3762974549_0.png resize: (257, 116) 1352608132 -0.6739483442163975 treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087_rle_crop_3762974543_0.png resize: (376, 242) 1352608133 -1.3816826794704313 treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087_rle_crop_3762974541_0.png resize: (156, 248) 1352608134 -1.6763428388513621 treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087_rle_crop_3762974545_0.png resize: (130, 344) 1352608136 0.6954630791963214 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974408_0.png resize: (222, 150) 1352608164 -1.877057034617007 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974409_0.png resize: (189, 163) 1352608165 -1.8684751776220263 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974415_0.png resize: (878, 736) 1352608166 -0.9483311747500721 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974420_0.png resize: (417, 532) 1352608167 -2.199376996427697 treat image : temp/1745320827_3447823_1352591868_4c3ae3c8066d9ff818ecafdb89b3edd8_rle_crop_3762974444_0.png resize: (210, 255) 1352608168 -2.0370131779715672 treat image : temp/1745320827_3447823_1352591868_4c3ae3c8066d9ff818ecafdb89b3edd8_rle_crop_3762974447_0.png resize: (199, 347) 1352608169 -0.2389048960136139 treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974460_0.png resize: (132, 152) 1352608170 -1.471125637035627 treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974458_0.png resize: (207, 349) 1352608173 -2.101011661895137 treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974485_0.png resize: (113, 142) 1352608177 0.22582496597816804 treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974477_0.png resize: (120, 109) 1352608181 1.3424599381039208 treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974475_0.png resize: (124, 105) 1352608185 -1.4407243121583038 treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974472_0.png resize: (99, 154) 1352608189 0.15568470523364433 treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974484_0.png resize: (295, 332) 1352608193 -1.1808126002377233 treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974516_0.png resize: (217, 265) 1352608196 -3.54409584453206 treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974509_0.png resize: (264, 423) 1352608201 -2.238133868921087 treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974513_0.png resize: (985, 189) 1352608204 -3.6850669888961023 treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974528_0.png resize: (118, 258) 1352608208 -1.4157614171059902 treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974529_0.png resize: (472, 323) 1352608212 -2.277463258250754 treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974527_0.png resize: (153, 306) 1352608216 -2.062242857400646 treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974526_0.png resize: (103, 192) 1352608220 -1.521480975638387 treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974531_0.png resize: (827, 382) 1352608224 -1.8621564961162762 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974426_0.png resize: (512, 515) 1352608543 -0.021956145998458416 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974417_0.png resize: (242, 330) 1352608544 -1.4334314184419639 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974440_0.png resize: (94, 180) 1352608545 -1.5650566568286608 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974412_0.png resize: (402, 599) 1352608546 -1.180359066824306 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974433_0.png resize: (82, 166) 1352608547 -0.7165389780302422 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974414_0.png resize: (114, 163) 1352608548 -0.2975540426757369 treat image : temp/1745320827_3447823_1352591868_4c3ae3c8066d9ff818ecafdb89b3edd8_rle_crop_3762974446_0.png resize: (428, 665) 1352608549 -1.5562344502739238 treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974462_0.png resize: (331, 131) 1352608550 -1.1226672000465459 treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974467_0.png resize: (287, 214) 1352608551 -1.9118406382650779 treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974466_0.png resize: (314, 583) 1352608552 -2.308532534829588 treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974463_0.png resize: (589, 441) 1352608553 -2.4863268502621296 treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974489_0.png resize: (480, 519) 1352608554 -4.849998470004998 treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974490_0.png resize: (347, 305) 1352608555 -2.4781488973942842 treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974493_0.png resize: (567, 623) 1352608556 -4.1336699828333625 treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974500_0.png resize: (729, 441) 1352608557 -1.2751234053561324 treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974508_0.png resize: (291, 323) 1352608558 -4.9437416465820325 treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974510_0.png resize: (283, 264) 1352608559 -3.2159829060214697 treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974534_0.png resize: (307, 233) 1352608560 -1.5846519705609325 treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974524_0.png resize: (237, 380) 1352608561 -1.5212634077463845 treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974535_0.png resize: (273, 129) 1352608562 -2.967865825804607 treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974536_0.png resize: (131, 364) 1352608563 -1.897501964956744 treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974532_0.png resize: (189, 246) 1352608564 -2.742282146411892 treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974523_0.png resize: (347, 403) 1352608565 -1.5577622651352556 treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974533_0.png resize: (254, 234) 1352608566 -2.608716181679621 treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087_rle_crop_3762974546_0.png resize: (722, 1967) 1352608567 1.149615328258638 treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087_rle_crop_3762974548_0.png resize: (235, 249) 1352608568 -0.5827060803827863 treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087_rle_crop_3762974547_0.png resize: (497, 606) 1352608569 -1.4638493759416658 treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087_rle_crop_3762974540_0.png resize: (288, 721) 1352608570 0.4856785051772211 treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087_rle_crop_3762974544_0.png resize: (721, 524) 1352608571 -0.6007613303532399 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974418_0.png resize: (173, 308) 1352608583 0.8825853296858991 treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974423_0.png resize: (109, 302) 1352608584 -1.7317369370842095 treat image : temp/1745320827_3447823_1352591868_4c3ae3c8066d9ff818ecafdb89b3edd8_rle_crop_3762974449_0.png resize: (104, 121) 1352608585 -0.5218566275918481 treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974537_0.png resize: (200, 204) 1352608599 -1.4673875481154743 treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974481_0.png resize: (430, 338) 1352608630 -2.1434291076657357 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 151 time used for this insertion : 0.01720118522644043 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 151 time used for this insertion : 0.028623342514038086 save missing photos in datou_result : time spend for datou_step_exec : 35.2363383769989 time spend to save output : 0.05182194709777832 total time spend for step 6 : 35.28816032409668 step7:brightness Tue Apr 22 13:25:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c.jpg treat image : temp/1745320827_3447823_1352591868_4c3ae3c8066d9ff818ecafdb89b3edd8.jpg treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d.jpg treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34.jpg treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352.jpg treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836.jpg treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e.jpg treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087.jpg treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974421_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974437_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974411_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974431_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974439_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974432_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974413_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974436_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974416_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974407_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974435_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974430_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974422_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974427_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974410_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974425_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974424_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974429_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974419_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974438_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974434_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974428_0.png treat image : temp/1745320827_3447823_1352591868_4c3ae3c8066d9ff818ecafdb89b3edd8_rle_crop_3762974448_0.png treat image : temp/1745320827_3447823_1352591868_4c3ae3c8066d9ff818ecafdb89b3edd8_rle_crop_3762974443_0.png treat image : temp/1745320827_3447823_1352591868_4c3ae3c8066d9ff818ecafdb89b3edd8_rle_crop_3762974441_0.png treat image : temp/1745320827_3447823_1352591868_4c3ae3c8066d9ff818ecafdb89b3edd8_rle_crop_3762974450_0.png treat image : temp/1745320827_3447823_1352591868_4c3ae3c8066d9ff818ecafdb89b3edd8_rle_crop_3762974445_0.png treat image : temp/1745320827_3447823_1352591868_4c3ae3c8066d9ff818ecafdb89b3edd8_rle_crop_3762974442_0.png treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974453_0.png treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974464_0.png treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974457_0.png treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974456_0.png treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974451_0.png treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974469_0.png treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974455_0.png treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974465_0.png treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974459_0.png treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974468_0.png treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974452_0.png treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974454_0.png treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974461_0.png treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974480_0.png treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974471_0.png treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974486_0.png treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974483_0.png treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974474_0.png treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974473_0.png treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974470_0.png treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974476_0.png treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974482_0.png treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974478_0.png treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974479_0.png treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974499_0.png treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974496_0.png treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974502_0.png treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974494_0.png treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974492_0.png treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974497_0.png treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974495_0.png treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974504_0.png treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974488_0.png treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974501_0.png treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974487_0.png treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974503_0.png treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974491_0.png treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974498_0.png treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974506_0.png treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974512_0.png treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974507_0.png treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974517_0.png treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974518_0.png treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974520_0.png treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974514_0.png treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974505_0.png treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974511_0.png treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974515_0.png treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974519_0.png treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974530_0.png treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974525_0.png treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974538_0.png treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974521_0.png treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974522_0.png treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087_rle_crop_3762974539_0.png treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087_rle_crop_3762974542_0.png treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087_rle_crop_3762974549_0.png treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087_rle_crop_3762974543_0.png treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087_rle_crop_3762974541_0.png treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087_rle_crop_3762974545_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974408_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974409_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974415_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974420_0.png treat image : temp/1745320827_3447823_1352591868_4c3ae3c8066d9ff818ecafdb89b3edd8_rle_crop_3762974444_0.png treat image : temp/1745320827_3447823_1352591868_4c3ae3c8066d9ff818ecafdb89b3edd8_rle_crop_3762974447_0.png treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974460_0.png treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974458_0.png treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974485_0.png treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974477_0.png treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974475_0.png treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974472_0.png treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974484_0.png treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974516_0.png treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974509_0.png treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974513_0.png treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974528_0.png treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974529_0.png treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974527_0.png treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974526_0.png treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974531_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974426_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974417_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974440_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974412_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974433_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974414_0.png treat image : temp/1745320827_3447823_1352591868_4c3ae3c8066d9ff818ecafdb89b3edd8_rle_crop_3762974446_0.png treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974462_0.png treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974467_0.png treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974466_0.png treat image : temp/1745320827_3447823_1352591834_3ea87427c488c28f2ca83e23df8bf79d_rle_crop_3762974463_0.png treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974489_0.png treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974490_0.png treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974493_0.png treat image : temp/1745320827_3447823_1352591809_a7a2871cea59ca318718f82e49cb0352_rle_crop_3762974500_0.png treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974508_0.png treat image : temp/1745320827_3447823_1352591652_57d71b95135ae8b7bcdab99b400e3836_rle_crop_3762974510_0.png treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974534_0.png treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974524_0.png treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974535_0.png treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974536_0.png treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974532_0.png treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974523_0.png treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974533_0.png treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087_rle_crop_3762974546_0.png treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087_rle_crop_3762974548_0.png treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087_rle_crop_3762974547_0.png treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087_rle_crop_3762974540_0.png treat image : temp/1745320827_3447823_1352591645_173b85902c12ed630c8312dc034b9087_rle_crop_3762974544_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974418_0.png treat image : temp/1745320827_3447823_1352591871_8d9fec23b9e4d772784d70619173bd9c_rle_crop_3762974423_0.png treat image : temp/1745320827_3447823_1352591868_4c3ae3c8066d9ff818ecafdb89b3edd8_rle_crop_3762974449_0.png treat image : temp/1745320827_3447823_1352591650_8b29bb4d6035951ca0f8283a8fc4271e_rle_crop_3762974537_0.png treat image : temp/1745320827_3447823_1352591829_66d6f9e63e9f3d957fb3600777d97e34_rle_crop_3762974481_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 151 time used for this insertion : 0.01723003387451172 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 151 time used for this insertion : 0.028795719146728516 save missing photos in datou_result : time spend for datou_step_exec : 10.634958744049072 time spend to save output : 0.05157899856567383 total time spend for step 7 : 10.686537742614746 step8:velours_tree Tue Apr 22 13:26:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.38999509811401367 time spend to save output : 4.100799560546875e-05 total time spend for step 8 : 0.39003610610961914 step9:send_mail_cod Tue Apr 22 13:26:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22301301_22-04-2025_13_26_03.pdf 22301527 imagette223015271745321163 22301528 imagette223015281745321163 22301529 change filename to text .imagette223015291745321163 22301530 imagette223015301745321163 22301531 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette223015311745321163 22301532 change filename to text .imagette223015321745321164 22301533 change filename to text .change filename to text .change filename to text .imagette223015331745321166 22301534 imagette223015341745321166 22301535 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette223015351745321166 22301536 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette223015361745321167 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22301301 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22301526,22301527,22301528,22301529,22301530,22301531,22301532,22301533,22301534,22301535,22301536?tags=environnement,mal_croppe,flou,pet_fonce,metal,pet_clair,pehd,autre,background,papier,carton args[1352591871] : ((1352591871, -0.6220093881178226, 492688767), (1352591871, -0.079211669451836, 496442774), '0.19124856033269796') We are sending mail with results at report@fotonower.com args[1352591868] : ((1352591868, 0.5777677087261339, 492688767), (1352591868, -0.3705023075928708, 496442774), '0.19124856033269796') We are sending mail with results at report@fotonower.com args[1352591834] : ((1352591834, -2.354672844214787, 492609224), (1352591834, -0.0025983725433073785, 2107752395), '0.19124856033269796') We are sending mail with results at report@fotonower.com args[1352591829] : ((1352591829, -2.1927105771337443, 492609224), (1352591829, 0.1473778950901496, 2107752395), '0.19124856033269796') We are sending mail with results at report@fotonower.com args[1352591809] : ((1352591809, -6.384175469385055, 492609224), (1352591809, 0.06302766133538716, 2107752395), '0.19124856033269796') We are sending mail with results at report@fotonower.com args[1352591652] : ((1352591652, -5.911824097064907, 492609224), (1352591652, 0.15092854019716184, 2107752395), '0.19124856033269796') We are sending mail with results at report@fotonower.com args[1352591650] : ((1352591650, -3.8285573386614846, 492609224), (1352591650, -0.07663019926374984, 496442774), '0.19124856033269796') We are sending mail with results at report@fotonower.com args[1352591645] : ((1352591645, -0.8187219622236703, 492688767), (1352591645, 0.5058145104290735, 2107752395), '0.19124856033269796') We are sending mail with results at report@fotonower.com refus_total : 0.19124856033269796 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22301301 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22301301_22-04-2025_13_26_03.pdf results_Auto_P22301301_22-04-2025_13_26_03.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22301301_22-04-2025_13_26_03.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22301301','results_Auto_P22301301_22-04-2025_13_26_03.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22301301_22-04-2025_13_26_03.pdf','pdf','','0.88','0.19124856033269796') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22301301

https://www.fotonower.com/image?json=false&list_photos_id=1352591871
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352591868
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352591834
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352591829
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352591809
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352591652
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352591650
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352591645
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 19.12%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_fonce: https://www.fotonower.com/view/22301529?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22301531?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/22301532?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22301533?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22301535?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22301536?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22301301_22-04-2025_13_26_03.pdf.

Lien vers velours :https://www.fotonower.com/velours/22301526,22301527,22301528,22301529,22301530,22301531,22301532,22301533,22301534,22301535,22301536?tags=environnement,mal_croppe,flou,pet_fonce,metal,pet_clair,pehd,autre,background,papier,carton.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 22 Apr 2025 11:26:12 GMT Content-Length: 0 Connection: close X-Message-Id: iBiMfu1TS3Ckt0O8ZkfWxg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1352591871, 1352591868, 1352591834, 1352591829, 1352591809, 1352591652, 1352591650, 1352591645] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591871', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591868', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591834', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591829', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591809', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591652', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591650', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591645', None, None, None, None, None, '2748458') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.013686895370483398 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.910590887069702 time spend to save output : 0.013945341110229492 total time spend for step 9 : 9.924536228179932 step10:split_time_score Tue Apr 22 13:26:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('12', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 22042025 22301301 Nombre de photos uploadées : 8 / 23040 (0%) 22042025 22301301 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 22042025 22301301 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.4836273193359375e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.00045299530029296875 elapsed_time : insert_dashboard_record_day_entry 0.022395610809326172 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.18735182242022957 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22291089_22-04-2025_09_13_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22291089 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22291089 AND mptpi.`type`=3594 To do Qualite : 0.16072672703340596 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22291091_22-04-2025_08_46_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22291091 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22291091 AND mptpi.`type`=3594 To do Qualite : 0.15614805311592236 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22300539_22-04-2025_12_56_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22300539 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22300539 AND mptpi.`type`=3594 To do Qualite : 0.02838228396061263 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22300544_22-04-2025_13_11_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22300544 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22300544 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22301283 order by id desc limit 1 Qualite : 0.19124856033269796 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22301301_22-04-2025_13_26_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22301301 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22301301 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'22042025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1352591871, 1352591868, 1352591834, 1352591829, 1352591809, 1352591652, 1352591650, 1352591645] Looping around the photos to save general results len do output : 1 /22301301Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591871', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591868', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591834', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591829', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591809', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591652', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591650', None, None, None, None, None, '2748458') ('3318', None, None, None, None, None, None, None, '2748458') ('3318', '22301301', '1352591645', None, None, None, None, None, '2748458') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01335763931274414 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.3208413124084473 time spend to save output : 0.013681888580322266 total time spend for step 10 : 1.3345232009887695 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 160.19user 124.50system 5:50.09elapsed 81%CPU (0avgtext+0avgdata 5027984maxresident)k 902976inputs+122192outputs (21901major+14245044minor)pagefaults 0swaps