python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2917507 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2621675'] with mtr_portfolio_ids : ['20902989'] and first list_photo_ids : [] new path : /proc/2917507/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.8257246017456055 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Feb 28 04:30:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5083 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-28 04:30:32.278816: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-28 04:30:32.307072: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-28 04:30:32.309484: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f7a88000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-28 04:30:32.309545: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-28 04:30:32.313879: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-28 04:30:32.550677: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x12583390 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-28 04:30:32.550728: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-28 04:30:32.566353: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-28 04:30:32.566986: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-28 04:30:32.571346: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-28 04:30:32.583217: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-28 04:30:32.583660: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-28 04:30:32.602004: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-28 04:30:32.606661: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-28 04:30:32.633778: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-28 04:30:32.635190: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-28 04:30:32.635270: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-28 04:30:32.636006: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-28 04:30:32.636028: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-28 04:30:32.636040: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-28 04:30:32.637549: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4631 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-28 04:30:32.952692: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-28 04:30:32.952820: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-28 04:30:32.952841: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-28 04:30:32.952860: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-28 04:30:32.952878: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-28 04:30:32.952895: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-28 04:30:32.952912: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-28 04:30:32.952931: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-28 04:30:32.954065: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-28 04:30:32.955453: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-28 04:30:32.955497: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-28 04:30:32.955516: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-28 04:30:32.955533: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-28 04:30:32.955550: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-28 04:30:32.955569: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-28 04:30:32.955586: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-28 04:30:32.955604: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-28 04:30:32.956619: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-28 04:30:32.956662: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-28 04:30:32.956671: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-28 04:30:32.956679: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-28 04:30:32.957628: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4631 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-28 04:30:43.529005: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-28 04:30:43.709236: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-28 04:30:45.211178: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 73 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 64 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 62 Detection mask done ! Trying to reset tf kernel 2918285 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 202 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5083 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0018167495727539062 nb_pixel_total : 38265 time to create 1 rle with old method : 0.04235434532165527 length of segment : 303 time for calcul the mask position with numpy : 0.0003724098205566406 nb_pixel_total : 6777 time to create 1 rle with old method : 0.007745027542114258 length of segment : 105 time for calcul the mask position with numpy : 0.0015714168548583984 nb_pixel_total : 46105 time to create 1 rle with old method : 0.051336050033569336 length of segment : 311 time for calcul the mask position with numpy : 0.0007319450378417969 nb_pixel_total : 9577 time to create 1 rle with old method : 0.0110626220703125 length of segment : 274 time for calcul the mask position with numpy : 0.007558107376098633 nb_pixel_total : 124593 time to create 1 rle with old method : 0.1399984359741211 length of segment : 858 time for calcul the mask position with numpy : 0.004842996597290039 nb_pixel_total : 164264 time to create 1 rle with new method : 0.011504173278808594 length of segment : 768 time for calcul the mask position with numpy : 0.0012118816375732422 nb_pixel_total : 31724 time to create 1 rle with old method : 0.03551006317138672 length of segment : 331 time for calcul the mask position with numpy : 0.0002570152282714844 nb_pixel_total : 3937 time to create 1 rle with old method : 0.004658699035644531 length of segment : 109 time for calcul the mask position with numpy : 0.0048978328704833984 nb_pixel_total : 170372 time to create 1 rle with new method : 0.01151585578918457 length of segment : 902 time for calcul the mask position with numpy : 0.0008344650268554688 nb_pixel_total : 26337 time to create 1 rle with old method : 0.03245067596435547 length of segment : 201 time for calcul the mask position with numpy : 0.00604248046875 nb_pixel_total : 226331 time to create 1 rle with new method : 0.012057065963745117 length of segment : 497 time for calcul the mask position with numpy : 0.0022008419036865234 nb_pixel_total : 83082 time to create 1 rle with old method : 0.09153962135314941 length of segment : 255 time for calcul the mask position with numpy : 0.0004191398620605469 nb_pixel_total : 13497 time to create 1 rle with old method : 0.015799283981323242 length of segment : 143 time for calcul the mask position with numpy : 0.00045609474182128906 nb_pixel_total : 14914 time to create 1 rle with old method : 0.017670869827270508 length of segment : 191 time for calcul the mask position with numpy : 0.0007803440093994141 nb_pixel_total : 10994 time to create 1 rle with old method : 0.013149023056030273 length of segment : 208 time for calcul the mask position with numpy : 0.0023031234741210938 nb_pixel_total : 61854 time to create 1 rle with old method : 0.0708925724029541 length of segment : 644 time for calcul the mask position with numpy : 0.0042002201080322266 nb_pixel_total : 167417 time to create 1 rle with new method : 0.00919485092163086 length of segment : 453 time for calcul the mask position with numpy : 0.0008728504180908203 nb_pixel_total : 46274 time to create 1 rle with old method : 0.05662178993225098 length of segment : 371 time for calcul the mask position with numpy : 0.0019464492797851562 nb_pixel_total : 58553 time to create 1 rle with old method : 0.07711911201477051 length of segment : 402 time for calcul the mask position with numpy : 0.0010738372802734375 nb_pixel_total : 22861 time to create 1 rle with old method : 0.034116268157958984 length of segment : 200 time for calcul the mask position with numpy : 0.0010128021240234375 nb_pixel_total : 25536 time to create 1 rle with old method : 0.02981281280517578 length of segment : 212 time for calcul the mask position with numpy : 0.0009403228759765625 nb_pixel_total : 25487 time to create 1 rle with old method : 0.02954697608947754 length of segment : 193 time for calcul the mask position with numpy : 0.0012252330780029297 nb_pixel_total : 30790 time to create 1 rle with old method : 0.03549075126647949 length of segment : 249 time for calcul the mask position with numpy : 0.0017750263214111328 nb_pixel_total : 52234 time to create 1 rle with old method : 0.06087994575500488 length of segment : 329 time for calcul the mask position with numpy : 0.0022563934326171875 nb_pixel_total : 83402 time to create 1 rle with old method : 0.12044453620910645 length of segment : 137 time for calcul the mask position with numpy : 0.0004885196685791016 nb_pixel_total : 11922 time to create 1 rle with old method : 0.014640331268310547 length of segment : 75 time for calcul the mask position with numpy : 0.008049964904785156 nb_pixel_total : 182379 time to create 1 rle with new method : 0.01585841178894043 length of segment : 629 time for calcul the mask position with numpy : 0.004818439483642578 nb_pixel_total : 134664 time to create 1 rle with old method : 0.15190434455871582 length of segment : 532 time for calcul the mask position with numpy : 0.0026824474334716797 nb_pixel_total : 58814 time to create 1 rle with old method : 0.06589126586914062 length of segment : 766 time for calcul the mask position with numpy : 0.005189418792724609 nb_pixel_total : 183970 time to create 1 rle with new method : 0.009316444396972656 length of segment : 478 time for calcul the mask position with numpy : 0.004062652587890625 nb_pixel_total : 127346 time to create 1 rle with old method : 0.17255449295043945 length of segment : 466 time for calcul the mask position with numpy : 0.0016531944274902344 nb_pixel_total : 29602 time to create 1 rle with old method : 0.034384965896606445 length of segment : 481 time for calcul the mask position with numpy : 0.0005505084991455078 nb_pixel_total : 14104 time to create 1 rle with old method : 0.01658177375793457 length of segment : 140 time for calcul the mask position with numpy : 0.005244731903076172 nb_pixel_total : 201116 time to create 1 rle with new method : 0.009958744049072266 length of segment : 492 time for calcul the mask position with numpy : 0.0023267269134521484 nb_pixel_total : 86417 time to create 1 rle with old method : 0.09868049621582031 length of segment : 390 time for calcul the mask position with numpy : 0.0031774044036865234 nb_pixel_total : 84743 time to create 1 rle with old method : 0.10391902923583984 length of segment : 436 time for calcul the mask position with numpy : 0.0022025108337402344 nb_pixel_total : 83009 time to create 1 rle with old method : 0.09480142593383789 length of segment : 383 time for calcul the mask position with numpy : 0.0007112026214599609 nb_pixel_total : 22812 time to create 1 rle with old method : 0.026486873626708984 length of segment : 212 time for calcul the mask position with numpy : 0.0011208057403564453 nb_pixel_total : 46025 time to create 1 rle with old method : 0.052146196365356445 length of segment : 295 time for calcul the mask position with numpy : 0.00030231475830078125 nb_pixel_total : 4651 time to create 1 rle with old method : 0.005539894104003906 length of segment : 165 time for calcul the mask position with numpy : 0.0002913475036621094 nb_pixel_total : 11297 time to create 1 rle with old method : 0.013602495193481445 length of segment : 118 time for calcul the mask position with numpy : 0.0003972053527832031 nb_pixel_total : 11306 time to create 1 rle with old method : 0.013347148895263672 length of segment : 146 time for calcul the mask position with numpy : 0.0016067028045654297 nb_pixel_total : 84264 time to create 1 rle with old method : 0.09650015830993652 length of segment : 270 time for calcul the mask position with numpy : 0.0002460479736328125 nb_pixel_total : 4880 time to create 1 rle with old method : 0.005975008010864258 length of segment : 100 time for calcul the mask position with numpy : 0.0017490386962890625 nb_pixel_total : 74066 time to create 1 rle with old method : 0.0844581127166748 length of segment : 367 time for calcul the mask position with numpy : 0.0033016204833984375 nb_pixel_total : 95048 time to create 1 rle with old method : 0.11623454093933105 length of segment : 504 time for calcul the mask position with numpy : 0.0030570030212402344 nb_pixel_total : 100239 time to create 1 rle with old method : 0.11374878883361816 length of segment : 404 time for calcul the mask position with numpy : 0.0007929801940917969 nb_pixel_total : 16545 time to create 1 rle with old method : 0.01933741569519043 length of segment : 156 time for calcul the mask position with numpy : 0.0011456012725830078 nb_pixel_total : 26924 time to create 1 rle with old method : 0.031231403350830078 length of segment : 443 time for calcul the mask position with numpy : 0.00024199485778808594 nb_pixel_total : 3422 time to create 1 rle with old method : 0.0040552616119384766 length of segment : 60 time for calcul the mask position with numpy : 0.0014483928680419922 nb_pixel_total : 42816 time to create 1 rle with old method : 0.04961681365966797 length of segment : 249 time for calcul the mask position with numpy : 0.0036559104919433594 nb_pixel_total : 75044 time to create 1 rle with old method : 0.08485007286071777 length of segment : 666 time for calcul the mask position with numpy : 0.0011124610900878906 nb_pixel_total : 31877 time to create 1 rle with old method : 0.037034034729003906 length of segment : 214 time for calcul the mask position with numpy : 0.0044498443603515625 nb_pixel_total : 95070 time to create 1 rle with old method : 0.11508965492248535 length of segment : 513 time for calcul the mask position with numpy : 0.00043773651123046875 nb_pixel_total : 13190 time to create 1 rle with old method : 0.016051054000854492 length of segment : 93 time for calcul the mask position with numpy : 0.0008578300476074219 nb_pixel_total : 14716 time to create 1 rle with old method : 0.018114328384399414 length of segment : 198 time for calcul the mask position with numpy : 0.0019345283508300781 nb_pixel_total : 42574 time to create 1 rle with old method : 0.050853729248046875 length of segment : 186 time for calcul the mask position with numpy : 0.0007004737854003906 nb_pixel_total : 6536 time to create 1 rle with old method : 0.008003711700439453 length of segment : 195 time for calcul the mask position with numpy : 0.000308990478515625 nb_pixel_total : 17256 time to create 1 rle with old method : 0.020233154296875 length of segment : 147 time for calcul the mask position with numpy : 0.001451253890991211 nb_pixel_total : 64803 time to create 1 rle with old method : 0.07872962951660156 length of segment : 111 time for calcul the mask position with numpy : 0.0006077289581298828 nb_pixel_total : 18068 time to create 1 rle with old method : 0.02110743522644043 length of segment : 324 time for calcul the mask position with numpy : 0.0001456737518310547 nb_pixel_total : 6128 time to create 1 rle with old method : 0.007439613342285156 length of segment : 178 time for calcul the mask position with numpy : 0.0007622241973876953 nb_pixel_total : 34236 time to create 1 rle with old method : 0.03983759880065918 length of segment : 430 time for calcul the mask position with numpy : 0.0003712177276611328 nb_pixel_total : 6897 time to create 1 rle with old method : 0.011489629745483398 length of segment : 101 time for calcul the mask position with numpy : 0.0011601448059082031 nb_pixel_total : 27635 time to create 1 rle with old method : 0.03912782669067383 length of segment : 186 time for calcul the mask position with numpy : 0.0017690658569335938 nb_pixel_total : 91793 time to create 1 rle with old method : 0.10294842720031738 length of segment : 533 time for calcul the mask position with numpy : 0.0004315376281738281 nb_pixel_total : 19602 time to create 1 rle with old method : 0.023168087005615234 length of segment : 132 time for calcul the mask position with numpy : 0.01915764808654785 nb_pixel_total : 468029 time to create 1 rle with new method : 0.03879213333129883 length of segment : 835 time for calcul the mask position with numpy : 0.021075010299682617 nb_pixel_total : 276615 time to create 1 rle with new method : 0.04196763038635254 length of segment : 683 time for calcul the mask position with numpy : 0.003973484039306641 nb_pixel_total : 85602 time to create 1 rle with old method : 0.09756731986999512 length of segment : 381 time for calcul the mask position with numpy : 0.001482248306274414 nb_pixel_total : 28509 time to create 1 rle with old method : 0.033379316329956055 length of segment : 167 time for calcul the mask position with numpy : 0.005797863006591797 nb_pixel_total : 104274 time to create 1 rle with old method : 0.1191556453704834 length of segment : 521 time for calcul the mask position with numpy : 0.0035941600799560547 nb_pixel_total : 52725 time to create 1 rle with old method : 0.059240102767944336 length of segment : 389 time for calcul the mask position with numpy : 0.0008864402770996094 nb_pixel_total : 15914 time to create 1 rle with old method : 0.018805265426635742 length of segment : 183 time for calcul the mask position with numpy : 0.0009613037109375 nb_pixel_total : 13824 time to create 1 rle with old method : 0.01647639274597168 length of segment : 188 time for calcul the mask position with numpy : 0.00749516487121582 nb_pixel_total : 229642 time to create 1 rle with new method : 0.010885000228881836 length of segment : 453 time for calcul the mask position with numpy : 0.0010824203491210938 nb_pixel_total : 16854 time to create 1 rle with old method : 0.019830703735351562 length of segment : 202 time for calcul the mask position with numpy : 0.0050983428955078125 nb_pixel_total : 68019 time to create 1 rle with old method : 0.09343624114990234 length of segment : 498 time for calcul the mask position with numpy : 0.0031113624572753906 nb_pixel_total : 53203 time to create 1 rle with old method : 0.07632207870483398 length of segment : 286 time for calcul the mask position with numpy : 0.0013012886047363281 nb_pixel_total : 19199 time to create 1 rle with old method : 0.02364802360534668 length of segment : 155 time for calcul the mask position with numpy : 0.0018651485443115234 nb_pixel_total : 29783 time to create 1 rle with old method : 0.035300493240356445 length of segment : 222 time for calcul the mask position with numpy : 0.007849693298339844 nb_pixel_total : 127700 time to create 1 rle with old method : 0.15507841110229492 length of segment : 235 time for calcul the mask position with numpy : 0.0005321502685546875 nb_pixel_total : 7196 time to create 1 rle with old method : 0.008372306823730469 length of segment : 96 time for calcul the mask position with numpy : 0.0019965171813964844 nb_pixel_total : 42226 time to create 1 rle with old method : 0.04868769645690918 length of segment : 377 time for calcul the mask position with numpy : 0.001628875732421875 nb_pixel_total : 29211 time to create 1 rle with old method : 0.03445720672607422 length of segment : 272 time for calcul the mask position with numpy : 0.0014190673828125 nb_pixel_total : 21309 time to create 1 rle with old method : 0.0248415470123291 length of segment : 217 time for calcul the mask position with numpy : 0.0005290508270263672 nb_pixel_total : 10624 time to create 1 rle with old method : 0.012742757797241211 length of segment : 101 time for calcul the mask position with numpy : 0.0020685195922851562 nb_pixel_total : 52451 time to create 1 rle with old method : 0.05930209159851074 length of segment : 377 time for calcul the mask position with numpy : 0.0014955997467041016 nb_pixel_total : 49458 time to create 1 rle with old method : 0.0575556755065918 length of segment : 465 time for calcul the mask position with numpy : 0.0016624927520751953 nb_pixel_total : 32190 time to create 1 rle with old method : 0.036650896072387695 length of segment : 341 time for calcul the mask position with numpy : 0.0036530494689941406 nb_pixel_total : 96704 time to create 1 rle with old method : 0.11005282402038574 length of segment : 383 time for calcul the mask position with numpy : 0.0006597042083740234 nb_pixel_total : 16843 time to create 1 rle with old method : 0.019896507263183594 length of segment : 101 time for calcul the mask position with numpy : 0.004101276397705078 nb_pixel_total : 95084 time to create 1 rle with old method : 0.10749340057373047 length of segment : 392 time for calcul the mask position with numpy : 0.0005095005035400391 nb_pixel_total : 9047 time to create 1 rle with old method : 0.010764360427856445 length of segment : 110 time for calcul the mask position with numpy : 0.004377126693725586 nb_pixel_total : 111257 time to create 1 rle with old method : 0.12529993057250977 length of segment : 502 time for calcul the mask position with numpy : 0.0003020763397216797 nb_pixel_total : 10348 time to create 1 rle with old method : 0.01230764389038086 length of segment : 136 time for calcul the mask position with numpy : 0.00044536590576171875 nb_pixel_total : 6347 time to create 1 rle with old method : 0.0075283050537109375 length of segment : 120 time for calcul the mask position with numpy : 0.0011599063873291016 nb_pixel_total : 25384 time to create 1 rle with old method : 0.02960205078125 length of segment : 233 time for calcul the mask position with numpy : 0.0003132820129394531 nb_pixel_total : 12990 time to create 1 rle with old method : 0.015386104583740234 length of segment : 145 time for calcul the mask position with numpy : 0.00874185562133789 nb_pixel_total : 198236 time to create 1 rle with new method : 0.0314180850982666 length of segment : 877 time for calcul the mask position with numpy : 0.0009212493896484375 nb_pixel_total : 36665 time to create 1 rle with old method : 0.041213274002075195 length of segment : 324 time for calcul the mask position with numpy : 0.00049591064453125 nb_pixel_total : 10006 time to create 1 rle with old method : 0.011854887008666992 length of segment : 216 time for calcul the mask position with numpy : 0.0008969306945800781 nb_pixel_total : 18953 time to create 1 rle with old method : 0.02241349220275879 length of segment : 305 time for calcul the mask position with numpy : 0.002798318862915039 nb_pixel_total : 98623 time to create 1 rle with old method : 0.11439085006713867 length of segment : 298 time for calcul the mask position with numpy : 0.0009028911590576172 nb_pixel_total : 25507 time to create 1 rle with old method : 0.029433012008666992 length of segment : 238 time for calcul the mask position with numpy : 0.0006988048553466797 nb_pixel_total : 29349 time to create 1 rle with old method : 0.03385782241821289 length of segment : 343 time for calcul the mask position with numpy : 0.001001119613647461 nb_pixel_total : 21959 time to create 1 rle with old method : 0.02595043182373047 length of segment : 337 time for calcul the mask position with numpy : 0.0004010200500488281 nb_pixel_total : 8986 time to create 1 rle with old method : 0.011090517044067383 length of segment : 145 time for calcul the mask position with numpy : 0.004038095474243164 nb_pixel_total : 147499 time to create 1 rle with old method : 0.16936588287353516 length of segment : 462 time for calcul the mask position with numpy : 0.0008609294891357422 nb_pixel_total : 25248 time to create 1 rle with old method : 0.02937006950378418 length of segment : 244 time for calcul the mask position with numpy : 0.003167867660522461 nb_pixel_total : 42187 time to create 1 rle with old method : 0.04918050765991211 length of segment : 434 time for calcul the mask position with numpy : 0.0006387233734130859 nb_pixel_total : 13494 time to create 1 rle with old method : 0.01608109474182129 length of segment : 173 time for calcul the mask position with numpy : 0.0036344528198242188 nb_pixel_total : 50185 time to create 1 rle with old method : 0.05813312530517578 length of segment : 349 time for calcul the mask position with numpy : 0.0011510848999023438 nb_pixel_total : 22107 time to create 1 rle with old method : 0.025399446487426758 length of segment : 276 time for calcul the mask position with numpy : 0.0005316734313964844 nb_pixel_total : 9631 time to create 1 rle with old method : 0.011490106582641602 length of segment : 104 time for calcul the mask position with numpy : 0.010174751281738281 nb_pixel_total : 250443 time to create 1 rle with new method : 0.01536250114440918 length of segment : 590 time for calcul the mask position with numpy : 0.0009799003601074219 nb_pixel_total : 20577 time to create 1 rle with old method : 0.02409076690673828 length of segment : 177 time for calcul the mask position with numpy : 0.0013785362243652344 nb_pixel_total : 22631 time to create 1 rle with old method : 0.026196002960205078 length of segment : 240 time for calcul the mask position with numpy : 0.010493993759155273 nb_pixel_total : 125839 time to create 1 rle with old method : 0.14357233047485352 length of segment : 697 time for calcul the mask position with numpy : 0.0037686824798583984 nb_pixel_total : 137152 time to create 1 rle with old method : 0.17329049110412598 length of segment : 478 time for calcul the mask position with numpy : 0.0016362667083740234 nb_pixel_total : 38483 time to create 1 rle with old method : 0.045591115951538086 length of segment : 349 time for calcul the mask position with numpy : 0.0012748241424560547 nb_pixel_total : 26685 time to create 1 rle with old method : 0.030780553817749023 length of segment : 231 time for calcul the mask position with numpy : 0.0019998550415039062 nb_pixel_total : 46094 time to create 1 rle with old method : 0.05287456512451172 length of segment : 222 time for calcul the mask position with numpy : 0.0015523433685302734 nb_pixel_total : 17052 time to create 1 rle with old method : 0.019135475158691406 length of segment : 199 time for calcul the mask position with numpy : 0.0005588531494140625 nb_pixel_total : 9414 time to create 1 rle with old method : 0.011139392852783203 length of segment : 191 time for calcul the mask position with numpy : 0.0040740966796875 nb_pixel_total : 81301 time to create 1 rle with old method : 0.09362363815307617 length of segment : 313 time for calcul the mask position with numpy : 0.002397775650024414 nb_pixel_total : 56524 time to create 1 rle with old method : 0.06338310241699219 length of segment : 222 time for calcul the mask position with numpy : 0.0004584789276123047 nb_pixel_total : 15983 time to create 1 rle with old method : 0.01873326301574707 length of segment : 194 time for calcul the mask position with numpy : 0.00885152816772461 nb_pixel_total : 232634 time to create 1 rle with new method : 0.013592243194580078 length of segment : 483 time for calcul the mask position with numpy : 0.008595705032348633 nb_pixel_total : 154750 time to create 1 rle with new method : 0.012840032577514648 length of segment : 368 time for calcul the mask position with numpy : 0.004660129547119141 nb_pixel_total : 69556 time to create 1 rle with old method : 0.093505859375 length of segment : 273 time for calcul the mask position with numpy : 0.002330780029296875 nb_pixel_total : 57874 time to create 1 rle with old method : 0.06648015975952148 length of segment : 333 time for calcul the mask position with numpy : 0.006033897399902344 nb_pixel_total : 103248 time to create 1 rle with old method : 0.11799931526184082 length of segment : 514 time for calcul the mask position with numpy : 0.0009796619415283203 nb_pixel_total : 12750 time to create 1 rle with old method : 0.015059471130371094 length of segment : 217 time for calcul the mask position with numpy : 0.003307342529296875 nb_pixel_total : 90954 time to create 1 rle with old method : 0.10527348518371582 length of segment : 267 time for calcul the mask position with numpy : 0.0015671253204345703 nb_pixel_total : 27216 time to create 1 rle with old method : 0.030763864517211914 length of segment : 333 time for calcul the mask position with numpy : 0.0002346038818359375 nb_pixel_total : 4554 time to create 1 rle with old method : 0.0055084228515625 length of segment : 48 time for calcul the mask position with numpy : 0.0035200119018554688 nb_pixel_total : 92334 time to create 1 rle with old method : 0.10493850708007812 length of segment : 457 time for calcul the mask position with numpy : 0.00034427642822265625 nb_pixel_total : 5721 time to create 1 rle with old method : 0.0066072940826416016 length of segment : 75 time for calcul the mask position with numpy : 0.04704427719116211 nb_pixel_total : 767317 time to create 1 rle with new method : 0.5185501575469971 length of segment : 1536 time for calcul the mask position with numpy : 0.0025589466094970703 nb_pixel_total : 49960 time to create 1 rle with old method : 0.05702829360961914 length of segment : 324 time for calcul the mask position with numpy : 0.004452705383300781 nb_pixel_total : 104725 time to create 1 rle with old method : 0.11972975730895996 length of segment : 582 time for calcul the mask position with numpy : 0.0007722377777099609 nb_pixel_total : 28252 time to create 1 rle with old method : 0.03260445594787598 length of segment : 237 time for calcul the mask position with numpy : 0.0012927055358886719 nb_pixel_total : 48752 time to create 1 rle with old method : 0.05520129203796387 length of segment : 312 time for calcul the mask position with numpy : 0.00031304359436035156 nb_pixel_total : 4598 time to create 1 rle with old method : 0.0059549808502197266 length of segment : 146 time for calcul the mask position with numpy : 0.0006415843963623047 nb_pixel_total : 20051 time to create 1 rle with old method : 0.02719593048095703 length of segment : 221 time for calcul the mask position with numpy : 0.0001881122589111328 nb_pixel_total : 6165 time to create 1 rle with old method : 0.0073931217193603516 length of segment : 122 time for calcul the mask position with numpy : 0.0005040168762207031 nb_pixel_total : 20113 time to create 1 rle with old method : 0.02370309829711914 length of segment : 219 time for calcul the mask position with numpy : 0.005383729934692383 nb_pixel_total : 234981 time to create 1 rle with new method : 0.014133453369140625 length of segment : 819 time for calcul the mask position with numpy : 0.0029761791229248047 nb_pixel_total : 29775 time to create 1 rle with old method : 0.0338284969329834 length of segment : 300 time for calcul the mask position with numpy : 0.0006277561187744141 nb_pixel_total : 9294 time to create 1 rle with old method : 0.010831594467163086 length of segment : 116 time for calcul the mask position with numpy : 0.0031003952026367188 nb_pixel_total : 80967 time to create 1 rle with old method : 0.09331631660461426 length of segment : 478 time for calcul the mask position with numpy : 0.003384113311767578 nb_pixel_total : 73330 time to create 1 rle with old method : 0.1065983772277832 length of segment : 221 time for calcul the mask position with numpy : 0.0005209445953369141 nb_pixel_total : 4332 time to create 1 rle with old method : 0.005552053451538086 length of segment : 87 time for calcul the mask position with numpy : 0.0007207393646240234 nb_pixel_total : 21206 time to create 1 rle with old method : 0.024950742721557617 length of segment : 248 time for calcul the mask position with numpy : 0.0003311634063720703 nb_pixel_total : 4772 time to create 1 rle with old method : 0.005732536315917969 length of segment : 70 time for calcul the mask position with numpy : 0.0018682479858398438 nb_pixel_total : 30783 time to create 1 rle with old method : 0.03515172004699707 length of segment : 290 time for calcul the mask position with numpy : 0.00029349327087402344 nb_pixel_total : 7172 time to create 1 rle with old method : 0.00860142707824707 length of segment : 140 time for calcul the mask position with numpy : 0.01513528823852539 nb_pixel_total : 322505 time to create 1 rle with new method : 0.02470231056213379 length of segment : 845 time for calcul the mask position with numpy : 0.003727436065673828 nb_pixel_total : 99030 time to create 1 rle with old method : 0.11192607879638672 length of segment : 335 time for calcul the mask position with numpy : 0.0005817413330078125 nb_pixel_total : 14864 time to create 1 rle with old method : 0.016878366470336914 length of segment : 473 time for calcul the mask position with numpy : 0.0010974407196044922 nb_pixel_total : 24854 time to create 1 rle with old method : 0.02876591682434082 length of segment : 184 time for calcul the mask position with numpy : 0.0006685256958007812 nb_pixel_total : 9952 time to create 1 rle with old method : 0.011819601058959961 length of segment : 112 time for calcul the mask position with numpy : 0.001405954360961914 nb_pixel_total : 20908 time to create 1 rle with old method : 0.024646997451782227 length of segment : 200 time for calcul the mask position with numpy : 0.006056070327758789 nb_pixel_total : 123562 time to create 1 rle with old method : 0.13950800895690918 length of segment : 410 time for calcul the mask position with numpy : 0.0018846988677978516 nb_pixel_total : 21495 time to create 1 rle with old method : 0.02785515785217285 length of segment : 286 time for calcul the mask position with numpy : 0.00021028518676757812 nb_pixel_total : 5943 time to create 1 rle with old method : 0.007631540298461914 length of segment : 193 time for calcul the mask position with numpy : 0.011488199234008789 nb_pixel_total : 211992 time to create 1 rle with new method : 0.020833253860473633 length of segment : 471 time for calcul the mask position with numpy : 0.0007112026214599609 nb_pixel_total : 6961 time to create 1 rle with old method : 0.009836196899414062 length of segment : 114 time for calcul the mask position with numpy : 0.005746364593505859 nb_pixel_total : 92773 time to create 1 rle with old method : 0.12695550918579102 length of segment : 526 time for calcul the mask position with numpy : 0.0007429122924804688 nb_pixel_total : 2021 time to create 1 rle with old method : 0.003004789352416992 length of segment : 199 time for calcul the mask position with numpy : 0.0002646446228027344 nb_pixel_total : 6780 time to create 1 rle with old method : 0.008207321166992188 length of segment : 70 time for calcul the mask position with numpy : 0.002852201461791992 nb_pixel_total : 73076 time to create 1 rle with old method : 0.08355140686035156 length of segment : 311 time for calcul the mask position with numpy : 0.0005385875701904297 nb_pixel_total : 11253 time to create 1 rle with old method : 0.013417959213256836 length of segment : 116 time for calcul the mask position with numpy : 0.001373291015625 nb_pixel_total : 28189 time to create 1 rle with old method : 0.03275704383850098 length of segment : 240 time for calcul the mask position with numpy : 0.0031554698944091797 nb_pixel_total : 84245 time to create 1 rle with old method : 0.1201331615447998 length of segment : 772 time for calcul the mask position with numpy : 0.0003311634063720703 nb_pixel_total : 6850 time to create 1 rle with old method : 0.00792074203491211 length of segment : 108 time for calcul the mask position with numpy : 0.009238004684448242 nb_pixel_total : 190714 time to create 1 rle with new method : 0.011942625045776367 length of segment : 457 time for calcul the mask position with numpy : 0.012866497039794922 nb_pixel_total : 399177 time to create 1 rle with new method : 0.016067028045654297 length of segment : 734 time for calcul the mask position with numpy : 0.00016069412231445312 nb_pixel_total : 3591 time to create 1 rle with old method : 0.004400014877319336 length of segment : 54 time for calcul the mask position with numpy : 0.008333444595336914 nb_pixel_total : 303492 time to create 1 rle with new method : 0.010654211044311523 length of segment : 678 time spent for convertir_results : 17.743300676345825 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 181 chid ids of type : 3594 Number RLEs to save : 58328 save missing photos in datou_result : time spend for datou_step_exec : 79.61544156074524 time spend to save output : 4.336750030517578 total time spend for step 1 : 83.95219159126282 step2:crop_condition Fri Feb 28 04:31:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 181 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 109 About to insert : list_path_to_insert length 109 new photo from crops ! About to upload 109 photos upload in portfolio : 3736932 init cache_photo without model_param we have 109 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740713540_2917507 we have uploaded 109 photos in the portfolio 3736932 time of upload the photos Elapsed time : 32.10002374649048 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 37 About to insert : list_path_to_insert length 37 new photo from crops ! About to upload 37 photos upload in portfolio : 3736932 init cache_photo without model_param we have 37 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740713590_2917507 we have uploaded 37 photos in the portfolio 3736932 time of upload the photos Elapsed time : 11.708061695098877 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740713604_2917507 we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.5473170280456543 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3736932 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740713613_2917507 we have uploaded 11 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.456754684448242 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3736932 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740713621_2917507 we have uploaded 11 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.7370922565460205 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740713626_2917507 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8013148307800293 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740713630_2917507 we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.034071207046509 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1340015756, 1340015747, 1340015735, 1340005478, 1340005474, 1340005440, 1340005434, 1340005426] Looping around the photos to save general results len do output : 181 /1340061346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340061569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340015756', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340015747', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340015735', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005478', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005474', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005440', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005434', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005426', None, None, None, None, None, '2621675') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 551 time used for this insertion : 0.5637702941894531 save_final save missing photos in datou_result : time spend for datou_step_exec : 118.69247579574585 time spend to save output : 0.5688283443450928 total time spend for step 2 : 119.26130414009094 step3:rle_unique_nms_with_priority Fri Feb 28 04:33:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 181 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 5.597511053085327 time for calcul the mask position with numpy : 0.809537410736084 nb_pixel_total : 6086428 time to create 1 rle with new method : 0.6745691299438477 time for calcul the mask position with numpy : 0.02001047134399414 nb_pixel_total : 10994 time to create 1 rle with old method : 0.01272273063659668 time for calcul the mask position with numpy : 0.019980192184448242 nb_pixel_total : 7957 time to create 1 rle with old method : 0.008902311325073242 time for calcul the mask position with numpy : 0.019670724868774414 nb_pixel_total : 13497 time to create 1 rle with old method : 0.014657974243164062 time for calcul the mask position with numpy : 0.02041769027709961 nb_pixel_total : 83082 time to create 1 rle with old method : 0.0898735523223877 time for calcul the mask position with numpy : 0.020658254623413086 nb_pixel_total : 226331 time to create 1 rle with new method : 0.49446725845336914 time for calcul the mask position with numpy : 0.02156662940979004 nb_pixel_total : 26337 time to create 1 rle with old method : 0.028723955154418945 time for calcul the mask position with numpy : 0.021443605422973633 nb_pixel_total : 170372 time to create 1 rle with new method : 1.135329246520996 time for calcul the mask position with numpy : 0.021980762481689453 nb_pixel_total : 3937 time to create 1 rle with old method : 0.004522562026977539 time for calcul the mask position with numpy : 0.021096467971801758 nb_pixel_total : 31724 time to create 1 rle with old method : 0.03487110137939453 time for calcul the mask position with numpy : 0.02239680290222168 nb_pixel_total : 164264 time to create 1 rle with new method : 0.5781912803649902 time for calcul the mask position with numpy : 0.021863460540771484 nb_pixel_total : 124593 time to create 1 rle with old method : 0.13856029510498047 time for calcul the mask position with numpy : 0.02063465118408203 nb_pixel_total : 9577 time to create 1 rle with old method : 0.010512113571166992 time for calcul the mask position with numpy : 0.02055954933166504 nb_pixel_total : 46105 time to create 1 rle with old method : 0.04703259468078613 time for calcul the mask position with numpy : 0.01968979835510254 nb_pixel_total : 6777 time to create 1 rle with old method : 0.007122993469238281 time for calcul the mask position with numpy : 0.02059340476989746 nb_pixel_total : 38265 time to create 1 rle with old method : 0.04041600227355957 create new chi : 4.542161226272583 time to delete rle : 0.015299081802368164 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 12968 TO DO : save crop sub photo not yet done ! save time : 1.3494572639465332 nb_obj : 22 nb_hashtags : 4 time to prepare the origin masks : 9.685707092285156 time for calcul the mask position with numpy : 0.38136816024780273 nb_pixel_total : 5285592 time to create 1 rle with new method : 0.5952754020690918 time for calcul the mask position with numpy : 0.020619869232177734 nb_pixel_total : 76458 time to create 1 rle with old method : 0.08101081848144531 time for calcul the mask position with numpy : 0.020446062088012695 nb_pixel_total : 84743 time to create 1 rle with old method : 0.08847475051879883 time for calcul the mask position with numpy : 0.020117998123168945 nb_pixel_total : 86417 time to create 1 rle with old method : 0.08986997604370117 time for calcul the mask position with numpy : 0.020759105682373047 nb_pixel_total : 201116 time to create 1 rle with new method : 0.596235990524292 time for calcul the mask position with numpy : 0.022041797637939453 nb_pixel_total : 14104 time to create 1 rle with old method : 0.016560077667236328 time for calcul the mask position with numpy : 0.02064204216003418 nb_pixel_total : 29207 time to create 1 rle with old method : 0.03352928161621094 time for calcul the mask position with numpy : 0.021326065063476562 nb_pixel_total : 127346 time to create 1 rle with old method : 0.1426241397857666 time for calcul the mask position with numpy : 0.02224564552307129 nb_pixel_total : 183970 time to create 1 rle with new method : 0.5313713550567627 time for calcul the mask position with numpy : 0.02126598358154297 nb_pixel_total : 58814 time to create 1 rle with old method : 0.06445527076721191 time for calcul the mask position with numpy : 0.020982742309570312 nb_pixel_total : 134297 time to create 1 rle with old method : 0.1471412181854248 time for calcul the mask position with numpy : 0.021791696548461914 nb_pixel_total : 182379 time to create 1 rle with new method : 0.6330471038818359 time for calcul the mask position with numpy : 0.02130126953125 nb_pixel_total : 11922 time to create 1 rle with old method : 0.01325082778930664 time for calcul the mask position with numpy : 0.020916461944580078 nb_pixel_total : 83402 time to create 1 rle with old method : 0.0914618968963623 time for calcul the mask position with numpy : 0.020534753799438477 nb_pixel_total : 51792 time to create 1 rle with old method : 0.055989742279052734 time for calcul the mask position with numpy : 0.020377635955810547 nb_pixel_total : 30790 time to create 1 rle with old method : 0.03291749954223633 time for calcul the mask position with numpy : 0.02064990997314453 nb_pixel_total : 25396 time to create 1 rle with old method : 0.027681589126586914 time for calcul the mask position with numpy : 0.021076679229736328 nb_pixel_total : 25536 time to create 1 rle with old method : 0.027155637741088867 time for calcul the mask position with numpy : 0.019710540771484375 nb_pixel_total : 22861 time to create 1 rle with old method : 0.024584531784057617 time for calcul the mask position with numpy : 0.0201263427734375 nb_pixel_total : 58553 time to create 1 rle with old method : 0.06274580955505371 time for calcul the mask position with numpy : 0.019895315170288086 nb_pixel_total : 46274 time to create 1 rle with old method : 0.04921722412109375 time for calcul the mask position with numpy : 0.020780324935913086 nb_pixel_total : 167417 time to create 1 rle with new method : 0.6813530921936035 time for calcul the mask position with numpy : 0.021295785903930664 nb_pixel_total : 61854 time to create 1 rle with old method : 0.06817317008972168 create new chi : 5.121184349060059 time to delete rle : 0.0024161338806152344 batch 1 Loaded 45 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 18663 TO DO : save crop sub photo not yet done ! save time : 1.261293649673462 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 3.784986972808838 time for calcul the mask position with numpy : 0.8085110187530518 nb_pixel_total : 6790939 time to create 1 rle with new method : 1.3034870624542236 time for calcul the mask position with numpy : 0.022101640701293945 nb_pixel_total : 74066 time to create 1 rle with old method : 0.08586859703063965 time for calcul the mask position with numpy : 0.020689725875854492 nb_pixel_total : 4880 time to create 1 rle with old method : 0.009032487869262695 time for calcul the mask position with numpy : 0.024234533309936523 nb_pixel_total : 84264 time to create 1 rle with old method : 0.09765076637268066 time for calcul the mask position with numpy : 0.03417205810546875 nb_pixel_total : 11306 time to create 1 rle with old method : 0.012717723846435547 time for calcul the mask position with numpy : 0.03829765319824219 nb_pixel_total : 11297 time to create 1 rle with old method : 0.012655496597290039 time for calcul the mask position with numpy : 0.03352642059326172 nb_pixel_total : 4651 time to create 1 rle with old method : 0.006013631820678711 time for calcul the mask position with numpy : 0.03364109992980957 nb_pixel_total : 46025 time to create 1 rle with old method : 0.051514625549316406 time for calcul the mask position with numpy : 0.03654789924621582 nb_pixel_total : 22812 time to create 1 rle with old method : 0.05757784843444824 create new chi : 2.7327795028686523 time to delete rle : 0.0018057823181152344 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 5506 TO DO : save crop sub photo not yet done ! save time : 0.42328333854675293 nb_obj : 23 nb_hashtags : 5 time to prepare the origin masks : 9.7314612865448 time for calcul the mask position with numpy : 0.360271692276001 nb_pixel_total : 5768071 time to create 1 rle with new method : 0.7538175582885742 time for calcul the mask position with numpy : 0.04060649871826172 nb_pixel_total : 464738 time to create 1 rle with new method : 0.6381103992462158 time for calcul the mask position with numpy : 0.03695321083068848 nb_pixel_total : 19492 time to create 1 rle with old method : 0.02317333221435547 time for calcul the mask position with numpy : 0.03725433349609375 nb_pixel_total : 66110 time to create 1 rle with old method : 0.07472705841064453 time for calcul the mask position with numpy : 0.036036014556884766 nb_pixel_total : 27635 time to create 1 rle with old method : 0.031278371810913086 time for calcul the mask position with numpy : 0.03763628005981445 nb_pixel_total : 6897 time to create 1 rle with old method : 0.007867574691772461 time for calcul the mask position with numpy : 0.03543829917907715 nb_pixel_total : 34161 time to create 1 rle with old method : 0.03969717025756836 time for calcul the mask position with numpy : 0.036629438400268555 nb_pixel_total : 3233 time to create 1 rle with old method : 0.003983020782470703 time for calcul the mask position with numpy : 0.037532806396484375 nb_pixel_total : 18068 time to create 1 rle with old method : 0.02106642723083496 time for calcul the mask position with numpy : 0.034406423568725586 nb_pixel_total : 64803 time to create 1 rle with old method : 0.08204460144042969 time for calcul the mask position with numpy : 0.03712129592895508 nb_pixel_total : 14836 time to create 1 rle with old method : 0.01709437370300293 time for calcul the mask position with numpy : 0.035264015197753906 nb_pixel_total : 6536 time to create 1 rle with old method : 0.007987260818481445 time for calcul the mask position with numpy : 0.03633475303649902 nb_pixel_total : 42574 time to create 1 rle with old method : 0.050992727279663086 time for calcul the mask position with numpy : 0.022627830505371094 nb_pixel_total : 14716 time to create 1 rle with old method : 0.020992040634155273 time for calcul the mask position with numpy : 0.03445315361022949 nb_pixel_total : 13190 time to create 1 rle with old method : 0.016770362854003906 time for calcul the mask position with numpy : 0.03530144691467285 nb_pixel_total : 95070 time to create 1 rle with old method : 0.11148786544799805 time for calcul the mask position with numpy : 0.03398275375366211 nb_pixel_total : 30072 time to create 1 rle with old method : 0.033370018005371094 time for calcul the mask position with numpy : 0.034566640853881836 nb_pixel_total : 75044 time to create 1 rle with old method : 0.08683466911315918 time for calcul the mask position with numpy : 0.03505706787109375 nb_pixel_total : 42816 time to create 1 rle with old method : 0.04889321327209473 time for calcul the mask position with numpy : 0.04005074501037598 nb_pixel_total : 3422 time to create 1 rle with old method : 0.004091024398803711 time for calcul the mask position with numpy : 0.03351926803588867 nb_pixel_total : 26924 time to create 1 rle with old method : 0.030412673950195312 time for calcul the mask position with numpy : 0.03455066680908203 nb_pixel_total : 16545 time to create 1 rle with old method : 0.018377304077148438 time for calcul the mask position with numpy : 0.03504204750061035 nb_pixel_total : 100239 time to create 1 rle with old method : 0.12364625930786133 time for calcul the mask position with numpy : 0.03483128547668457 nb_pixel_total : 95048 time to create 1 rle with old method : 0.10843586921691895 create new chi : 3.6081900596618652 time to delete rle : 0.004095792770385742 batch 1 Loaded 47 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 15104 TO DO : save crop sub photo not yet done ! save time : 1.1640737056732178 nb_obj : 31 nb_hashtags : 6 time to prepare the origin masks : 4.440888404846191 time for calcul the mask position with numpy : 0.41268062591552734 nb_pixel_total : 5353651 time to create 1 rle with new method : 1.0209462642669678 time for calcul the mask position with numpy : 0.027338504791259766 nb_pixel_total : 32706 time to create 1 rle with old method : 0.03607368469238281 time for calcul the mask position with numpy : 0.028182506561279297 nb_pixel_total : 28509 time to create 1 rle with old method : 0.035053253173828125 time for calcul the mask position with numpy : 0.028250932693481445 nb_pixel_total : 29211 time to create 1 rle with old method : 0.03174304962158203 time for calcul the mask position with numpy : 0.027630090713500977 nb_pixel_total : 7196 time to create 1 rle with old method : 0.0078046321868896484 time for calcul the mask position with numpy : 0.02868795394897461 nb_pixel_total : 85602 time to create 1 rle with old method : 0.09163570404052734 time for calcul the mask position with numpy : 0.02899456024169922 nb_pixel_total : 276615 time to create 1 rle with new method : 0.645601749420166 time for calcul the mask position with numpy : 0.029368877410888672 nb_pixel_total : 104274 time to create 1 rle with old method : 0.12021875381469727 time for calcul the mask position with numpy : 0.02874898910522461 nb_pixel_total : 42226 time to create 1 rle with old method : 0.04716014862060547 time for calcul the mask position with numpy : 0.02837204933166504 nb_pixel_total : 229642 time to create 1 rle with new method : 0.46909356117248535 time for calcul the mask position with numpy : 0.027520179748535156 nb_pixel_total : 95084 time to create 1 rle with old method : 0.11185479164123535 time for calcul the mask position with numpy : 0.02809429168701172 nb_pixel_total : 52725 time to create 1 rle with old method : 0.05852198600769043 time for calcul the mask position with numpy : 0.02774357795715332 nb_pixel_total : 29783 time to create 1 rle with old method : 0.03407597541809082 time for calcul the mask position with numpy : 0.028487443923950195 nb_pixel_total : 53203 time to create 1 rle with old method : 0.05944252014160156 time for calcul the mask position with numpy : 0.027698993682861328 nb_pixel_total : 10624 time to create 1 rle with old method : 0.01160287857055664 time for calcul the mask position with numpy : 0.027939319610595703 nb_pixel_total : 6347 time to create 1 rle with old method : 0.007083415985107422 time for calcul the mask position with numpy : 0.028518199920654297 nb_pixel_total : 15914 time to create 1 rle with old method : 0.01847696304321289 time for calcul the mask position with numpy : 0.028385639190673828 nb_pixel_total : 12990 time to create 1 rle with old method : 0.014441728591918945 time for calcul the mask position with numpy : 0.027566909790039062 nb_pixel_total : 16854 time to create 1 rle with old method : 0.018613100051879883 time for calcul the mask position with numpy : 0.027474164962768555 nb_pixel_total : 32190 time to create 1 rle with old method : 0.0349736213684082 time for calcul the mask position with numpy : 0.027621984481811523 nb_pixel_total : 21309 time to create 1 rle with old method : 0.02286243438720703 time for calcul the mask position with numpy : 0.028565406799316406 nb_pixel_total : 96704 time to create 1 rle with old method : 0.10411572456359863 time for calcul the mask position with numpy : 0.028090238571166992 nb_pixel_total : 77963 time to create 1 rle with old method : 0.08354449272155762 time for calcul the mask position with numpy : 0.028311729431152344 nb_pixel_total : 68019 time to create 1 rle with old method : 0.07437849044799805 time for calcul the mask position with numpy : 0.027437210083007812 nb_pixel_total : 6451 time to create 1 rle with old method : 0.007219076156616211 time for calcul the mask position with numpy : 0.028211355209350586 nb_pixel_total : 13824 time to create 1 rle with old method : 0.015387296676635742 time for calcul the mask position with numpy : 0.028543472290039062 nb_pixel_total : 52451 time to create 1 rle with old method : 0.058807373046875 time for calcul the mask position with numpy : 0.028879880905151367 nb_pixel_total : 127700 time to create 1 rle with old method : 0.1487593650817871 time for calcul the mask position with numpy : 0.028774261474609375 nb_pixel_total : 25384 time to create 1 rle with old method : 0.029611587524414062 time for calcul the mask position with numpy : 0.029077768325805664 nb_pixel_total : 19199 time to create 1 rle with old method : 0.02190399169921875 time for calcul the mask position with numpy : 0.028659582138061523 nb_pixel_total : 9047 time to create 1 rle with old method : 0.009779214859008789 time for calcul the mask position with numpy : 0.02812790870666504 nb_pixel_total : 16843 time to create 1 rle with old method : 0.01830458641052246 create new chi : 4.835259199142456 time to delete rle : 0.0031430721282958984 batch 1 Loaded 63 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 19321 TO DO : save crop sub photo not yet done ! save time : 1.2996296882629395 nb_obj : 13 nb_hashtags : 4 time to prepare the origin masks : 5.719552516937256 time for calcul the mask position with numpy : 1.3040087223052979 nb_pixel_total : 6373528 time to create 1 rle with new method : 0.8861801624298096 time for calcul the mask position with numpy : 0.020340681076049805 nb_pixel_total : 13494 time to create 1 rle with old method : 0.014990806579589844 time for calcul the mask position with numpy : 0.020310163497924805 nb_pixel_total : 42187 time to create 1 rle with old method : 0.04570913314819336 time for calcul the mask position with numpy : 0.019708633422851562 nb_pixel_total : 25248 time to create 1 rle with old method : 0.026153564453125 time for calcul the mask position with numpy : 0.020903825759887695 nb_pixel_total : 147499 time to create 1 rle with old method : 0.15763354301452637 time for calcul the mask position with numpy : 0.02256035804748535 nb_pixel_total : 8986 time to create 1 rle with old method : 0.010437250137329102 time for calcul the mask position with numpy : 0.020473003387451172 nb_pixel_total : 21959 time to create 1 rle with old method : 0.02403879165649414 time for calcul the mask position with numpy : 0.020845413208007812 nb_pixel_total : 29349 time to create 1 rle with old method : 0.03180646896362305 time for calcul the mask position with numpy : 0.020638227462768555 nb_pixel_total : 25507 time to create 1 rle with old method : 0.028089284896850586 time for calcul the mask position with numpy : 0.020366191864013672 nb_pixel_total : 98623 time to create 1 rle with old method : 0.10512065887451172 time for calcul the mask position with numpy : 0.02142047882080078 nb_pixel_total : 18953 time to create 1 rle with old method : 0.020917177200317383 time for calcul the mask position with numpy : 0.02047133445739746 nb_pixel_total : 10006 time to create 1 rle with old method : 0.01087808609008789 time for calcul the mask position with numpy : 0.0214688777923584 nb_pixel_total : 36665 time to create 1 rle with old method : 0.03903317451477051 time for calcul the mask position with numpy : 0.022540569305419922 nb_pixel_total : 198236 time to create 1 rle with new method : 0.7466034889221191 create new chi : 3.7783849239349365 time to delete rle : 0.0015892982482910156 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 10952 TO DO : save crop sub photo not yet done ! save time : 0.7526366710662842 nb_obj : 37 nb_hashtags : 6 time to prepare the origin masks : 5.134305000305176 time for calcul the mask position with numpy : 0.5809857845306396 nb_pixel_total : 4040240 time to create 1 rle with new method : 0.5434920787811279 time for calcul the mask position with numpy : 0.02741098403930664 nb_pixel_total : 4554 time to create 1 rle with old method : 0.004878044128417969 time for calcul the mask position with numpy : 0.02640080451965332 nb_pixel_total : 9631 time to create 1 rle with old method : 0.010333061218261719 time for calcul the mask position with numpy : 0.026404380798339844 nb_pixel_total : 3021 time to create 1 rle with old method : 0.0032486915588378906 time for calcul the mask position with numpy : 0.027525663375854492 nb_pixel_total : 22631 time to create 1 rle with old method : 0.024924516677856445 time for calcul the mask position with numpy : 0.027875423431396484 nb_pixel_total : 24207 time to create 1 rle with old method : 0.02547144889831543 time for calcul the mask position with numpy : 0.02845621109008789 nb_pixel_total : 234981 time to create 1 rle with new method : 0.4955260753631592 time for calcul the mask position with numpy : 0.03236579895019531 nb_pixel_total : 125839 time to create 1 rle with old method : 0.14320850372314453 time for calcul the mask position with numpy : 0.029081106185913086 nb_pixel_total : 12750 time to create 1 rle with old method : 0.014835834503173828 time for calcul the mask position with numpy : 0.029212474822998047 nb_pixel_total : 17052 time to create 1 rle with old method : 0.019978761672973633 time for calcul the mask position with numpy : 0.02942347526550293 nb_pixel_total : 50185 time to create 1 rle with old method : 0.06406784057617188 time for calcul the mask position with numpy : 0.03471684455871582 nb_pixel_total : 767317 time to create 1 rle with new method : 0.6235983371734619 time for calcul the mask position with numpy : 0.02779388427734375 nb_pixel_total : 20577 time to create 1 rle with old method : 0.022150754928588867 time for calcul the mask position with numpy : 0.027990102767944336 nb_pixel_total : 7951 time to create 1 rle with old method : 0.008870840072631836 time for calcul the mask position with numpy : 0.027745485305786133 nb_pixel_total : 137152 time to create 1 rle with old method : 0.14414405822753906 time for calcul the mask position with numpy : 0.02777838706970215 nb_pixel_total : 38483 time to create 1 rle with old method : 0.041115522384643555 time for calcul the mask position with numpy : 0.027764558792114258 nb_pixel_total : 104725 time to create 1 rle with old method : 0.12093782424926758 time for calcul the mask position with numpy : 0.028954505920410156 nb_pixel_total : 48025 time to create 1 rle with old method : 0.0523982048034668 time for calcul the mask position with numpy : 0.02830052375793457 nb_pixel_total : 22107 time to create 1 rle with old method : 0.024153470993041992 time for calcul the mask position with numpy : 0.028026342391967773 nb_pixel_total : 90945 time to create 1 rle with old method : 0.10022783279418945 time for calcul the mask position with numpy : 0.028090953826904297 nb_pixel_total : 436 time to create 1 rle with old method : 0.0006434917449951172 time for calcul the mask position with numpy : 0.028510093688964844 nb_pixel_total : 20051 time to create 1 rle with old method : 0.021750450134277344 time for calcul the mask position with numpy : 0.028577566146850586 nb_pixel_total : 92334 time to create 1 rle with old method : 0.10581588745117188 time for calcul the mask position with numpy : 0.029560565948486328 nb_pixel_total : 250443 time to create 1 rle with new method : 0.44072914123535156 time for calcul the mask position with numpy : 0.027711153030395508 nb_pixel_total : 9414 time to create 1 rle with old method : 0.010724782943725586 time for calcul the mask position with numpy : 0.02821516990661621 nb_pixel_total : 57874 time to create 1 rle with old method : 0.0623774528503418 time for calcul the mask position with numpy : 0.027306079864501953 nb_pixel_total : 6165 time to create 1 rle with old method : 0.006846427917480469 time for calcul the mask position with numpy : 0.027679920196533203 nb_pixel_total : 26685 time to create 1 rle with old method : 0.028836965560913086 time for calcul the mask position with numpy : 0.028268098831176758 nb_pixel_total : 69556 time to create 1 rle with old method : 0.07513046264648438 time for calcul the mask position with numpy : 0.03202557563781738 nb_pixel_total : 46094 time to create 1 rle with old method : 0.06828713417053223 time for calcul the mask position with numpy : 0.027609825134277344 nb_pixel_total : 49960 time to create 1 rle with old method : 0.05515742301940918 time for calcul the mask position with numpy : 0.027469873428344727 nb_pixel_total : 103248 time to create 1 rle with old method : 0.11026430130004883 time for calcul the mask position with numpy : 0.02859663963317871 nb_pixel_total : 154750 time to create 1 rle with new method : 0.4691610336303711 time for calcul the mask position with numpy : 0.0269930362701416 nb_pixel_total : 232634 time to create 1 rle with new method : 0.5654740333557129 time for calcul the mask position with numpy : 0.02963852882385254 nb_pixel_total : 81301 time to create 1 rle with old method : 0.09032273292541504 time for calcul the mask position with numpy : 0.028066635131835938 nb_pixel_total : 4677 time to create 1 rle with old method : 0.0050504207611083984 time for calcul the mask position with numpy : 0.0276792049407959 nb_pixel_total : 56524 time to create 1 rle with old method : 0.06173062324523926 time for calcul the mask position with numpy : 0.028712749481201172 nb_pixel_total : 5721 time to create 1 rle with old method : 0.006620883941650391 create new chi : 6.458871841430664 time to delete rle : 0.003614187240600586 batch 1 Loaded 75 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 26707 TO DO : save crop sub photo not yet done ! save time : 1.8511078357696533 nb_obj : 32 nb_hashtags : 4 time to prepare the origin masks : 4.693125247955322 time for calcul the mask position with numpy : 0.16036200523376465 nb_pixel_total : 4732448 time to create 1 rle with new method : 0.847827672958374 time for calcul the mask position with numpy : 0.029746532440185547 nb_pixel_total : 190714 time to create 1 rle with new method : 0.591292142868042 time for calcul the mask position with numpy : 0.02786993980407715 nb_pixel_total : 21206 time to create 1 rle with old method : 0.024103403091430664 time for calcul the mask position with numpy : 0.02979874610900879 nb_pixel_total : 322505 time to create 1 rle with new method : 0.6294076442718506 time for calcul the mask position with numpy : 0.029244422912597656 nb_pixel_total : 7172 time to create 1 rle with old method : 0.008149862289428711 time for calcul the mask position with numpy : 0.02826213836669922 nb_pixel_total : 29775 time to create 1 rle with old method : 0.03355598449707031 time for calcul the mask position with numpy : 0.029117345809936523 nb_pixel_total : 80967 time to create 1 rle with old method : 0.09189152717590332 time for calcul the mask position with numpy : 0.027543306350708008 nb_pixel_total : 24854 time to create 1 rle with old method : 0.027684450149536133 time for calcul the mask position with numpy : 0.02821636199951172 nb_pixel_total : 84245 time to create 1 rle with old method : 0.09846758842468262 time for calcul the mask position with numpy : 0.029207229614257812 nb_pixel_total : 92773 time to create 1 rle with old method : 0.10305929183959961 time for calcul the mask position with numpy : 0.03473377227783203 nb_pixel_total : 73330 time to create 1 rle with old method : 0.07778453826904297 time for calcul the mask position with numpy : 0.026909589767456055 nb_pixel_total : 303490 time to create 1 rle with new method : 0.6161668300628662 time for calcul the mask position with numpy : 0.03737521171569824 nb_pixel_total : 14864 time to create 1 rle with old method : 0.027300119400024414 time for calcul the mask position with numpy : 0.03761649131774902 nb_pixel_total : 11253 time to create 1 rle with old method : 0.02071404457092285 time for calcul the mask position with numpy : 0.03887748718261719 nb_pixel_total : 99030 time to create 1 rle with old method : 0.18570971488952637 time for calcul the mask position with numpy : 0.03829240798950195 nb_pixel_total : 211992 time to create 1 rle with new method : 0.5145087242126465 time for calcul the mask position with numpy : 0.029202699661254883 nb_pixel_total : 20908 time to create 1 rle with old method : 0.02340388298034668 time for calcul the mask position with numpy : 0.029938220977783203 nb_pixel_total : 399177 time to create 1 rle with new method : 1.0277140140533447 time for calcul the mask position with numpy : 0.028017520904541016 nb_pixel_total : 73076 time to create 1 rle with old method : 0.08294272422790527 time for calcul the mask position with numpy : 0.027933359146118164 nb_pixel_total : 6961 time to create 1 rle with old method : 0.007823705673217773 time for calcul the mask position with numpy : 0.02824997901916504 nb_pixel_total : 2021 time to create 1 rle with old method : 0.003187417984008789 time for calcul the mask position with numpy : 0.02833247184753418 nb_pixel_total : 30783 time to create 1 rle with old method : 0.035867929458618164 time for calcul the mask position with numpy : 0.029198408126831055 nb_pixel_total : 28189 time to create 1 rle with old method : 0.03194260597229004 time for calcul the mask position with numpy : 0.02931356430053711 nb_pixel_total : 6850 time to create 1 rle with old method : 0.009369373321533203 time for calcul the mask position with numpy : 0.02938103675842285 nb_pixel_total : 123562 time to create 1 rle with old method : 0.1414182186126709 time for calcul the mask position with numpy : 0.032839298248291016 nb_pixel_total : 9952 time to create 1 rle with old method : 0.01621413230895996 time for calcul the mask position with numpy : 0.03277778625488281 nb_pixel_total : 4332 time to create 1 rle with old method : 0.004889011383056641 time for calcul the mask position with numpy : 0.0283205509185791 nb_pixel_total : 21495 time to create 1 rle with old method : 0.02430129051208496 time for calcul the mask position with numpy : 0.028980731964111328 nb_pixel_total : 9294 time to create 1 rle with old method : 0.010485172271728516 time for calcul the mask position with numpy : 0.02829885482788086 nb_pixel_total : 1171 time to create 1 rle with old method : 0.0014216899871826172 time for calcul the mask position with numpy : 0.028393030166625977 nb_pixel_total : 299 time to create 1 rle with old method : 0.0003883838653564453 time for calcul the mask position with numpy : 0.028229951858520508 nb_pixel_total : 4772 time to create 1 rle with old method : 0.005355119705200195 time for calcul the mask position with numpy : 0.027939796447753906 nb_pixel_total : 6780 time to create 1 rle with old method : 0.007394313812255859 create new chi : 6.615916967391968 time to delete rle : 0.003325939178466797 batch 1 Loaded 65 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 21496 TO DO : save crop sub photo not yet done ! save time : 1.6004581451416016 map_output_result : {1340015756: (0.0, 'Should be the crop_list due to order', 0), 1340015747: (0.0, 'Should be the crop_list due to order', 0), 1340015735: (0.0, 'Should be the crop_list due to order', 0), 1340005478: (0.0, 'Should be the crop_list due to order', 0), 1340005474: (0.0, 'Should be the crop_list due to order', 0), 1340005440: (0.0, 'Should be the crop_list due to order', 0), 1340005434: (0.0, 'Should be the crop_list due to order', 0), 1340005426: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1340015756, 1340015747, 1340015735, 1340005478, 1340005474, 1340005440, 1340005434, 1340005426] Looping around the photos to save general results len do output : 8 /1340015756.Didn't retrieve data . /1340015747.Didn't retrieve data . /1340015735.Didn't retrieve data . /1340005478.Didn't retrieve data . /1340005474.Didn't retrieve data . /1340005440.Didn't retrieve data . /1340005434.Didn't retrieve data . /1340005426.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340015756', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340015747', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340015735', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005478', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005474', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005440', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005434', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005426', None, None, None, None, None, '2621675') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.015928030014038086 save_final save missing photos in datou_result : time spend for datou_step_exec : 97.15718793869019 time spend to save output : 0.016333341598510742 total time spend for step 3 : 97.1735212802887 step4:ventilate_hashtags_in_portfolio Fri Feb 28 04:35:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20902989 get user id for portfolio 20902989 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20902989 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_fonce','metal','mal_croppe','carton','pet_clair','environnement','pehd','autre','flou','background')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20902989 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_fonce','metal','mal_croppe','carton','pet_clair','environnement','pehd','autre','flou','background')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20902989 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_fonce','metal','mal_croppe','carton','pet_clair','environnement','pehd','autre','flou','background')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/20908883,20908884,20908885,20908886,20908887,20908888,20908889,20908890,20908891,20908892,20908893?tags=papier,pet_fonce,metal,mal_croppe,carton,pet_clair,environnement,pehd,autre,flou,background Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1340015756, 1340015747, 1340015735, 1340005478, 1340005474, 1340005440, 1340005434, 1340005426] Looping around the photos to save general results len do output : 1 /20902989. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340015756', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340015747', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340015735', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005478', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005474', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005440', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005434', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005426', None, None, None, None, None, '2621675') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014900684356689453 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7428975105285645 time spend to save output : 0.015346288681030273 total time spend for step 4 : 1.7582437992095947 step5:final Fri Feb 28 04:35:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1340015756: ('0.21224495549087694',), 1340015747: ('0.21224495549087694',), 1340015735: ('0.21224495549087694',), 1340005478: ('0.21224495549087694',), 1340005474: ('0.21224495549087694',), 1340005440: ('0.21224495549087694',), 1340005434: ('0.21224495549087694',), 1340005426: ('0.21224495549087694',)} new output for save of step final : {1340015756: ('0.21224495549087694',), 1340015747: ('0.21224495549087694',), 1340015735: ('0.21224495549087694',), 1340005478: ('0.21224495549087694',), 1340005474: ('0.21224495549087694',), 1340005440: ('0.21224495549087694',), 1340005434: ('0.21224495549087694',), 1340005426: ('0.21224495549087694',)} [1340015756, 1340015747, 1340015735, 1340005478, 1340005474, 1340005440, 1340005434, 1340005426] Looping around the photos to save general results len do output : 8 /1340015756.Didn't retrieve data . /1340015747.Didn't retrieve data . /1340015735.Didn't retrieve data . /1340005478.Didn't retrieve data . /1340005474.Didn't retrieve data . /1340005440.Didn't retrieve data . /1340005434.Didn't retrieve data . /1340005426.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340015756', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340015747', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340015735', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005478', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005474', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005440', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005434', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005426', None, None, None, None, None, '2621675') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.015022039413452148 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11301350593566895 time spend to save output : 0.015518903732299805 total time spend for step 5 : 0.12853240966796875 step6:blur_detection Fri Feb 28 04:35:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a.jpg resize: (2160, 3264) 1340015756 -2.731464293644823 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47.jpg resize: (2160, 3264) 1340015747 -3.807294019684228 treat image : temp/1740713427_2917507_1340015735_1d6ea7f6a8fab41d34a752f98760c5b6.jpg resize: (2160, 3264) 1340015735 -1.2368956585154443 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382.jpg resize: (2160, 3264) 1340005478 -4.326476407947541 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291.jpg resize: (2160, 3264) 1340005474 -3.370797848662996 treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b.jpg resize: (2160, 3264) 1340005440 -4.199435664753825 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5.jpg resize: (2160, 3264) 1340005434 -4.796168276936969 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480.jpg resize: (2160, 3264) 1340005426 -4.2733864639416055 treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532405_0.png resize: (274, 211) 1340061346 -3.3900862269638954 treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532413_0.png resize: (893, 300) 1340061347 -1.754494335549281 treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532417_0.png resize: (142, 123) 1340061348 -3.0578094997624676 treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532410_0.png resize: (590, 451) 1340061349 -3.744491160079047 treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532411_0.png resize: (291, 182) 1340061350 -2.6613052420311 treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532407_0.png resize: (310, 196) 1340061351 -2.8537399127030127 treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532406_0.png resize: (105, 98) 1340061352 -3.449453704865521 treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532412_0.png resize: (106, 47) 1340061353 -3.3897879194038594 treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532418_0.png resize: (191, 126) 1340061354 -0.7120600369230754 treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532408_0.png resize: (201, 156) 1340061355 -2.6114210437455236 treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532419_0.png resize: (205, 137) 1340061356 -3.026740072607988 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532433_0.png resize: (644, 176) 1340061357 -1.580090515592443 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532436_0.png resize: (252, 215) 1340061358 -3.3296353816678947 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532421_0.png resize: (446, 523) 1340061359 -2.4215989691913387 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532432_0.png resize: (531, 450) 1340061360 -0.9074426218521493 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532425_0.png resize: (212, 203) 1340061361 -3.6018245949961427 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532422_0.png resize: (364, 189) 1340061362 -4.448872014517092 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532427_0.png resize: (245, 218) 1340061363 -1.9938530509256116 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532429_0.png resize: (136, 734) 1340061364 -2.8064104343841874 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532431_0.png resize: (629, 490) 1340061365 -2.939465142855242 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532430_0.png resize: (75, 214) 1340061366 -2.0463180951326856 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532428_0.png resize: (329, 245) 1340061367 -3.089257690862399 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532423_0.png resize: (395, 175) 1340061368 -2.975053988857452 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532426_0.png resize: (193, 183) 1340061369 -1.0657054876342982 treat image : temp/1740713427_2917507_1340015735_1d6ea7f6a8fab41d34a752f98760c5b6_rle_crop_3689532442_0.png resize: (170, 217) 1340061370 -2.565596574872579 treat image : temp/1740713427_2917507_1340015735_1d6ea7f6a8fab41d34a752f98760c5b6_rle_crop_3689532443_0.png resize: (295, 221) 1340061371 -0.485582162077885 treat image : temp/1740713427_2917507_1340015735_1d6ea7f6a8fab41d34a752f98760c5b6_rle_crop_3689532445_0.png resize: (116, 133) 1340061372 -1.139320066887128 treat image : temp/1740713427_2917507_1340015735_1d6ea7f6a8fab41d34a752f98760c5b6_rle_crop_3689532446_0.png resize: (146, 120) 1340061373 -2.2410354373331747 treat image : temp/1740713427_2917507_1340015735_1d6ea7f6a8fab41d34a752f98760c5b6_rle_crop_3689532447_0.png resize: (261, 388) 1340061374 -2.7893531195674157 treat image : temp/1740713427_2917507_1340015735_1d6ea7f6a8fab41d34a752f98760c5b6_rle_crop_3689532448_0.png resize: (99, 79) 1340061375 -2.1160839047814326 treat image : temp/1740713427_2917507_1340015735_1d6ea7f6a8fab41d34a752f98760c5b6_rle_crop_3689532444_0.png resize: (165, 44) 1340061376 -2.6037686254258663 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532468_0.png resize: (98, 102) 1340061377 -0.8812559176012225 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532472_0.png resize: (790, 993) 1340061378 -3.488392510716043 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532463_0.png resize: (144, 170) 1340061379 -3.5277621281812683 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532461_0.png resize: (174, 520) 1340061380 -2.353351246063669 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532465_0.png resize: (188, 126) 1340061381 -3.0856617255419314 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532452_0.png resize: (153, 189) 1340061382 -3.8905513310976 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532453_0.png resize: (241, 178) 1340061383 -3.430647794580202 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532451_0.png resize: (383, 378) 1340061384 -2.2869437378480626 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532458_0.png resize: (513, 443) 1340061385 -2.379191041346983 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532466_0.png resize: (124, 75) 1340061386 -2.6013251477652126 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532462_0.png resize: (195, 153) 1340061387 -2.8079524327818293 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532456_0.png resize: (666, 253) 1340061388 -1.3573438085151501 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532471_0.png resize: (123, 267) 1340061389 -3.658822006596366 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532455_0.png resize: (189, 358) 1340061390 -4.1765980634168 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532450_0.png resize: (504, 307) 1340061391 -2.848754564707031 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532454_0.png resize: (60, 86) 1340061392 -3.2607265352774326 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532457_0.png resize: (211, 288) 1340061393 -2.0125629039474746 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532476_0.png resize: (495, 293) 1340061394 -3.114420075674505 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532477_0.png resize: (385, 188) 1340061395 -0.5176572143393656 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532483_0.png resize: (286, 297) 1340061396 -1.8940127199763737 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532478_0.png resize: (182, 105) 1340061397 -0.8356276124517462 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532485_0.png resize: (205, 232) 1340061398 -3.5543597865393197 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532497_0.png resize: (385, 368) 1340061399 -1.2281595986765776 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532490_0.png resize: (209, 197) 1340061400 -2.9952858662644384 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532503_0.png resize: (145, 115) 1340061401 -2.9633607662606174 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532487_0.png resize: (96, 113) 1340061402 -3.1982888580206024 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532479_0.png resize: (187, 113) 1340061403 -2.8339953785762555 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532486_0.png resize: (234, 980) 1340061404 -1.8615787186427717 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532480_0.png resize: (395, 678) 1340061405 -0.41569943353066324 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532473_0.png resize: (683, 979) 1340061406 -2.514579354053323 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532494_0.png resize: (330, 135) 1340061407 -2.671660682819367 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532495_0.png resize: (326, 412) 1340061408 -2.0986876228599307 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532482_0.png resize: (302, 441) 1340061409 -2.5090143189909524 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532493_0.png resize: (260, 329) 1340061410 -2.6938500287769287 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532488_0.png resize: (351, 214) 1340061411 -2.964101849814624 treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532507_0.png resize: (233, 231) 1340061412 -3.40037914429744 treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532513_0.png resize: (462, 518) 1340061414 -1.9895586844112967 treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532514_0.png resize: (244, 206) 1340061415 -0.8693420493570705 treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532515_0.png resize: (469, 403) 1340061416 -1.4503360028149717 treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532511_0.png resize: (327, 108) 1340061417 -3.246924690064153 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532529_0.png resize: (189, 57) 1340061418 1.3458402872913147 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532518_0.png resize: (266, 98) 1340061419 -1.9372913880726348 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532528_0.png resize: (238, 174) 1340061420 -1.641462023042271 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532517_0.png resize: (304, 308) 1340061421 -2.4285006612427447 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532550_0.png resize: (165, 231) 1340061422 -3.5201883994287724 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532551_0.png resize: (107, 77) 1340061423 -3.869384955882547 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532526_0.png resize: (189, 190) 1340061424 -2.7399784110896737 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532525_0.png resize: (198, 317) 1340061425 -3.12586171527212 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532521_0.png resize: (177, 159) 1340061426 -4.2115534088831446 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532542_0.png resize: (453, 356) 1340061427 -4.282570151069052 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532532_0.png resize: (194, 170) 1340061428 -1.9312710270573283 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532548_0.png resize: (288, 258) 1340061429 -2.5213286697367834 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532543_0.png resize: (75, 104) 1340061431 -2.979470771349654 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532547_0.png resize: (215, 191) 1340061432 -2.219218637328429 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532533_0.png resize: (418, 842) 1340061433 -1.4720222203241402 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532538_0.png resize: (175, 130) 1340061434 -3.3423506676248573 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532574_0.png resize: (526, 303) 1340061435 -0.9157246605234303 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532554_0.png resize: (232, 237) 1340061436 -1.7678946621744351 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532559_0.png resize: (191, 186) 1340061437 -2.248221662426601 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532580_0.png resize: (472, 336) 1340061438 -3.3262655120456834 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532562_0.png resize: (140, 77) 1340061439 -1.5967171712823982 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532569_0.png resize: (408, 477) 1340061440 -4.193821004094923 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532565_0.png resize: (209, 139) 1340061441 -3.875061653011303 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532572_0.png resize: (469, 740) 1340061442 -0.9828770068840491 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532575_0.png resize: (152, 96) 1340061443 -4.061484694682305 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532567_0.png resize: (110, 141) 1340061444 -3.4871554936404183 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532577_0.png resize: (292, 333) 1340061445 -3.77339723129006 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532561_0.png resize: (276, 209) 1340061446 -3.406875256015144 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532570_0.png resize: (154, 266) 1340061447 -4.224611318015162 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532560_0.png resize: (67, 87) 1340061448 -1.7910059134515397 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532584_0.png resize: (51, 89) 1340061449 2.472834364427998 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532581_0.png resize: (108, 85) 1340061450 -3.230447996115097 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532576_0.png resize: (68, 129) 1340061451 -2.0363903990997407 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532571_0.png resize: (110, 79) 1340061452 -3.8792798417968326 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532555_0.png resize: (116, 108) 1340061453 -3.4998094496959506 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532579_0.png resize: (227, 176) 1340061454 -3.490103563508012 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532573_0.png resize: (112, 82) 1340061455 -2.9021616692833176 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532558_0.png resize: (87, 65) 1340061456 -1.1423088972278372 treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532409_0.png resize: (858, 396) 1340061482 -2.3307378870027597 treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532415_0.png resize: (491, 596) 1340061483 -1.8992578645795744 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532437_0.png resize: (135, 191) 1340061484 -2.232902743281312 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532424_0.png resize: (200, 177) 1340061485 -3.7861067897333522 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532434_0.png resize: (456, 540) 1340061486 -3.9665271658277814 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532440_0.png resize: (380, 432) 1340061488 -2.6033884875657614 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532459_0.png resize: (93, 273) 1340061489 -3.025816595631846 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532501_0.png resize: (115, 91) 1340061490 -2.8425319060915175 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532474_0.png resize: (321, 556) 1340061491 -2.0085934832728563 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532484_0.png resize: (142, 237) 1340061492 -2.080716222752529 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532499_0.png resize: (460, 416) 1340061493 -2.3767432749861848 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532489_0.png resize: (240, 254) 1340061494 -3.1847705470655163 treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532504_0.png resize: (802, 481) 1340061495 -2.358049636352959 treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532506_0.png resize: (196, 113) 1340061496 -3.6529383386608623 treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532505_0.png resize: (303, 181) 1340061497 -3.1969527572057816 treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532510_0.png resize: (278, 156) 1340061498 -4.327744883912072 treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532516_0.png resize: (145, 139) 1340061499 -2.358176217199697 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532552_0.png resize: (168, 228) 1340061500 -3.5523059148679463 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532539_0.png resize: (252, 461) 1340061501 -3.8558210712351664 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532531_0.png resize: (222, 417) 1340061502 -3.5572782425736627 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532536_0.png resize: (256, 298) 1340061503 -4.8205667938038514 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532520_0.png resize: (520, 632) 1340061504 -4.2772456291385685 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532530_0.png resize: (281, 507) 1340061505 -3.931003608995052 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532523_0.png resize: (683, 445) 1340061506 -1.7477613152008218 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532537_0.png resize: (464, 429) 1340061507 -3.739532125479141 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532522_0.png resize: (240, 185) 1340061508 -2.4254792678130275 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532553_0.png resize: (819, 453) 1340061509 -1.5179743129729713 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532544_0.png resize: (1160, 1057) 1340061510 -4.395906436868535 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532541_0.png resize: (44, 135) 1340061511 -3.1695475875166434 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532540_0.png resize: (231, 270) 1340061512 -4.229137214536607 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532519_0.png resize: (83, 186) 1340061513 -3.4918357889846936 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532549_0.png resize: (116, 150) 1340061514 -3.4388570685440105 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532563_0.png resize: (730, 626) 1340061515 -1.0829978653430317 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532564_0.png resize: (260, 619) 1340061516 -3.52487482422319 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532582_0.png resize: (405, 846) 1340061517 -0.7091889235352368 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532568_0.png resize: (198, 166) 1340061518 -2.9941664647633788 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532556_0.png resize: (349, 370) 1340061519 -2.890680393170685 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532496_0.png resize: (97, 208) 1340061521 -2.1628660114767135 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532498_0.png resize: (105, 141) 1340061522 -2.2068202864324205 treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532512_0.png resize: (105, 161) 1340061523 -3.1154845916146248 treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532509_0.png resize: (237, 139) 1340061524 -2.4917351880871084 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532527_0.png resize: (219, 284) 1340061525 -4.288598290253079 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532435_0.png resize: (456, 423) 1340061529 -2.748125817011092 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532441_0.png resize: (353, 405) 1340061530 -3.8984558442295656 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532470_0.png resize: (507, 223) 1340061531 -2.4850594928629137 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532492_0.png resize: (317, 214) 1340061532 -2.1556242833997326 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532502_0.png resize: (233, 136) 1340061534 -1.7565395812948694 treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532508_0.png resize: (232, 616) 1340061535 -2.4722478405584116 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532524_0.png resize: (415, 528) 1340061536 -2.871992681693777 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532583_0.png resize: (731, 649) 1340061537 -1.6577646649638622 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532566_0.png resize: (181, 199) 1340061538 -3.089734939358229 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532557_0.png resize: (213, 434) 1340061539 -3.3646489499185357 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532585_0.png resize: (669, 508) 1340061540 -2.5554906164407822 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532439_0.png resize: (390, 307) 1340061548 -3.3336762509067657 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532438_0.png resize: (492, 559) 1340061549 -3.3231774460164067 treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532420_0.png resize: (644, 254) 1340061550 -3.410210656817551 treat image : temp/1740713427_2917507_1340015735_1d6ea7f6a8fab41d34a752f98760c5b6_rle_crop_3689532449_0.png resize: (349, 300) 1340061551 -3.3838849624363223 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532464_0.png resize: (111, 675) 1340061552 -1.3384750025197412 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532460_0.png resize: (118, 302) 1340061553 -4.127638008616286 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532469_0.png resize: (176, 236) 1340061554 -2.3363685840153843 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532475_0.png resize: (165, 218) 1340061555 -1.041248086818861 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532481_0.png resize: (185, 129) 1340061556 -3.0587396337733828 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532491_0.png resize: (101, 120) 1340061557 -0.7095093175531414 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532546_0.png resize: (582, 331) 1340061558 -2.3647748242043884 treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532467_0.png resize: (331, 169) 1340061560 -4.136697791245156 treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532578_0.png resize: (116, 128) 1340061561 -3.053916903830888 treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532414_0.png resize: (197, 181) 1340061564 -2.482719227707214 treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532416_0.png resize: (236, 496) 1340061565 -2.581432261101923 treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532500_0.png resize: (121, 114) 1340061566 -2.390952205222592 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532534_0.png resize: (368, 646) 1340061567 -3.9312131744356678 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532535_0.png resize: (264, 397) 1340061568 -4.609787896291492 treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532545_0.png resize: (254, 471) 1340061569 -4.119815138570887 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 189 time used for this insertion : 0.03233933448791504 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 189 time used for this insertion : 0.10052156448364258 save missing photos in datou_result : time spend for datou_step_exec : 34.73100233078003 time spend to save output : 0.13972902297973633 total time spend for step 6 : 34.870731353759766 step7:brightness Fri Feb 28 04:36:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a.jpg treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47.jpg treat image : temp/1740713427_2917507_1340015735_1d6ea7f6a8fab41d34a752f98760c5b6.jpg treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382.jpg treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291.jpg treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b.jpg treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5.jpg treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480.jpg treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532405_0.png treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532413_0.png treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532417_0.png treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532410_0.png treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532411_0.png treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532407_0.png treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532406_0.png treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532412_0.png treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532418_0.png treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532408_0.png treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532419_0.png treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532433_0.png treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532436_0.png treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532421_0.png treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532432_0.png treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532425_0.png treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532422_0.png treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532427_0.png treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532429_0.png treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532431_0.png treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532430_0.png treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532428_0.png treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532423_0.png treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532426_0.png treat image : temp/1740713427_2917507_1340015735_1d6ea7f6a8fab41d34a752f98760c5b6_rle_crop_3689532442_0.png treat image : temp/1740713427_2917507_1340015735_1d6ea7f6a8fab41d34a752f98760c5b6_rle_crop_3689532443_0.png treat image : temp/1740713427_2917507_1340015735_1d6ea7f6a8fab41d34a752f98760c5b6_rle_crop_3689532445_0.png treat image : temp/1740713427_2917507_1340015735_1d6ea7f6a8fab41d34a752f98760c5b6_rle_crop_3689532446_0.png treat image : temp/1740713427_2917507_1340015735_1d6ea7f6a8fab41d34a752f98760c5b6_rle_crop_3689532447_0.png treat image : temp/1740713427_2917507_1340015735_1d6ea7f6a8fab41d34a752f98760c5b6_rle_crop_3689532448_0.png treat image : temp/1740713427_2917507_1340015735_1d6ea7f6a8fab41d34a752f98760c5b6_rle_crop_3689532444_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532468_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532472_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532463_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532461_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532465_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532452_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532453_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532451_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532458_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532466_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532462_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532456_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532471_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532455_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532450_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532454_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532457_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532476_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532477_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532483_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532478_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532485_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532497_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532490_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532503_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532487_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532479_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532486_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532480_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532473_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532494_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532495_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532482_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532493_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532488_0.png treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532507_0.png treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532513_0.png treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532514_0.png treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532515_0.png treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532511_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532529_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532518_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532528_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532517_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532550_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532551_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532526_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532525_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532521_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532542_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532532_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532548_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532543_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532547_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532533_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532538_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532574_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532554_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532559_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532580_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532562_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532569_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532565_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532572_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532575_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532567_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532577_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532561_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532570_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532560_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532584_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532581_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532576_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532571_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532555_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532579_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532573_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532558_0.png treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532409_0.png treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532415_0.png treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532437_0.png treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532424_0.png treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532434_0.png treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532440_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532459_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532501_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532474_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532484_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532499_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532489_0.png treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532504_0.png treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532506_0.png treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532505_0.png treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532510_0.png treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532516_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532552_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532539_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532531_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532536_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532520_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532530_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532523_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532537_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532522_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532553_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532544_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532541_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532540_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532519_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532549_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532563_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532564_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532582_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532568_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532556_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532496_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532498_0.png treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532512_0.png treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532509_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532527_0.png treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532435_0.png treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532441_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532470_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532492_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532502_0.png treat image : temp/1740713427_2917507_1340005440_9de21b750adec8fa59a5f472e1cf5f9b_rle_crop_3689532508_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532524_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532583_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532566_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532557_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532585_0.png treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532439_0.png treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532438_0.png treat image : temp/1740713427_2917507_1340015747_ad07e870c8c7760cad6f4365f988db47_rle_crop_3689532420_0.png treat image : temp/1740713427_2917507_1340015735_1d6ea7f6a8fab41d34a752f98760c5b6_rle_crop_3689532449_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532464_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532460_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532469_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532475_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532481_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532491_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532546_0.png treat image : temp/1740713427_2917507_1340005478_197fdd1925e5873bc419e37f32c3f382_rle_crop_3689532467_0.png treat image : temp/1740713427_2917507_1340005426_1c00f0f83f024188e7cd179fe0022480_rle_crop_3689532578_0.png treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532414_0.png treat image : temp/1740713427_2917507_1340015756_c03c45b38dd62f1900b25c38d43b589a_rle_crop_3689532416_0.png treat image : temp/1740713427_2917507_1340005474_51b9daf1a69c1fc9420a9d090b7c2291_rle_crop_3689532500_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532534_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532535_0.png treat image : temp/1740713427_2917507_1340005434_e6bb36a18ab5d2810d5e8a318fea79a5_rle_crop_3689532545_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 189 time used for this insertion : 0.024000883102416992 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 189 time used for this insertion : 0.29157423973083496 save missing photos in datou_result : time spend for datou_step_exec : 8.765939474105835 time spend to save output : 0.32105422019958496 total time spend for step 7 : 9.08699369430542 step8:velours_tree Fri Feb 28 04:36:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.26708436012268066 time spend to save output : 5.1975250244140625e-05 total time spend for step 8 : 0.2671363353729248 step9:send_mail_cod Fri Feb 28 04:36:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P20902989_28-02-2025_04_36_15.pdf 20908883 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209088831740713775 20908884 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209088841740713776 20908885 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209088851740713777 20908886 imagette209088861740713777 20908887 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209088871740713777 20908888 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209088881740713779 20908890 change filename to text .change filename to text .imagette209088901740713780 20908891 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209088911740713780 20908892 imagette209088921740713781 20908893 imagette209088931740713781 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20902989 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20908883,20908884,20908885,20908886,20908887,20908888,20908889,20908890,20908891,20908892,20908893?tags=papier,pet_fonce,metal,mal_croppe,carton,pet_clair,environnement,pehd,autre,flou,background args[1340015756] : ((1340015756, -2.731464293644823, 492609224), (1340015756, -0.4532212958291802, 496442774), '0.21224495549087694') We are sending mail with results at report@fotonower.com args[1340015747] : ((1340015747, -3.807294019684228, 492609224), (1340015747, -0.12431218698681175, 496442774), '0.21224495549087694') We are sending mail with results at report@fotonower.com args[1340015735] : ((1340015735, -1.2368956585154443, 492688767), (1340015735, -0.21952757705062712, 496442774), '0.21224495549087694') We are sending mail with results at report@fotonower.com args[1340005478] : ((1340005478, -4.326476407947541, 492609224), (1340005478, 0.0757947273891308, 2107752395), '0.21224495549087694') We are sending mail with results at report@fotonower.com args[1340005474] : ((1340005474, -3.370797848662996, 492609224), (1340005474, -0.29992207166260065, 496442774), '0.21224495549087694') We are sending mail with results at report@fotonower.com args[1340005440] : ((1340005440, -4.199435664753825, 492609224), (1340005440, 0.013392514689173771, 2107752395), '0.21224495549087694') We are sending mail with results at report@fotonower.com args[1340005434] : ((1340005434, -4.796168276936969, 492609224), (1340005434, -0.5038671263113184, 501862349), '0.21224495549087694') We are sending mail with results at report@fotonower.com args[1340005426] : ((1340005426, -4.2733864639416055, 492609224), (1340005426, -0.0780554262136454, 496442774), '0.21224495549087694') We are sending mail with results at report@fotonower.com refus_total : 0.21224495549087694 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20902989 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1340005434,1340005440,1340005474,1340005478,1340015756,1340005426,1340015735,1340015747) Found this number of photos: 8 begin to download photo : 1340005434 begin to download photo : 1340005474 begin to download photo : 1340015756 begin to download photo : 1340015735 download finish for photo 1340015756 begin to download photo : 1340005426 download finish for photo 1340015735 begin to download photo : 1340015747 download finish for photo 1340005474 begin to download photo : 1340005478 download finish for photo 1340005434 begin to download photo : 1340005440 download finish for photo 1340015747 download finish for photo 1340005426 download finish for photo 1340005478 download finish for photo 1340005440 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20902989_28-02-2025_04_36_15.pdf results_Auto_P20902989_28-02-2025_04_36_15.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20902989_28-02-2025_04_36_15.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','20902989','results_Auto_P20902989_28-02-2025_04_36_15.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20902989_28-02-2025_04_36_15.pdf','pdf','','1.07','0.21224495549087694') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/20902989

https://www.fotonower.com/image?json=false&list_photos_id=1340015756
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1340015747
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1340015735
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1340005478
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1340005474
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1340005440
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1340005434
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1340005426
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 21.22%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/20908883?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/20908884?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/20908885?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/20908887?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/20908888?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/20908890?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/20908891?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20902989_28-02-2025_04_36_15.pdf.

Lien vers velours :https://www.fotonower.com/velours/20908883,20908884,20908885,20908886,20908887,20908888,20908889,20908890,20908891,20908892,20908893?tags=papier,pet_fonce,metal,mal_croppe,carton,pet_clair,environnement,pehd,autre,flou,background.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 28 Feb 2025 03:36:24 GMT Content-Length: 0 Connection: close X-Message-Id: zI_F0dxgRaSEx43gPT_KaA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1340015756, 1340015747, 1340015735, 1340005478, 1340005474, 1340005440, 1340005434, 1340005426] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340015756', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340015747', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340015735', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005478', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005474', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005440', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005434', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005426', None, None, None, None, None, '2621675') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.016693115234375 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.097206830978394 time spend to save output : 0.01699519157409668 total time spend for step 9 : 9.11420202255249 step10:split_time_score Fri Feb 28 04:36:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('08', 5), ('09', 3)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 27022025 20902989 Nombre de photos uploadées : 8 / 23040 (0%) 27022025 20902989 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 27022025 20902989 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 2.86102294921875e-06 elapsed_time : order_list_meta_photo_and_scores 6.198883056640625e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0005414485931396484 elapsed_time : insert_dashboard_record_day_entry 0.028836965560913086 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.09945970404899608 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20905767_28-02-2025_03_29_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20905767 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20905767 AND mptpi.`type`=3726 To do Qualite : 0.21224495549087694 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20902989_28-02-2025_04_36_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20902989 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20902989 AND mptpi.`type`=3594 To do Qualite : 0.0662392077948395 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20905796_28-02-2025_03_23_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20905796 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20905796 AND mptpi.`type`=3726 To do Qualite : 0.191975621870083 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20901279_28-02-2025_03_04_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20901279 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20901279 AND mptpi.`type`=3594 To do Qualite : 0.18062130587831837 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20901768_28-02-2025_03_57_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20901768 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20901768 AND mptpi.`type`=3594 To do Qualite : 0.1199733468175425 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20901284_28-02-2025_01_54_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20901284 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20901284 AND mptpi.`type`=3726 To do Qualite : 0.16412012537548684 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20901286_28-02-2025_02_31_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20901286 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20901286 AND mptpi.`type`=3594 To do Qualite : 0.21264894399468545 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20901288_28-02-2025_02_10_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20901288 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20901288 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'27022025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1340015756, 1340015747, 1340015735, 1340005478, 1340005474, 1340005440, 1340005434, 1340005426] Looping around the photos to save general results len do output : 1 /20902989Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340015756', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340015747', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340015735', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005478', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005474', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005440', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005434', None, None, None, None, None, '2621675') ('3318', None, None, None, None, None, None, None, '2621675') ('3318', '20902989', '1340005426', None, None, None, None, None, '2621675') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014646768569946289 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.6743066310882568 time spend to save output : 0.014868021011352539 total time spend for step 10 : 0.6891746520996094 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 180.44user 109.81system 6:00.88elapsed 80%CPU (0avgtext+0avgdata 6089448maxresident)k 493592inputs+173256outputs (5001major+15535768minor)pagefaults 0swaps