python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1371448 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2883783'] with mtr_portfolio_ids : ['23079435'] and first list_photo_ids : [] new path : /proc/1371448/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFB[Errno 104] Connection reset by peer can't download the photo : 1359027761 complete_path : /home/admin/workarea/git/Velours/python/temp/1747417229_1371448_1359027761_6cdc988c2a663ecd89309177eb95f680.jpg Fwe have missing 1 photos in the step downloads : photo missing : [1359027761] try to delete the photos missing in DB Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1359027761 length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 2.0031697750091553 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri May 16 19:40:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-16 19:40:34.165087: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-16 19:40:34.191265: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-16 19:40:34.192649: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f4da4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-16 19:40:34.192702: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-16 19:40:34.195304: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-16 19:40:34.306912: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x208dd8b0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-16 19:40:34.306974: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-16 19:40:34.308253: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-16 19:40:34.308696: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 19:40:34.311863: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 19:40:34.314847: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-16 19:40:34.315376: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-16 19:40:34.318319: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-16 19:40:34.319681: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-16 19:40:34.325273: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-16 19:40:34.327295: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-16 19:40:34.327382: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 19:40:34.328297: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-16 19:40:34.328314: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-16 19:40:34.328323: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-16 19:40:34.329638: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9879 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-16 19:40:34.591509: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-16 19:40:34.591646: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 19:40:34.591692: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 19:40:34.591733: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-16 19:40:34.591773: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-16 19:40:34.591814: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-16 19:40:34.591853: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-16 19:40:34.591893: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-16 19:40:34.593676: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-16 19:40:34.595040: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-16 19:40:34.595101: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 19:40:34.595125: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 19:40:34.595145: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-16 19:40:34.595160: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-16 19:40:34.595174: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-16 19:40:34.595188: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-16 19:40:34.595202: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-16 19:40:34.596525: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-16 19:40:34.596555: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-16 19:40:34.596565: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-16 19:40:34.596573: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-16 19:40:34.597909: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9879 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-16 19:40:45.478724: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 19:40:45.729273: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 42 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 46 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas sNone max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 7037 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.004369497299194336 nb_pixel_total : 167539 time to create 1 rle with new method : 0.011001825332641602 length of segment : 407 time for calcul the mask position with numpy : 0.0008256435394287109 nb_pixel_total : 42692 time to create 1 rle with old method : 0.05095505714416504 length of segment : 289 time for calcul the mask position with numpy : 0.00025534629821777344 nb_pixel_total : 11496 time to create 1 rle with old method : 0.01327967643737793 length of segment : 139 time for calcul the mask position with numpy : 0.002205371856689453 nb_pixel_total : 88808 time to create 1 rle with old method : 0.10026240348815918 length of segment : 628 time for calcul the mask position with numpy : 0.0006647109985351562 nb_pixel_total : 42683 time to create 1 rle with old method : 0.0477907657623291 length of segment : 164 time for calcul the mask position with numpy : 0.002424955368041992 nb_pixel_total : 162118 time to create 1 rle with new method : 0.009821176528930664 length of segment : 554 time for calcul the mask position with numpy : 0.0007429122924804688 nb_pixel_total : 31785 time to create 1 rle with old method : 0.04987311363220215 length of segment : 218 time for calcul the mask position with numpy : 0.0005464553833007812 nb_pixel_total : 33007 time to create 1 rle with old method : 0.04254770278930664 length of segment : 198 time for calcul the mask position with numpy : 0.0031502246856689453 nb_pixel_total : 171746 time to create 1 rle with new method : 0.00924062728881836 length of segment : 537 time for calcul the mask position with numpy : 0.0022127628326416016 nb_pixel_total : 77291 time to create 1 rle with old method : 0.08646178245544434 length of segment : 425 time for calcul the mask position with numpy : 0.0007953643798828125 nb_pixel_total : 47397 time to create 1 rle with old method : 0.052460432052612305 length of segment : 174 time for calcul the mask position with numpy : 0.0004410743713378906 nb_pixel_total : 24954 time to create 1 rle with old method : 0.029163122177124023 length of segment : 281 time for calcul the mask position with numpy : 0.0017385482788085938 nb_pixel_total : 90512 time to create 1 rle with old method : 0.10291361808776855 length of segment : 341 time for calcul the mask position with numpy : 0.0002372264862060547 nb_pixel_total : 10972 time to create 1 rle with old method : 0.014270782470703125 length of segment : 135 time for calcul the mask position with numpy :20481 time to create 1 rle with old method : 0.023113250732421875 length of segment : 144 time for calcul the mask position with numpy : 0.0024721622467041016 nb_pixel_total : 41161 time to create 1 rle with old method : 0.04851794242858887 length of segment : 563 time for calcul the mask position with numpy : 0.002964496612548828 nb_pixel_total : 64464 time to create 1 rle with old method : 0.07172632217407227 length of segment : 332 time for calcul the mask position with numpy : 0.0005474090576171875 nb_pixel_total : 16888 time to create 1 rle with old method : 0.019202232360839844 length of segment : 199 time for calcul the mask position with numpy : 0.0018703937530517578 nb_pixel_total : 51906 time to create 1 rle with old method : 0.0582728385925293 length of segment : 312 time for calcul the mask position with numpy : 0.0035903453826904297 nb_pixel_total : 94393 time to create 1 rle with old method : 0.11057305335998535 length of segment : 391 time for calcul the mask position with numpy : 0.001878499984741211 nb_pixel_total : 60480 time to create 1 rle with old method : 0.0688924789428711 length of segment : 225 time for calcul the mask position with numpy : 0.0028450489044189453 nb_pixel_total : 80548 time to create 1 rle with old method : 0.11571526527404785 length of segment : 443 time for calcul the mask position with numpy : 0.001550912857055664 nb_pixel_total : 37244 time to create 1 rle with old method : 0.04248380661010742 length of segment : 206 time for calcul the mask position with numpy : 0.0012431144714355469 nb_pixel_total : 29787 time to create 1 rle with old method : 0.03429985046386719 length of segment : 180 time for calcul the mask position with numpy : 0.0067577362060546875 nb_pixel_total : 130727 time to create 1 rle with old method : 0.1488945484161377 length of segment : 568 time for calcul the mask position with numpy : 0.0027205944061279297 nb_pixel_total : 44776 time to create 1 rle with old method : 0.051093339920043945 length of segment : 253 time for calcul the mask position with numpy : 0.0003960132598876953 nb_pixel_total : 8040 time to create 1 rle with old method : 0.009604930877685547 length of segment : 70 time for calcul the mask position with numpy : 0.0014693737030029297 nb_pixel_total : 33283 time to create 1 rle with old method : 0.03880572319030762 length of segment : 307 time for calcul the mask position with numpy : 0.001809835433959961 nb_pixel_total : 63785 time to create 1 rle with old method : 0.07187366485595703 length of segment : 380 time for calcul the mask position with numpy : 0.0013277530670166016 nb_pixel_total : 35413 time to create 1 rle with old method : 0.04940152168273926 length of segment : 130 time for calcul the mask position with numpy : 0.0014750957489013672 nb_pixel_total : 37695 time to create 1 rle with old method : 0.04063773155212402 length of segment : 272 time for calcul the mask position with numpy : 0.0010614395141601562 nb_pixel_total : 31587 time to create 1 rle with old method : 0.03720903396606445 length of segment : 266 time for calcul the mask position with numpy : 0.00072479248046875 nb_pixel_total : 16396 time to create 1 rle with old method : 0.019730091094970703 length of segment : 138 time for calcul the mask position with numpy : 0.0018513202667236328 nb_pixel_total : 51615 time to create 1 rle with old method : 0.05933713912963867 length of segment : 214 time for calcul the mask position with numpy : 0.0029251575469970703 nb_pixel_total : 75282 time to create 1 rle with old method : 0.08704805374145508 length of segment : 519 time for calcul the mask position with numpy : 0.0015299320220947266 nb_pixel_total : 23221 time to create 1 rle with old method : 0.026313066482543945 length of segment : 221 time for calcul the mask position with numpy : 0.0028061866760253906 nb_pixel_total : 47622 time to create 1 rle with old method : 0.05292367935180664 length of segment : 415 time for calcul the mask position with numpy : 0.0015866756439208984 nb_pixel_total : 48640 time to create 1 rle with old method : 0.05547046661376953 length of segment : 375 time for calcul the mask position with numpy : 0.0024535655975341797 nb_pixel_total : 60807 time to create 1 rle with old method : 0.06928801536560059 length of segment : 354 time for calcul the mask position with numpy : 0.0016033649444580078 nb_pixel_total : 37808 time to create 1 rle with old method : 0.04352617263793945 length of segment : 222 time for calcul the mask position with numpy : 0.00066375732421875 nb_pixel_total : 20986 time to create 1 rle with old method : 0.02429986000061035 length of segment : 266 time for calcul the mask position with numpy : 0.02251887321472168 nb_pixel_total : 380144 time to create 1 rle with new method : 0.04047441482543945 length of segment : 1238 time for calcul the mask position with numpy : 0.000385284423828125 nb_pixel_total : 11536 time to create 1 rle with old method : 0.013384819030761719 length of segment : 109 time for calcul the mask position with numpy : 0.0008440017700195312 nb_pixel_total : 20898 time to create 1 rle with old method : 0.02391815185546875 length of segment : 200 time for calcul the mask position with numpy : 0.0023047924041748047 nb_pixel_total : 79480 time to create 1 rle with old method : 0.08702492713928223 length of segment : 419 time for calcul the mask position with numpy : 0.0019235610961914062 nb_pixel_total : 50820 time to create 1 rle with old method : 0.05792522430419922 length of segment : 218 time for calcul the mask position with numpy : 0.0014204978942871094 nb_pixel_total : 29484 time to create 1 rle with old method : 0.04619407653808594 length of segment : 174 time for calcul the mask position with numpy : 0.0005743503570556641 nb_pixel_total : 9639 time to create 1 rle with old method : 0.011565923690795898 length of segment : 80 time for calcul the mask position with numpy : 0.0013813972473144531 nb_pixel_total : 22761 time to create 1 rle with old method : 0.026428937911987305 length of segment : 225 time for calcul the mask position with numpy : 0.0016281604766845703 nb_pixel_total : 52313 time to create 1 rle with old method : 0.0609285831451416 length of segment : 476 time for calcul the mask position with numpy : 0.007099628448486328 nb_pixel_total : 127386 time to create 1 rle with old method : 0.14252448081970215 length of segment : 692 time for calcul the mask position with numpy : 0.0008234977722167969 nb_pixel_total : 20083 time to create 1 rle with old method : 0.0225827693939209 length of segment : 188 time for calcul the mask position with numpy : 0.0025696754455566406 nb_pixel_total : 68182 time to create 1 rle with old method : 0.07621335983276367 length of segment : 470 time for calcul the mask position with numpy : 0.0013506412506103516 nb_pixel_total : 32518 time to create 1 rle with old method : 0.03694581985473633 length of segment : 221 time for calcul the mask position with numpy : 0.0006358623504638672 nb_pixel_total : 16969 time to create 1 rle with old method : 0.021262407302856445 length of segment : 131 time for calcul the mask position with numpy : 0.0005290508270263672 nb_pixel_total : 9898 time to create 1 rle with old method : 0.011617660522460938 length of segment : 129 time for calcul the mask position with numpy : 0.0026776790618896484 nb_pixel_total : 58251 time to create 1 rle with old method : 0.06499385833740234 length of segment : 443 time for calcul the mask position with numpy : 0.0012679100036621094 nb_pixel_total : 36820 time to create 1 rle with old method : 0.0418095588684082 length of segment : 207 time for calcul the mask position with numpy : 0.0017120838165283203 nb_pixel_total : 30444 time to create 1 rle with old method : 0.0355381965637207 length of segment : 199 time for calcul the mask position with numpy : 0.003377199172973633 nb_pixel_total : 57361 time to create 1 rle with old method : 0.06445884704589844 length of segment : 622 time for calcul the mask position with numpy : 0.0005424022674560547 nb_pixel_total : 15374 time to create 1 rle with old method : 0.018001079559326172 length of segment : 143 time for calcul the mask position with numpy : 0.0022547245025634766 nb_pixel_total : 42808 time to create 1 rle with old method : 0.04857206344604492 length of segment : 357 time for calcul the mask position with numpy : 0.0011126995086669922 nb_pixel_total : 25878 time to create 1 rle with old method : 0.03002023696899414 length of segment : 169 time for calcul the mask position with numpy : 0.0020728111267089844 nb_pixel_total : 3911 time to create 1 rle with old method : 0.005438566207885742 length of segment : 194 time for calcul the mask position with numpy : 0.0017478466033935547 nb_pixel_total : 24536 time to create 1 rle with old method : 0.029574871063232422 length of segment : 190 time for calcul the mask position with numpy : 0.0036466121673583984 nb_pixel_total : 78986 time to create 1 rle with old method : 0.11100220680236816 length of segment : 342 time for calcul the mask position with numpy : 0.0032110214233398438 nb_pixel_total : 92628 time to create 1 rle with old method : 0.10468649864196777 length of segment : 375 time for calcul the mask position with numpy : 0.0002560615539550781 nb_pixel_total : 4014 time to create 1 rle with old method : 0.004954814910888672 length of segment : 74 time for calcul the mask position with numpy : 0.003335237503051758 nb_pixel_total : 87073 time to create 1 rle with old method : 0.12163090705871582 length of segment : 339 time for calcul the mask position with numpy : 0.001055002212524414 nb_pixel_total : 22958 time to create 1 rle with old method : 0.02725815773010254 length of segment : 146 time for calcul the mask position with numpy : 0.002612590789794922 nb_pixel_total : 72030 time to create 1 rle with old method : 0.08086919784545898 length of segment : 285 time for calcul the mask position with numpy : 0.0003972053527832031 nb_pixel_total : 7192 time to create 1 rle with old method : 0.00865793228149414 length of segment : 108 time for calcul the mask position with numpy : 0.0019409656524658203 nb_pixel_total : 41099 time to create 1 rle with old method : 0.06416678428649902 length of segment : 286 time for calcul the mask position with numpy : 0.0017740726470947266 nb_pixel_total : 42534 time to create 1 rle with old method : 0.04941821098327637 length of segment : 312 time for calcul the mask position with numpy : 0.00583958625793457 nb_pixel_total : 146495 time to create 1 rle with old method : 0.1630408763885498 length of segment : 335 time for calcul the mask position with numpy : 0.0026063919067382812 nb_pixel_total : 47648 time to create 1 rle with old method : 0.05244874954223633 length of segment : 577 time for calcul the mask position with numpy : 0.002121448516845703 nb_pixel_total : 59310 time to create 1 rle with old method : 0.06676959991455078 length of segment : 237 time for calcul the mask position with numpy : 0.002780914306640625 nb_pixel_total : 58676 time to create 1 rle with old method : 0.06565618515014648 length of segment : 374 time for calcul the mask position with numpy : 0.003068208694458008 nb_pixel_total : 76509 time to create 1 rle with old method : 0.0856776237487793 length of segment : 247 time for calcul the mask position with numpy : 0.002155303955078125 nb_pixel_total : 49083 time to create 1 rle with old method : 0.05510354042053223 length of segment : 348 time for calcul the mask position with numpy : 0.0028743743896484375 nb_pixel_total : 84247 time to create 1 rle with old method : 0.0937659740447998 length of segment : 451 time for calcul the mask position with numpy : 0.00359344482421875 nb_pixel_total : 81642 time to create 1 rle with old method : 0.09099173545837402 length of segment : 515 time for calcul the mask position with numpy : 0.0014219284057617188 nb_pixel_total : 30449 time to create 1 rle with old method : 0.03541755676269531 length of segment : 293 time for calcul the mask position with numpy : 0.0007660388946533203 nb_pixel_total : 10842 time to create 1 rle with old method : 0.012683629989624023 length of segment : 136 time for calcul the mask position with numpy : 0.0015521049499511719 nb_pixel_total : 36484 time to create 1 rle with old method : 0.04040384292602539 length of segment : 190 time for calcul the mask position with numpy : 0.0011107921600341797 nb_pixel_total : 24698 time to create 1 rle with old method : 0.028845787048339844 length of segment : 194 time for calcul the mask position with numpy : 0.0045642852783203125 nb_pixel_total : 121340 time to create 1 rle with old method : 0.13307833671569824 length of segment : 416 time for calcul the mask position with numpy : 0.0022995471954345703 nb_pixel_total : 62539 time to create 1 rle with old method : 0.07136201858520508 length of segment : 342 time for calcul the mask position with numpy : 0.0019049644470214844 nb_pixel_total : 26442 time to create 1 rle with old method : 0.030640840530395508 length of segment : 279 time for calcul the mask position with numpy : 0.0005261898040771484 nb_pixel_total : 7289 time to create 1 rle with old method : 0.008662939071655273 length of segment : 111 time for calcul the mask position with numpy : 0.004281282424926758 nb_pixel_total : 68914 time to create 1 rle with old method : 0.07720708847045898 length of segment : 403 time for calcul the mask position with numpy : 0.00045371055603027344 nb_pixel_total : 20076 time to create 1 rle with old method : 0.024761199951171875 length of segment : 185 time for calcul the mask position with numpy : 0.0025327205657958984 nb_pixel_total : 59715 time to create 1 rle with old method : 0.07230687141418457 length of segment : 358 time for calcul the mask position with numpy : 0.004792690277099609 nb_pixel_total : 95701 time to create 1 rle with old method : 0.10695123672485352 length of segment : 484 time for calcul the mask position with numpy : 0.007815361022949219 nb_pixel_total : 211075 time to create 1 rle with new method : 0.012182235717773438 length of segment : 620 time for calcul the mask position with numpy : 0.0019381046295166016 nb_pixel_total : 43752 time to create 1 rle with old method : 0.049570322036743164 length of segment : 364 time for calcul the mask position with numpy : 0.0013360977172851562 nb_pixel_total : 27792 time to create 1 rle with old method : 0.03227710723876953 length of segment : 196 time for calcul the mask position with numpy : 0.002205371856689453 nb_pixel_total : 55359 time to create 1 rle with old method : 0.06266069412231445 length of segment : 378 time for calcul the mask position with numpy : 0.002593994140625 nb_pixel_total : 51189 time to create 1 rle with old method : 0.05904126167297363 length of segment : 405 time for calcul the mask position with numpy : 0.0050907135009765625 nb_pixel_total : 145804 time to create 1 rle with old method : 0.18780994415283203 length of segment : 396 time for calcul the mask position with numpy : 0.0006906986236572266 nb_pixel_total : 14856 time to create 1 rle with old method : 0.02018570899963379 length of segment : 174 time for calcul the mask position with numpy : 0.003126382827758789 nb_pixel_total : 63249 time to create 1 rle with old method : 0.08507323265075684 length of segment : 323 time for calcul the mask position with numpy : 0.0006210803985595703 nb_pixel_total : 13651 time to create 1 rle with old method : 0.016141891479492188 length of segment : 119 time for calcul the mask position with numpy : 0.002674102783203125 nb_pixel_total : 69662 time to create 1 rle with old method : 0.0805521011352539 length of segment : 322 time for calcul the mask position with numpy : 0.0027327537536621094 nb_pixel_total : 66774 time to create 1 rle with old method : 0.0762629508972168 length of segment : 862 time for calcul the mask position with numpy : 0.005169868469238281 nb_pixel_total : 176140 time to create 1 rle with new method : 0.010399818420410156 length of segment : 439 time for calcul the mask position with numpy : 0.0055310726165771484 nb_pixel_total : 164215 time to create 1 rle with new method : 0.0068988800048828125 length of segment : 452 time for calcul the mask position with numpy : 0.003942251205444336 nb_pixel_total : 123846 time to create 1 rle with old method : 0.14110207557678223 length of segment : 365 time for calcul the mask position with numpy : 0.0010309219360351562 nb_pixel_total : 25332 time to create 1 rle with old method : 0.02989649772644043 length of segment : 190 time for calcul the mask position with numpy : 0.00130462646484375 nb_pixel_total : 33155 time to create 1 rle with old method : 0.04073762893676758 length of segment : 261 time for calcul the mask position with numpy : 0.0009329319000244141 nb_pixel_total : 16030 time to create 1 rle with old method : 0.02523016929626465 length of segment : 212 time for calcul the mask position with numpy : 0.004419088363647461 nb_pixel_total : 51803 time to create 1 rle with old method : 0.06141185760498047 length of segment : 326 time for calcul the mask position with numpy : 0.0043146610260009766 nb_pixel_total : 100170 time to create 1 rle with old method : 0.11318206787109375 length of segment : 499 time for calcul the mask position with numpy : 0.0009584426879882812 nb_pixel_total : 14918 time to create 1 rle with old method : 0.017254352569580078 length of segment : 197 time for calcul the mask position with numpy : 0.0016436576843261719 nb_pixel_total : 43612 time to create 1 rle with old method : 0.05014777183532715 length of segment : 448 time for calcul the mask position with numpy : 0.0005075931549072266 nb_pixel_total : 13320 time to create 1 rle with old method : 0.015691757202148438 length of segment : 124 time for calcul the mask position with numpy : 0.0007913112640380859 nb_pixel_total : 15698 time to create 1 rle with old method : 0.018465280532836914 length of segment : 136 time for calcul the mask position with numpy : 0.0058443546295166016 nb_pixel_total : 127966 time to create 1 rle with old method : 0.1419389247894287 length of segment : 557 time for calcul the mask position with numpy : 0.004266262054443359 nb_pixel_total : 90140 time to create 1 rle with old method : 0.10448360443115234 length of segment : 427 time for calcul the mask position with numpy : 0.0045626163482666016 nb_pixel_total : 93433 time to create 1 rle with old method : 0.11089038848876953 length of segment : 332 time for calcul the mask position with numpy : 0.0010395050048828125 nb_pixel_total : 15611 time to create 1 rle with old method : 0.018581867218017578 length of segment : 176 time for calcul the mask position with numpy : 0.005736351013183594 nb_pixel_total : 182078 time to create 1 rle with new method : 0.009781599044799805 length of segment : 399 time for calcul the mask position with numpy : 0.0028030872344970703 nb_pixel_total : 82058 time to create 1 rle with old method : 0.09338068962097168 length of segment : 542 time for calcul the mask position with numpy : 0.0027790069580078125 nb_pixel_total : 52629 time to create 1 rle with old method : 0.06139111518859863 length of segment : 409 time for calcul the mask position with numpy : 0.0017328262329101562 nb_pixel_total : 38746 time to create 1 rle with old method : 0.0443577766418457 length of segment : 215 time for calcul the mask position with numpy : 0.006317615509033203 nb_pixel_total : 201027 time to create 1 rle with new method : 0.015201568603515625 length of segment : 722 time for calcul the mask position with numpy : 0.0004782676696777344 nb_pixel_total : 6745 time to create 1 rle with old method : 0.008269071578979492 length of segment : 101 time for calcul the mask position with numpy : 0.0015192031860351562 nb_pixel_total : 35738 time to create 1 rle with old method : 0.0433192253112793 length of segment :Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 160 chid ids of type : 3594 Number RLEs to save : 51144 save missing photos in datou_result : time spend for datou_step_exec : 89.14414763450623 time spend to save output : 3.2086591720581055 total time spend for step 1 : 92.35280680656433 step2:crop_condition Fri May 16 19:42:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 160 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 133 About to insert : list_path_to_insert length 133 new photo from crops ! About to upload 133 photos upload in portfolio : 3736932 init cache_photo without model_param we have 133 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747417363_1371448 we have uploaded 133 photos in the portfolio 3736932 time of upload the photos Elapsed time : 34.857720613479614 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747417403_1371448 we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.396350145339966 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747417410_1371448 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6030497550964355 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747417414_1371448 we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.420257329940796 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747417418_1371448 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.2792320251464844 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747417422_1371448 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9243409633636475 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1359028006, 1359027949, 1359027944, 1359027940, 1359027925, 1359027907, 1359027770, 1359027765] Looping around the photos to save general results len do output : 160 /1359041958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359041999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359042140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359028006', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027949', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027944', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027940', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027925', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027907', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027770', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027765', None, None, None, None, None, '2883783') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 488 time used for this insertion : 0.03211569786071777 save_final save missing photos in datou_result : time spend for datou_step_exec : 99.49276471138 time spend to save output : 0.036536216735839844 total time spend for step 2 : 99.52930092811584 step3:rle_unique_nms_with_priority Fri May 16 19:43:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 160 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 4.917644500732422 time for calcul the mask position with numpy : 1.0711638927459717 nb_pixel_total : 7392884 time to create 1 rle with new method : 0.9204578399658203 time for calcul the mask position with numpy : 0.046449899673461914 nb_pixel_total : 24954 time to create 1 rle with old method : 0.02813410758972168 time for calcul the mask position with numpy : 0.04170870780944824 nb_pixel_total : 47397 time to create 1 rle with old method : 0.053157806396484375 time for calcul the mask position with numpy : 0.03391909599304199 nb_pixel_total : 77291 time to create 1 rle with old method : 0.08559703826904297 time for calcul the mask position with numpy : 0.0257720947265625 nb_pixel_total : 171746 time to create 1 rle with new method : 0.8054912090301514 time for calcul the mask position with numpy : 0.026267051696777344 nb_pixel_total : 33007 time to create 1 rle with old method : 0.036948204040527344 time for calcul the mask position with numpy : 0.037572383880615234 nb_pixel_total : 31785 time to create 1 rle with old method : 0.03565859794616699 time for calcul the mask position with numpy : 0.04314899444580078 nb_pixel_total : 162118 time to create 1 rle with new method : 0.9006145000457764 time for calcul the mask position with numpy : 0.04066634178161621 nb_pixel_total : 42683 time to create 1 rle with old method : 0.05067276954650879 time for calcul the mask position with numpy : 0.04131174087524414 nb_pixel_total : 88808 time to create 1 rle with old method : 0.10013151168823242 time for calcul the mask position with numpy : 0.04230046272277832 nb_pixel_total : 11496 time to create 1 rle with old method : 0.013022184371948242 time for calcul the mask position with numpy : 0.03883171081542969 nb_pixel_total : 42692 time to create 1 rle with old method : 0.04796767234802246 time for calcul the mask position with numpy : 0.038886308670043945 nb_pixel_total : 167539 time to create 1 rle with new method : 0.6756548881530762 create new chi : 5.403994560241699 time to delete rle : 0.028057575225830078 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 10188 TO DO : save crop sub photo not yet done ! save time : 0.8020260334014893 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 9.562597274780273 time for calcul the mask position with numpy : 1.2386353015899658 nb_pixel_total : 7517006 time to create 1 rle with new method : 0.44947338104248047 time for calcul the mask position with numpy : 0.026451826095581055 nb_pixel_total : 59108 time to create 1 rle with old method : 0.06933021545410156 time for calcul the mask position with numpy : 0.02488422393798828 nb_pixel_total : 25681 time to create 1 rle with old method : 0.028400659561157227 time for calcul the mask position with numpy : 0.026693105697631836 nb_pixel_total : 54176 time to create 1 rle with old method : 0.06659054756164551 time for calcul the mask position with numpy : 0.025569915771484375 nb_pixel_total : 46056 time to create 1 rle with old method : 0.05127716064453125 time for calcul the mask position with numpy : 0.025662899017333984 nb_pixel_total : 70692 time to create 1 rle with old method : 0.0784292221069336 time for calcul the mask position with numpy : 0.02487778663635254 nb_pixel_total : 21262 time to create 1 rle with old method : 0.023968219757080078 time for calcul the mask position with numpy : 0.023463726043701172 nb_pixel_total : 46779 time to create 1 rle with old method : 0.04852414131164551 time for calcul the mask position with numpy : 0.024993419647216797 nb_pixel_total : 142678 time to create 1 rle with old method : 0.15595602989196777 time for calcul the mask position with numpy : 0.03470468521118164 nb_pixel_total : 31283 time to create 1 rle with old method : 0.038721323013305664 time for calcul the mask position with numpy : 0.030932188034057617 nb_pixel_total : 60992 time to create 1 rle with old method : 0.06663179397583008 time for calcul the mask position with numpy : 0.025434017181396484 nb_pixel_total : 22391 time to create 1 rle with old method : 0.024698972702026367 time for calcul the mask position with numpy : 0.02578878402709961 nb_pixel_total : 51502 time to create 1 rle with old method : 0.078125 time for calcul the mask position with numpy : 0.02694392204284668 nb_pixel_total : 43310 time to create 1 rle with old method : 0.04767012596130371 time for calcul the mask position with numpy : 0.025110960006713867 nb_pixel_total : 10972 time to create 1 rle with old method : 0.012343406677246094 time for calcul the mask position with numpy : 0.026013851165771484 nb_pixel_total : 90512 time to create 1 rle with old method : 0.09770750999450684 create new chi : 3.0207691192626953 time to delete rle : 0.0023865699768066406 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 10710 TO DO : save crop sub photo not yet done ! save time : 0.691286563873291 nb_obj : 20 nb_hashtags : 2 time to prepare the origin masks : 9.059098482131958 time for calcul the mask position with numpy : 0.5901749134063721 nb_pixel_total : 7126703 time to create 1 rle with new method : 0.9715991020202637 time for calcul the mask position with numpy : 0.03989529609680176 nb_pixel_total : 60480 time to create 1 rle with old method : 0.06700348854064941 time for calcul the mask position with numpy : 0.025923490524291992 nb_pixel_total : 94393 time to create 1 rle with old method : 0.10175251960754395 time for calcul the mask position with numpy : 0.024631500244140625 nb_pixel_total : 51906 time to create 1 rle with old method : 0.05531120300292969 time for calcul the mask position with numpy : 0.02437424659729004 nb_pixel_total : 15625 time to create 1 rle with old method : 0.0168304443359375 time for calcul the mask position with numpy : 0.02560710906982422 nb_pixel_total : 64464 time to create 1 rle with old method : 0.06984639167785645 time for calcul the mask position with numpy : 0.024512052536010742 nb_pixel_total : 41161 time to create 1 rle with old method : 0.04471421241760254 time for calcul the mask position with numpy : 0.024370908737182617 nb_pixel_total : 20465 time to create 1 rle with old method : 0.021884918212890625 time for calcul the mask position with numpy : 0.02531290054321289 nb_pixel_total : 51684 time to create 1 rle with old method : 0.0571749210357666 time for calcul the mask position with numpy : 0.025152921676635742 nb_pixel_total : 33633 time to create 1 rle with old method : 0.039562225341796875 time for calcul the mask position with numpy : 0.025861263275146484 nb_pixel_total : 15761 time to create 1 rle with old method : 0.017379045486450195 time for calcul the mask position with numpy : 0.025468111038208008 nb_pixel_total : 13425 time to create 1 rle with old method : 0.014669418334960938 time for calcul the mask position with numpy : 0.026620149612426758 nb_pixel_total : 108456 time to create 1 rle with old method : 0.12724614143371582 time for calcul the mask position with numpy : 0.028097152709960938 nb_pixel_total : 17159 time to create 1 rle with old method : 0.01905655860900879 time for calcul the mask position with numpy : 0.026322603225708008 nb_pixel_total : 43699 time to create 1 rle with old method : 0.07053589820861816 time for calcul the mask position with numpy : 0.028414487838745117 nb_pixel_total : 122394 time to create 1 rle with old method : 0.13279199600219727 time for calcul the mask position with numpy : 0.026164770126342773 nb_pixel_total : 135671 time to create 1 rle with old method : 0.15290570259094238 time for calcul the mask position with numpy : 0.026633501052856445 nb_pixel_total : 66728 time to create 1 rle with old method : 0.07451486587524414 time for calcul the mask position with numpy : 0.026319026947021484 nb_pixel_total : 110868 time to create 1 rle with old method : 0.12348079681396484 time for calcul the mask position with numpy : 0.02412128448486328 nb_pixel_total : 61396 time to create 1 rle with old method : 0.06519699096679688 time for calcul the mask position with numpy : 0.024524450302124023 nb_pixel_total : 38329 time to create 1 rle with old method : 0.04195713996887207 create new chi : 3.449183702468872 time to delete rle : 0.0034818649291992188 batch 1 Loaded 41 chid ids of type : 3594 ++++++++++++++++++++++++++++Number RLEs to save : 15414 TO DO : save crop sub photo not yet done ! save time : 0.9747397899627686 nb_obj : 23 nb_hashtags : 3 time to prepare the origin masks : 12.861948728561401 time for calcul the mask position with numpy : 0.5979416370391846 nb_pixel_total : 7065678 time to create 1 rle with new method : 0.711904764175415 time for calcul the mask position with numpy : 0.025370359420776367 nb_pixel_total : 20898 time to create 1 rle with old method : 0.0235898494720459 time for calcul the mask position with numpy : 0.025269269943237305 nb_pixel_total : 10589 time to create 1 rle with old method : 0.012001752853393555 time for calcul the mask position with numpy : 0.03446078300476074 nb_pixel_total : 284516 time to create 1 rle with new method : 0.7143840789794922 time for calcul the mask position with numpy : 0.04271054267883301 nb_pixel_total : 18443 time to create 1 rle with old method : 0.020746707916259766 time for calcul the mask position with numpy : 0.04188871383666992 nb_pixel_total : 37808 time to create 1 rle with old method : 0.04242086410522461 time for calcul the mask position with numpy : 0.04171609878540039 nb_pixel_total : 60807 time to create 1 rle with old method : 0.06779599189758301 time for calcul the mask position with numpy : 0.02665233612060547 nb_pixel_total : 48640 time to create 1 rle with old method : 0.06557846069335938 time for calcul the mask position with numpy : 0.027146577835083008 nb_pixel_total : 47622 time to create 1 rle with old method : 0.05226278305053711 time for calcul the mask position with numpy : 0.024760007858276367 nb_pixel_total : 23221 time to create 1 rle with old method : 0.024844884872436523 time for calcul the mask position with numpy : 0.025690793991088867 nb_pixel_total : 75282 time to create 1 rle with old method : 0.0846552848815918 time for calcul the mask position with numpy : 0.027843475341796875 nb_pixel_total : 51615 time to create 1 rle with old method : 0.05733156204223633 time for calcul the mask position with numpy : 0.028776884078979492 nb_pixel_total : 16396 time to create 1 rle with old method : 0.026700735092163086 time for calcul the mask position with numpy : 0.0343015193939209 nb_pixel_total : 31587 time to create 1 rle with old method : 0.06265997886657715 time for calcul the mask position with numpy : 0.02658390998840332 nb_pixel_total : 37695 time to create 1 rle with old method : 0.042672157287597656 time for calcul the mask position with numpy : 0.026712656021118164 nb_pixel_total : 35413 time to create 1 rle with old method : 0.03953695297241211 time for calcul the mask position with numpy : 0.02578139305114746 nb_pixel_total : 63785 time to create 1 rle with old method : 0.07065844535827637 time for calcul the mask position with numpy : 0.02575993537902832 nb_pixel_total : 33283 time to create 1 rle with old method : 0.039102792739868164 time for calcul the mask position with numpy : 0.02575993537902832 nb_pixel_total : 8040 time to create 1 rle with old method : 0.009061813354492188 time for calcul the mask position with numpy : 0.02594780921936035 nb_pixel_total : 44776 time to create 1 rle with old method : 0.04924654960632324 time for calcul the mask position with numpy : 0.029651165008544922 nb_pixel_total : 130727 time to create 1 rle with old method : 0.1424236297607422 time for calcul the mask position with numpy : 0.024860143661499023 nb_pixel_total : 29787 time to create 1 rle with old method : 0.03358769416809082 time for calcul the mask position with numpy : 0.026547908782958984 nb_pixel_total : 37244 time to create 1 rle with old method : 0.06052994728088379 time for calcul the mask position with numpy : 0.02570962905883789 nb_pixel_total : 80548 time to create 1 rle with old method : 0.09020471572875977 create new chi : 3.8851122856140137 time to delete rle : 0.0030527114868164062 batch 1 Loaded 47 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++Number RLEs to save : 16351 TO DO : save crop sub photo not yet done ! save time : 1.0293562412261963 nb_obj : 26 nb_hashtags : 3 time to prepare the origin masks : 4.424880504608154 time for calcul the mask position with numpy : 0.5996096134185791 nb_pixel_total : 7193825 time to create 1 rle with new method : 0.7225513458251953 time for calcul the mask position with numpy : 0.033049583435058594 nb_pixel_total : 30444 time to create 1 rle with old method : 0.03287220001220703 time for calcul the mask position with numpy : 0.032723426818847656 nb_pixel_total : 22958 time to create 1 rle with old method : 0.025062084197998047 time for calcul the mask position with numpy : 0.03314042091369629 nb_pixel_total : 92628 time to create 1 rle with old method : 0.09835124015808105 time for calcul the mask position with numpy : 0.033133745193481445 nb_pixel_total : 87073 time to create 1 rle with old method : 0.09881806373596191 time for calcul the mask position with numpy : 0.03547239303588867 nb_pixel_total : 22761 time to create 1 rle with old method : 0.026988506317138672 time for calcul the mask position with numpy : 0.03332662582397461 nb_pixel_total : 57361 time to create 1 rle with old method : 0.06306648254394531 time for calcul the mask position with numpy : 0.033632755279541016 nb_pixel_total : 24536 time to create 1 rle with old method : 0.027519941329956055 time for calcul the mask position with numpy : 0.035147905349731445 nb_pixel_total : 42808 time to create 1 rle with old method : 0.04860544204711914 time for calcul the mask position with numpy : 0.034386634826660156 nb_pixel_total : 50820 time to create 1 rle with old method : 0.057502031326293945 time for calcul the mask position with numpy : 0.03367352485656738 nb_pixel_total : 78986 time to create 1 rle with old method : 0.08722949028015137 time for calcul the mask position with numpy : 0.033780813217163086 nb_pixel_total : 29484 time to create 1 rle with old method : 0.033249855041503906 time for calcul the mask position with numpy : 0.03418326377868652 nb_pixel_total : 15374 time to create 1 rle with old method : 0.017050743103027344 time for calcul the mask position with numpy : 0.033736467361450195 nb_pixel_total : 9898 time to create 1 rle with old method : 0.011047601699829102 time for calcul the mask position with numpy : 0.03401470184326172 nb_pixel_total : 32518 time to create 1 rle with old method : 0.03612565994262695 time for calcul the mask position with numpy : 0.03413820266723633 nb_pixel_total : 52313 time to create 1 rle with old method : 0.058689117431640625 time for calcul the mask position with numpy : 0.03438925743103027 nb_pixel_total : 79480 time to create 1 rle with old method : 0.0891416072845459 time for calcul the mask position with numpy : 0.033620357513427734 nb_pixel_total : 25878 time to create 1 rle with old method : 0.028693675994873047 time for calcul the mask position with numpy : 0.035158395767211914 nb_pixel_total : 20083 time to create 1 rle with old method : 0.02211618423461914 time for calcul the mask position with numpy : 0.03394746780395508 nb_pixel_total : 3911 time to create 1 rle with old method : 0.006677865982055664 time for calcul the mask position with numpy : 0.03903055191040039 nb_pixel_total : 127386 time to create 1 rle with old method : 0.14778494834899902 time for calcul the mask position with numpy : 0.03316378593444824 nb_pixel_total : 16969 time to create 1 rle with old method : 0.018624544143676758 time for calcul the mask position with numpy : 0.03409123420715332 nb_pixel_total : 68182 time to create 1 rle with old method : 0.07485342025756836 time for calcul the mask position with numpy : 0.033524274826049805 nb_pixel_total : 58251 time to create 1 rle with old method : 0.06377863883972168 time for calcul the mask position with numpy : 0.033255577087402344 nb_pixel_total : 36820 time to create 1 rle with old method : 0.039922475814819336 time for calcul the mask position with numpy : 0.03384256362915039 nb_pixel_total : 9639 time to create 1 rle with old method : 0.010458707809448242 time for calcul the mask position with numpy : 0.03197765350341797 nb_pixel_total : 4014 time to create 1 rle with old method : 0.004422903060913086 create new chi : 3.473755359649658 time to delete rle : 0.0024030208587646484 batch 1 Loaded 53 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++Number RLEs to save : 16606 TO DO : save crop sub photo not yet done ! save time : 1.2339129447937012 nb_obj : 25 nb_hashtags : 3 time to prepare the origin masks : 9.799623012542725 time for calcul the mask position with numpy : 0.4794025421142578 nb_pixel_total : 6771098 time to create 1 rle with new method : 0.7155132293701172 time for calcul the mask position with numpy : 0.025880813598632812 nb_pixel_total : 211075 time to create 1 rle with new method : 0.5279145240783691 time for calcul the mask position with numpy : 0.02367711067199707 nb_pixel_total : 95701 time to create 1 rle with old method : 0.10339856147766113 time for calcul the mask position with numpy : 0.023953676223754883 nb_pixel_total : 59715 time to create 1 rle with old method : 0.06328868865966797 time for calcul the mask position with numpy : 0.02374434471130371 nb_pixel_total : 1349 time to create 1 rle with old method : 0.0016362667083740234 time for calcul the mask position with numpy : 0.023944377899169922 nb_pixel_total : 68914 time to create 1 rle with old method : 0.0727074146270752 time for calcul the mask position with numpy : 0.023828744888305664 nb_pixel_total : 7289 time to create 1 rle with old method : 0.008097171783447266 time for calcul the mask position with numpy : 0.02446150779724121 nb_pixel_total : 26442 time to create 1 rle with old method : 0.028606176376342773 time for calcul the mask position with numpy : 0.0249025821685791 nb_pixel_total : 62539 time to create 1 rle with old method : 0.0691225528717041 time for calcul the mask position with numpy : 0.026086807250976562 nb_pixel_total : 121340 time to create 1 rle with old method : 0.13579249382019043 time for calcul the mask position with numpy : 0.025875329971313477 nb_pixel_total : 24698 time to create 1 rle with old method : 0.02777552604675293 time for calcul the mask position with numpy : 0.02577686309814453 nb_pixel_total : 36484 time to create 1 rle with old method : 0.04083442687988281 time for calcul the mask position with numpy : 0.025131702423095703 nb_pixel_total : 10842 time to create 1 rle with old method : 0.012002944946289062 time for calcul the mask position with numpy : 0.025432825088500977 nb_pixel_total : 30449 time to create 1 rle with old method : 0.034539222717285156 time for calcul the mask position with numpy : 0.025845050811767578 nb_pixel_total : 81642 time to create 1 rle with old method : 0.09983587265014648 time for calcul the mask position with numpy : 0.040380001068115234 nb_pixel_total : 84247 time to create 1 rle with old method : 0.10779356956481934 time for calcul the mask position with numpy : 0.0294802188873291 nb_pixel_total : 49083 time to create 1 rle with old method : 0.0553591251373291 time for calcul the mask position with numpy : 0.025852680206298828 nb_pixel_total : 76509 time to create 1 rle with old method : 0.08754277229309082 time for calcul the mask position with numpy : 0.026711702346801758 nb_pixel_total : 58676 time to create 1 rle with old method : 0.06479001045227051 time for calcul the mask position with numpy : 0.025916337966918945 nb_pixel_total : 59310 time to create 1 rle with old method : 0.06585025787353516 time for calcul the mask position with numpy : 0.025694847106933594 nb_pixel_total : 47648 time to create 1 rle with old method : 0.05363011360168457 time for calcul the mask position with numpy : 0.026697874069213867 nb_pixel_total : 146495 time to create 1 rle with old method : 0.1623225212097168 time for calcul the mask position with numpy : 0.02553248405456543 nb_pixel_total : 42534 time to create 1 rle with old method : 0.046652793884277344 time for calcul the mask position with numpy : 0.025609970092773438 nb_pixel_total : 41099 time to create 1 rle with old method : 0.046030282974243164 time for calcul the mask position with numpy : 0.027211666107177734 nb_pixel_total : 7192 time to create 1 rle with old method : 0.008388280868530273 time for calcul the mask position with numpy : 0.025849580764770508 nb_pixel_total : 72030 time to create 1 rle with old method : 0.09197521209716797 create new chi : 3.9276576042175293 time to delete rle : 0.004042148590087891 batch 1 Loaded 51 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 18226 TO DO : save crop sub photo not yet done ! save time : 1.2447361946105957 nb_obj : 22 nb_hashtags : 3 time to prepare the origin masks : 9.442530393600464 time for calcul the mask position with numpy : 0.4647040367126465 nb_pixel_total : 6964073 time to create 1 rle with new method : 0.47220349311828613 time for calcul the mask position with numpy : 0.02376699447631836 nb_pixel_total : 15698 time to create 1 rle with old method : 0.017200231552124023 time for calcul the mask position with numpy : 0.02422642707824707 nb_pixel_total : 13320 time to create 1 rle with old method : 0.015144586563110352 time for calcul the mask position with numpy : 0.02647233009338379 nb_pixel_total : 43612 time to create 1 rle with old method : 0.04927492141723633 time for calcul the mask position with numpy : 0.02590012550354004 nb_pixel_total : 14918 time to create 1 rle with old method : 0.016799449920654297 time for calcul the mask position with numpy : 0.027124404907226562 nb_pixel_total : 100170 time to create 1 rle with old method : 0.11578750610351562 time for calcul the mask position with numpy : 0.02621293067932129 nb_pixel_total : 51803 time to create 1 rle with old method : 0.058571577072143555 time for calcul the mask position with numpy : 0.026604175567626953 nb_pixel_total : 16030 time to create 1 rle with old method : 0.017886638641357422 time for calcul the mask position with numpy : 0.02485346794128418 nb_pixel_total : 33155 time to create 1 rle with old method : 0.03573489189147949 time for calcul the mask position with numpy : 0.024068593978881836 nb_pixel_total : 25332 time to create 1 rle with old method : 0.028157711029052734 time for calcul the mask position with numpy : 0.02561473846435547 nb_pixel_total : 123846 time to create 1 rle with old method : 0.13491463661193848 time for calcul the mask position with numpy : 0.02611684799194336 nb_pixel_total : 164215 time to create 1 rle with new method : 0.5818419456481934 time for calcul the mask position with numpy : 0.02709174156188965 nb_pixel_total : 176140 time to create 1 rle with new method : 0.4434542655944824 time for calcul the mask position with numpy : 0.02698230743408203 nb_pixel_total : 66774 time to create 1 rle with old method : 0.0750112533569336 time for calcul the mask position with numpy : 0.027817249298095703 nb_pixel_total : 69662 time to create 1 rle with old method : 0.0791018009185791 time for calcul the mask position with numpy : 0.024500370025634766 nb_pixel_total : 13651 time to create 1 rle with old method : 0.015224218368530273 time for calcul the mask position with numpy : 0.02534770965576172 nb_pixel_total : 63249 time to create 1 rle with old method : 0.07039356231689453 time for calcul the mask position with numpy : 0.025773048400878906 nb_pixel_total : 14856 time to create 1 rle with old method : 0.016831398010253906 time for calcul the mask position with numpy : 0.02625298500061035 nb_pixel_total : 145804 time to create 1 rle with old method : 0.16328883171081543 time for calcul the mask position with numpy : 0.026539325714111328 nb_pixel_total : 51189 time to create 1 rle with old method : 0.05751180648803711 time for calcul the mask position with numpy : 0.02463531494140625 nb_pixel_total : 55359 time to create 1 rle with old method : 0.06117057800292969 time for calcul the mask position with numpy : 0.024949312210083008 nb_pixel_total : 27792 time to create 1 rle with old method : 0.03064131736755371 time for calcul the mask position with numpy : 0.025151968002319336 nb_pixel_total : 43752 time to create 1 rle with old method : 0.05064821243286133 create new chi : 3.7332723140716553 time to delete rle : 0.0026483535766601562 batch 1 Loaded 45 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++Number RLEs to save : 16536 TO DO : save crop sub photo not yet done ! save time : 1.0472047328948975 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 6.589765787124634 time for calcul the mask position with numpy : 0.3836386203765869 nb_pixel_total : 6886698 time to create 1 rle with new method : 1.2804992198944092 time for calcul the mask position with numpy : 0.08553004264831543 nb_pixel_total : 82619 time to create 1 rle with old method : 0.2361140251159668 time for calcul the mask position with numpy : 0.06763029098510742 nb_pixel_total : 128271 time to create 1 rle with old method : 0.2266407012939453 time for calcul the mask position with numpy : 0.04573702812194824 nb_pixel_total : 72528 time to create 1 rle with old method : 0.11094880104064941 time for calcul the mask position with numpy : 0.0437467098236084 nb_pixel_total : 40928 time to create 1 rle with old method : 0.04651927947998047 time for calcul the mask position with numpy : 0.0483555793762207 nb_pixel_total : 67704 time to create 1 rle with old method : 0.10342574119567871 time for calcul the mask position with numpy : 0.08023953437805176 nb_pixel_total : 89481 time to create 1 rle with old method : 0.1063222885131836 time for calcul the mask position with numpy : 0.04072213172912598 nb_pixel_total : 35738 time to create 1 rle with old method : 0.0406794548034668 time for calcul the mask position with numpy : 0.03756117820739746 nb_pixel_total : 6745 time to create 1 rle with old method : 0.008623600006103516 time for calcul the mask position with numpy : 0.03583097457885742 nb_pixel_total : 201027 time to create 1 rle with new method : 2.426400661468506 time for calcul the mask position with numpy : 0.033385515213012695 nb_pixel_total : 38746 time to create 1 rle with old method : 0.04191160202026367 time for calcul the mask position with numpy : 0.02884840965270996 nb_pixel_total : 52629 time to create 1 rle with old method : 0.05767011642456055 time for calcul the mask position with numpy : 0.029210329055786133 nb_pixel_total : 82058 time to create 1 rle with old method : 0.0914461612701416 time for calcul the mask position with numpy : 0.029966115951538086 nb_pixel_total : 182078 time to create 1 rle with new method : 0.5189588069915771 time for calcul the mask position with numpy : 0.03062295913696289 nb_pixel_total : 15611 time to create 1 rle with old method : 0.016880035400390625 time for calcul the mask position with numpy : 0.0307619571685791 nb_pixel_total : 93433 time to create 1 rle with old method : 0.10434699058532715 time for calcul the mask position with numpy : 0.03491997718811035 nb_pixel_total : 90140 time to create 1 rle with old method : 0.10093212127685547 time for calcul the mask position with numpy : 0.03166818618774414 nb_pixel_total : 127966 time to create 1 rle with old method : 0.14608502388000488 create new chi : 6.914661884307861 time to delete rle : 0.0039052963256835938 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 14788 TO DO : save crop sub photo not yet done ! save time : 0.9358925819396973 map_output_result : {1359028006: (0.0, 'Should be the crop_list due to order', 0), 1359027949: (0.0, 'Should be the crop_list due to order', 0), 1359027944: (0.0, 'Should be the crop_list due to order', 0), 1359027940: (0.0, 'Should be the crop_list due to order', 0), 1359027925: (0.0, 'Should be the crop_list due to order', 0), 1359027907: (0.0, 'Should be the crop_list due to order', 0), 1359027770: (0.0, 'Should be the crop_list due to order', 0), 1359027765: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1359028006, 1359027949, 1359027944, 1359027940, 1359027925, 1359027907, 1359027770, 1359027765] Looping around the photos to save general results len do output : 8 /1359028006.Didn't retrieve data . /1359027949.Didn't retrieve data . /1359027944.Didn't retrieve data . /1359027940.Didn't retrieve data . /1359027925.Didn't retrieve data . /1359027907.Didn't retrieve data . /1359027770.Didn't retrieve data . /1359027765.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359028006', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027949', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027944', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027940', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027925', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027907', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027770', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027765', None, None, None, None, None, '2883783') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.01583075523376465 save_final save missing photos in datou_result : time spend for datou_step_exec : 109.95234608650208 time spend to save output : 0.016286373138427734 total time spend for step 3 : 109.9686324596405 step4:ventilate_hashtags_in_portfolio Fri May 16 19:45:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23079435 get user id for portfolio 23079435 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23079435 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','carton','background','environnement','pet_fonce','autre','mal_croppe','papier','pet_clair','flou','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23079435 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','carton','background','environnement','pet_fonce','autre','mal_croppe','papier','pet_clair','flou','metal')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23079435 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','carton','background','environnement','pet_fonce','autre','mal_croppe','papier','pet_clair','flou','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23079899,23079900,23079901,23079902,23079903,23079904,23079905,23079906,23079907,23079908,23079909?tags=pehd,carton,background,environnement,pet_fonce,autre,mal_croppe,papier,pet_clair,flou,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1359028006, 1359027949, 1359027944, 1359027940, 1359027925, 1359027907, 1359027770, 1359027765] Looping around the photos to save general results len do output : 1 /23079435. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359028006', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027949', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027944', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027940', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027925', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027907', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027770', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027765', None, None, None, None, None, '2883783') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.0147705078125 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5928385257720947 time spend to save output : 0.015005350112915039 total time spend for step 4 : 1.6078438758850098 step5:final Fri May 16 19:45:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1359028006: ('0.14222299081307868',), 1359027949: ('0.14222299081307868',), 1359027944: ('0.14222299081307868',), 1359027940: ('0.14222299081307868',), 1359027925: ('0.14222299081307868',), 1359027907: ('0.14222299081307868',), 1359027770: ('0.14222299081307868',), 1359027765: ('0.14222299081307868',)} new output for save of step final : {1359028006: ('0.14222299081307868',), 1359027949: ('0.14222299081307868',), 1359027944: ('0.14222299081307868',), 1359027940: ('0.14222299081307868',), 1359027925: ('0.14222299081307868',), 1359027907: ('0.14222299081307868',), 1359027770: ('0.14222299081307868',), 1359027765: ('0.14222299081307868',)} [1359028006, 1359027949, 1359027944, 1359027940, 1359027925, 1359027907, 1359027770, 1359027765] Looping around the photos to save general results len do output : 8 /1359028006.Didn't retrieve data . /1359027949.Didn't retrieve data . /1359027944.Didn't retrieve data . /1359027940.Didn't retrieve data . /1359027925.Didn't retrieve data . /1359027907.Didn't retrieve data . /1359027770.Didn't retrieve data . /1359027765.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359028006', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027949', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027944', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027940', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027925', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027907', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027770', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027765', None, None, None, None, None, '2883783') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.013735532760620117 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.16410279273986816 time spend to save output : 0.014161109924316406 total time spend for step 5 : 0.17826390266418457 step6:blur_detection Fri May 16 19:45:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13.jpg resize: (2160, 3840) 1359028006 -6.472522881878713 treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500.jpg resize: (2160, 3840) 1359027949 -6.414221460390221 treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded.jpg resize: (2160, 3840) 1359027944 -6.447335339300633 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279.jpg resize: (2160, 3840) 1359027940 -6.48690161973303 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777.jpg resize: (2160, 3840) 1359027925 -6.6011666540244915 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c.jpg resize: (2160, 3840) 1359027907 -6.578608248003387 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf.jpg resize: (2160, 3840) 1359027770 -6.517780612660002 treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6.jpg resize: (2160, 3840) 1359027765 -6.534967996389526 treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126627_0.png resize: (289, 230) 1359041958 -4.002030972788084 treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126626_0.png resize: (399, 669) 1359041960 -3.290988788069505 treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126628_0.png resize: (139, 120) 1359041961 -3.464753062785514 treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126629_0.png resize: (477, 443) 1359041962 -4.439442661947594 treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126630_0.png resize: (155, 375) 1359041963 -4.35952738091919 treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126636_0.png resize: (165, 349) 1359041964 -3.752212661100773 treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126632_0.png resize: (201, 256) 1359041965 -4.380242925019172 treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126635_0.png resize: (383, 447) 1359041966 -4.0047493760375215 treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126631_0.png resize: (359, 591) 1359041967 -3.742776803185946 treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126633_0.png resize: (198, 248) 1359041968 -2.928840104147412 treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126640_0.png resize: (294, 218) 1359041970 -3.787138074731491 treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126645_0.png resize: (386, 630) 1359041971 -3.359986944924281 treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126639_0.png resize: (135, 117) 1359041972 -3.450985959606888 treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126644_0.png resize: (222, 219) 1359041973 -3.8809608016653314 treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126647_0.png resize: (186, 165) 1359041974 0.41862280638714094 treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126642_0.png resize: (298, 172) 1359041975 -2.9549828366605744 treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126649_0.png resize: (154, 428) 1359041978 -4.50976039083374 treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126646_0.png resize: (202, 379) 1359041979 -4.479250853780141 treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126652_0.png resize: (438, 443) 1359041980 -3.736725680075242 treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126651_0.png resize: (215, 195) 1359041981 -4.467675532160296 treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126638_0.png resize: (340, 385) 1359041982 -2.6429365869568904 treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126641_0.png resize: (243, 294) 1359041983 -2.223129677998323 treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126667_0.png resize: (562, 150) 1359041984 -4.036803881313814 treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126658_0.png resize: (461, 439) 1359041985 -2.13707254015191 treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126669_0.png resize: (196, 127) 1359041986 -1.9404532786172382 treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126655_0.png resize: (276, 460) 1359041987 -2.3431610679237096 treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126662_0.png resize: (180, 143) 1359041988 -4.315933334666543 treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126672_0.png resize: (218, 363) 1359041989 -3.4654223707130853 treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126665_0.png resize: (306, 250) 1359041990 -3.0955695676236252 treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126666_0.png resize: (144, 182) 1359041991 -2.763470252865827 treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126656_0.png resize: (229, 426) 1359041992 -0.5978898708883434 treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126661_0.png resize: (455, 394) 1359041993 -4.767717842667314 treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126664_0.png resize: (223, 213) 1359041994 -2.957971950034696 treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126654_0.png resize: (340, 325) 1359041995 -2.511021832044645 treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126657_0.png resize: (561, 395) 1359041996 -1.572720697791879 treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126670_0.png resize: (233, 341) 1359041997 -2.095574501406169 treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126659_0.png resize: (352, 203) 1359041998 -3.7690770642993368 treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126671_0.png resize: (365, 456) 1359041999 -0.0899613704073333 treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126653_0.png resize: (375, 172) 1359042000 -4.148722016043036 treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126668_0.png resize: (324, 309) 1359042001 -3.821702779004155 treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126663_0.png resize: (239, 180) 1359042002 -3.2574748921503964 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126687_0.png resize: (217, 199) 1359042003 -2.055194760405717 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126693_0.png resize: (640, 945) 1359042004 -4.551458222039737 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126673_0.png resize: (438, 243) 1359042005 0.9375287781495418 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126685_0.png resize: (214, 322) 1359042006 -1.728745206852919 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126679_0.png resize: (288, 207) 1359042007 -3.198472971987983 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126678_0.png resize: (69, 173) 1359042008 -3.0642435289077157 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126689_0.png resize: (327, 276) 1359042009 -3.7763179899882067 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126674_0.png resize: (206, 293) 1359042010 -2.4343545029253084 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126684_0.png resize: (138, 147) 1359042011 -1.5772542360335344 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126675_0.png resize: (165, 298) 1359042012 -1.5717114325529236 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126691_0.png resize: (241, 317) 1359042013 -3.622868263270404 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126680_0.png resize: (310, 336) 1359042014 -4.321100466036602 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126688_0.png resize: (364, 215) 1359042015 -3.137964150244469 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126677_0.png resize: (239, 460) 1359042016 -2.861522611298314 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126676_0.png resize: (555, 488) 1359042017 -4.4485940575943275 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126683_0.png resize: (256, 195) 1359042018 -3.3892543312535692 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126692_0.png resize: (206, 218) 1359042019 -3.593451945745013 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126686_0.png resize: (408, 276) 1359042020 -4.725211899941525 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126682_0.png resize: (267, 219) 1359042021 -3.63229669946416 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126713_0.png resize: (356, 190) 1359042022 -3.207362279128352 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126715_0.png resize: (167, 269) 1359042023 -1.1964801444631012 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126696_0.png resize: (417, 238) 1359042024 1.828990066045626 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126697_0.png resize: (218, 302) 1359042025 -1.5497972725340472 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126701_0.png resize: (357, 244) 1359042026 -3.6426432946856755 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126699_0.png resize: (80, 181) 1359042027 -3.144793190548549 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126706_0.png resize: (114, 224) 1359042028 -4.0975314301345485 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126709_0.png resize: (207, 268) 1359042029 -2.763883464789051 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126714_0.png resize: (163, 195) 1359042030 -3.3163628867105976 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126698_0.png resize: (157, 319) 1359042031 -1.895414370190513 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126705_0.png resize: (215, 203) 1359042032 -4.241139012716413 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126708_0.png resize: (298, 332) 1359042033 -4.123541192207703 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126716_0.png resize: (173, 263) 1359042034 -3.8680645225728068 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126710_0.png resize: (199, 332) 1359042035 -3.118192607663042 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126702_0.png resize: (564, 467) 1359042036 -4.631936058356114 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126704_0.png resize: (399, 268) 1359042037 -4.593226685730767 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126719_0.png resize: (67, 90) 1359042039 -3.589672757559852 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126717_0.png resize: (307, 436) 1359042040 -3.8204271269615013 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126711_0.png resize: (441, 286) 1359042041 -3.272128010711331 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126712_0.png resize: (142, 144) 1359042042 -3.3190512887329806 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126707_0.png resize: (129, 95) 1359042043 -3.39703017259849 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126738_0.png resize: (413, 419) 1359042044 -3.4627565969285827 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126734_0.png resize: (225, 229) 1359042045 0.7113912944154295 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126724_0.png resize: (286, 215) 1359042046 -3.786830590277998 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126728_0.png resize: (225, 376) 1359042048 -0.7503615042331457 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126742_0.png resize: (364, 302) 1359042049 -3.1741594014994847 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126725_0.png resize: (311, 167) 1359042050 -5.17459349801337 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126723_0.png resize: (108, 79) 1359042051 -0.9935217029449438 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126726_0.png resize: (306, 670) 1359042052 -2.7579127760291215 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126731_0.png resize: (315, 254) 1359042053 -3.011567370970376 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126745_0.png resize: (413, 333) 1359042054 -3.7717465916304294 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126746_0.png resize: (418, 765) 1359042055 -3.858173043673482 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126739_0.png resize: (256, 370) 1359042056 -1.9896148621542424 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126735_0.png resize: (135, 160) 1359042058 -2.591523793903551 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126722_0.png resize: (267, 382) 1359042059 0.14685729151296678 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126733_0.png resize: (414, 313) 1359042060 -4.369515020443385 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126732_0.png resize: (425, 289) 1359042061 -4.203940242307371 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126727_0.png resize: (336, 272) 1359042062 -2.685186293730065 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126729_0.png resize: (374, 293) 1359042063 -3.23429239976019 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126740_0.png resize: (266, 223) 1359042064 -2.0371966336394043 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126741_0.png resize: (111, 107) 1359042065 -3.8927262749222957 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126747_0.png resize: (352, 184) 1359042066 -2.8457108105278874 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126756_0.png resize: (538, 170) 1359042067 -2.27257195523978 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126766_0.png resize: (332, 217) 1359042068 -3.706197305601516 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126763_0.png resize: (359, 451) 1359042069 -2.663560803222162 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126764_0.png resize: (433, 407) 1359042070 -2.957380980783814 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126755_0.png resize: (322, 319) 1359042071 0.3653285689066027 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126752_0.png resize: (173, 111) 1359042072 -2.926716810993884 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126754_0.png resize: (119, 164) 1359042073 -1.5182602011477189 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126757_0.png resize: (380, 626) 1359042074 -1.9514347205905869 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126750_0.png resize: (280, 316) 1359042075 -3.1763016230876833 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126759_0.png resize: (363, 530) 1359042076 -3.8416387348825216 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126768_0.png resize: (128, 199) 1359042077 -3.9967714733216546 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126753_0.png resize: (290, 367) 1359042078 -4.179597974492246 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126758_0.png resize: (412, 511) 1359042079 -4.208254924430999 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126749_0.png resize: (336, 276) 1359042080 -0.6633436053213917 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126761_0.png resize: (239, 266) 1359042081 -3.669656423379377 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126751_0.png resize: (387, 487) 1359042082 -4.500774049551472 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126760_0.png resize: (123, 340) 1359042083 -3.9226037155242235 treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126773_0.png resize: (391, 612) 1359042084 -2.540624172544334 treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126771_0.png resize: (328, 457) 1359042085 -4.3394644130134 treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126775_0.png resize: (251, 381) 1359042086 -2.0849564506206395 treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126777_0.png resize: (590, 557) 1359042087 -4.5372009171129895 treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126774_0.png resize: (388, 344) 1359042088 -4.220149823151471 treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126770_0.png resize: (408, 471) 1359042089 0.734657890835625 treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126769_0.png resize: (557, 413) 1359042090 -2.2337872741415987 treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126779_0.png resize: (139, 390) 1359042091 1.9093632605595905 treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126776_0.png resize: (188, 297) 1359042092 -3.669617154049358 treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126780_0.png resize: (549, 318) 1359042093 -4.4939874469030245 treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126781_0.png resize: (351, 331) 1359042094 -3.0805712243647165 treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126783_0.png resize: (395, 245) 1359042095 -3.3358178159872405 treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126782_0.png resize: (255, 221) 1359042096 -4.502850060737501 treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126778_0.png resize: (94, 123) 1359042098 -3.4658153908626446 treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126637_0.png resize: (281, 128) 1359042106 -2.828270494912273 treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126660_0.png resize: (88, 254) 1359042107 -3.9227215291635917 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126695_0.png resize: (200, 148) 1359042108 -3.886216201306437 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126700_0.png resize: (220, 198) 1359042109 -1.7955909192198527 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126720_0.png resize: (311, 415) 1359042110 -2.60345787987883 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126703_0.png resize: (188, 146) 1359042111 -4.108506672581815 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126736_0.png resize: (190, 320) 1359042112 -3.200966801332234 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126744_0.png resize: (340, 273) 1359042114 -2.351579532459024 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126737_0.png resize: (172, 223) 1359042115 -2.7235584054446607 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126743_0.png resize: (185, 163) 1359042116 -2.139937232380298 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126762_0.png resize: (184, 129) 1359042117 -3.534476363891441 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126748_0.png resize: (194, 225) 1359042118 -2.8887939740936948 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126765_0.png resize: (197, 129) 1359042119 -2.5210432063360697 treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126785_0.png resize: (319, 435) 1359042120 -4.226435560192701 treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126772_0.png resize: (174, 161) 1359042121 -2.945316159327383 treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126767_0.png resize: (123, 138) 1359042123 -4.429616384106581 treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126634_0.png resize: (537, 457) 1359042127 -5.14910130760968 treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126650_0.png resize: (231, 329) 1359042128 -4.19240855648836 treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126643_0.png resize: (351, 225) 1359042129 -4.6893498743837965 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126718_0.png resize: (342, 362) 1359042130 -4.5886369375041145 treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126721_0.png resize: (143, 223) 1359042131 -3.4804379534970327 treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126648_0.png resize: (291, 287) 1359042135 -2.295574177142897 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126681_0.png resize: (124, 352) 1359042136 -4.1135615529321425 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126690_0.png resize: (278, 313) 1359042137 -2.2352138491505738 treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126694_0.png resize: (88, 164) 1359042138 -3.5817783866762416 treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126730_0.png resize: (247, 421) 1359042139 -3.8565187285022886 treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126784_0.png resize: (255, 610) 1359042140 -4.080726914792254 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 168 time used for this insertion : 0.025243282318115234 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 168 time used for this insertion : 0.03175544738769531 save missing photos in datou_result : time spend for datou_step_exec : 38.74363660812378 time spend to save output : 0.06331157684326172 total time spend for step 6 : 38.80694818496704 step7:brightness Fri May 16 19:46:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13.jpg treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500.jpg treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded.jpg treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279.jpg treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777.jpg treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c.jpg treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf.jpg treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6.jpg treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126627_0.png treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126626_0.png treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126628_0.png treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126629_0.png treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126630_0.png treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126636_0.png treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126632_0.png treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126635_0.png treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126631_0.png treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126633_0.png treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126640_0.png treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126645_0.png treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126639_0.png treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126644_0.png treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126647_0.png treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126642_0.png treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126649_0.png treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126646_0.png treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126652_0.png treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126651_0.png treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126638_0.png treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126641_0.png treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126667_0.png treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126658_0.png treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126669_0.png treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126655_0.png treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126662_0.png treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126672_0.png treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126665_0.png treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126666_0.png treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126656_0.png treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126661_0.png treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126664_0.png treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126654_0.png treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126657_0.png treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126670_0.png treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126659_0.png treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126671_0.png treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126653_0.png treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126668_0.png treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126663_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126687_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126693_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126673_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126685_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126679_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126678_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126689_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126674_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126684_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126675_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126691_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126680_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126688_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126677_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126676_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126683_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126692_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126686_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126682_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126713_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126715_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126696_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126697_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126701_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126699_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126706_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126709_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126714_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126698_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126705_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126708_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126716_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126710_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126702_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126704_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126719_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126717_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126711_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126712_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126707_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126738_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126734_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126724_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126728_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126742_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126725_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126723_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126726_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126731_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126745_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126746_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126739_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126735_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126722_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126733_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126732_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126727_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126729_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126740_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126741_0.png treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126747_0.png treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126756_0.png treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126766_0.png treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126763_0.png treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126764_0.png treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126755_0.png treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126752_0.png treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126754_0.png treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126757_0.png treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126750_0.png treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126759_0.png treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126768_0.png treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126753_0.png treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126758_0.png treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126749_0.png treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126761_0.png treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126751_0.png treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126760_0.png treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126773_0.png treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126771_0.png treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126775_0.png treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126777_0.png treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126774_0.png treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126770_0.png treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126769_0.png treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126779_0.png treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126776_0.png treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126780_0.png treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126781_0.png treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126783_0.png treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126782_0.png treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126778_0.png treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126637_0.png treat image : temp/1747417229_1371448_1359027944_a8b11bbd1058aa65b7dcaa0e5b6d0ded_rle_crop_3802126660_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126695_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126700_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126720_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126703_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126736_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126744_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126737_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126743_0.png treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126762_0.png treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126748_0.png treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126765_0.png treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126785_0.png treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126772_0.png treat image : temp/1747417229_1371448_1359027770_ccfa8e250b2eb0d03f89968bf6da4fbf_rle_crop_3802126767_0.png treat image : temp/1747417229_1371448_1359028006_f6f86a898b527eb127669b03e9792e13_rle_crop_3802126634_0.png treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126650_0.png treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126643_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126718_0.png treat image : temp/1747417229_1371448_1359027925_2ea52759c98be2031de2fef23ee07777_rle_crop_3802126721_0.png treat image : temp/1747417229_1371448_1359027949_df62571496f3f74654225196e6e82500_rle_crop_3802126648_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126681_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126690_0.png treat image : temp/1747417229_1371448_1359027940_31f93d5e13f54caed71023f254b41279_rle_crop_3802126694_0.png treat image : temp/1747417229_1371448_1359027907_1faabc59ff3585aa6df51458d60c769c_rle_crop_3802126730_0.png treat image : temp/1747417229_1371448_1359027765_2a35e89248e8467331dd3199e0236de6_rle_crop_3802126784_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 168 time used for this insertion : 0.021714448928833008 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 168 time used for this insertion : 0.036734819412231445 save missing photos in datou_result : time spend for datou_step_exec : 9.906521797180176 time spend to save output : 0.06449317932128906 total time spend for step 7 : 9.971014976501465 step8:velours_tree Fri May 16 19:46:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.4484405517578125 time spend to save output : 3.981590270996094e-05 total time spend for step 8 : 1.4484803676605225 step9:send_mail_cod Fri May 16 19:46:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23079435_16-05-2025_19_46_25.pdf 23079899 imagette230798991747417585 23079900 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette230799001747417585 23079901 imagette230799011747417586 23079903 change filename to text .change filename to text .imagette230799031747417586 23079904 change filename to text .change filename to text .change filename to text .change filename to text .imagette230799041747417586 23079905 imagette230799051747417587 23079906 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette230799061747417587 23079907 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette230799071747417588 23079908 imagette230799081747417589 23079909 change filename to text .imagette230799091747417589 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23079435 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23079899,23079900,23079901,23079902,23079903,23079904,23079905,23079906,23079907,23079908,23079909?tags=pehd,carton,background,environnement,pet_fonce,autre,mal_croppe,papier,pet_clair,flou,metal args[1359028006] : ((1359028006, -6.472522881878713, 492609224), (1359028006, 0.5442409638690372, 2107752395), '0.14222299081307868') We are sending mail with results at report@fotonower.com args[1359027949] : ((1359027949, -6.414221460390221, 492609224), (1359027949, 0.5443808347431509, 2107752395), '0.14222299081307868') We are sending mail with results at report@fotonower.com args[1359027944] : ((1359027944, -6.447335339300633, 492609224), (1359027944, 0.8704140372469068, 2107752395), '0.14222299081307868') We are sending mail with results at report@fotonower.com args[1359027940] : ((1359027940, -6.48690161973303, 492609224), (1359027940, 0.7359126052675258, 2107752395), '0.14222299081307868') We are sending mail with results at report@fotonower.com args[1359027925] : ((1359027925, -6.6011666540244915, 492609224), (1359027925, 0.7377559736768848, 2107752395), '0.14222299081307868') We are sending mail with results at report@fotonower.com args[1359027907] : ((1359027907, -6.578608248003387, 492609224), (1359027907, 1.2001796320001137, 2107752395), '0.14222299081307868') We are sending mail with results at report@fotonower.com args[1359027770] : ((1359027770, -6.517780612660002, 492609224), (1359027770, 1.0506946243848188, 2107752395), '0.14222299081307868') We are sending mail with results at report@fotonower.com args[1359027765] : ((1359027765, -6.534967996389526, 492609224), (1359027765, 0.8976115527666578, 2107752395), '0.14222299081307868') We are sending mail with results at report@fotonower.com refus_total : 0.14222299081307868 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23079435 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23079435_16-05-2025_19_46_25.pdf results_Auto_P23079435_16-05-2025_19_46_25.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23079435_16-05-2025_19_46_25.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23079435','results_Auto_P23079435_16-05-2025_19_46_25.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23079435_16-05-2025_19_46_25.pdf','pdf','','0.62','0.14222299081307868') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23079435

https://www.fotonower.com/image?json=false&list_photos_id=1359028006
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359027949
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359027944
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359027940
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359027925
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359027907
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359027770
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359027765
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 14.22%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/23079900?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23079903?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23079904?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23079906?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23079907?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/23079909?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23079435_16-05-2025_19_46_25.pdf.

Lien vers velours :https://www.fotonower.com/velours/23079899,23079900,23079901,23079902,23079903,23079904,23079905,23079906,23079907,23079908,23079909?tags=pehd,carton,background,environnement,pet_fonce,autre,mal_croppe,papier,pet_clair,flou,metal.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 16 May 2025 17:46:31 GMT Content-Length: 0 Connection: close X-Message-Id: KcPNaBPiTr-YFpw8xsEkmQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1359028006, 1359027949, 1359027944, 1359027940, 1359027925, 1359027907, 1359027770, 1359027765] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359028006', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027949', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027944', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027940', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027925', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027907', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027770', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027765', None, None, None, None, None, '2883783') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.014095783233642578 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.525770425796509 time spend to save output : 0.014303445816040039 total time spend for step 9 : 6.540073871612549 step10:split_time_score Fri May 16 19:46:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 16052025 23079435 Nombre de photos uploadées : 9 / 23040 (0%) 16052025 23079435 Nombre de photos taguées (types de déchets): 0 / 9 (0%) 16052025 23079435 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 2.6226043701171875e-06 elapsed_time : order_list_meta_photo_and_scores 7.867813110351562e-06 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005042552947998047 elapsed_time : insert_dashboard_record_day_entry 0.027771711349487305 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.14881168016975313 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23052716_16-05-2025_08_52_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23052716 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23052716 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23052744 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23067225 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23067239 order by id desc limit 1 Qualite : 0.10353827080118315 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23071983_16-05-2025_16_52_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23071983 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23071983 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23073354 order by id desc limit 1 Qualite : 0.1697871024856702 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23073358_16-05-2025_17_35_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23073358 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23073358 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23075513 order by id desc limit 1 Qualite : 0.12602876639660496 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23075515_16-05-2025_18_22_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23075515 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23075515 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23079427 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23079432 order by id desc limit 1 Qualite : 0.14222299081307868 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23079435_16-05-2025_19_46_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23079435 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23079435 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'16052025': {'nb_upload': 9, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1359028006, 1359027949, 1359027944, 1359027940, 1359027925, 1359027907, 1359027770, 1359027765] Looping around the photos to save general results len do output : 1 /23079435Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359028006', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027949', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027944', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027940', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027925', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027907', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027770', None, None, None, None, None, '2883783') ('3318', None, None, None, None, None, None, None, '2883783') ('3318', '23079435', '1359027765', None, None, None, None, None, '2883783') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014149665832519531 save_final save missing photos in datou_result : begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 time used for this insertion : 0.015095233917236328 time spend for datou_step_exec : 6.7553839683532715 time spend to save output : 0.02952098846435547 total time spend for step 10 : 6.784904956817627 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 164.24user 142.32system 6:13.23elapsed 82%CPU (0avgtext+0avgdata 5546724maxresident)k 716056inputs+141512outputs (15058major+15506805minor)pagefaults 0swaps