python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2691911 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2848510'] with mtr_portfolio_ids : ['22960477'] and first list_photo_ids : [] new path : /proc/2691911/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 6 ; length of list_pids : 6 ; length of list_args : 6 time to download the photos : 0.9372773170471191 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed May 14 13:00:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5647 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-14 13:00:31.705806: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-14 13:00:31.735043: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-14 13:00:31.737294: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f65fc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-14 13:00:31.737354: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-14 13:00:31.741404: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-14 13:00:32.041638: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x42278350 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-14 13:00:32.041697: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-14 13:00:32.042701: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-14 13:00:32.043158: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-14 13:00:32.046460: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-14 13:00:32.049405: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-14 13:00:32.049851: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-14 13:00:32.052785: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-14 13:00:32.054155: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-14 13:00:32.059536: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-14 13:00:32.060902: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-14 13:00:32.060978: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-14 13:00:32.061648: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-14 13:00:32.061663: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-14 13:00:32.061672: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-14 13:00:32.062715: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5022 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-14 13:00:32.326846: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-14 13:00:32.326979: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-14 13:00:32.327013: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-14 13:00:32.327038: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-14 13:00:32.327063: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-14 13:00:32.327087: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-14 13:00:32.327111: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-14 13:00:32.327136: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-14 13:00:32.328420: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-14 13:00:32.329430: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-14 13:00:32.329460: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-14 13:00:32.329476: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-14 13:00:32.329490: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-14 13:00:32.329503: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-14 13:00:32.329517: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-14 13:00:32.329531: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-14 13:00:32.329545: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-14 13:00:32.330542: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-14 13:00:32.330569: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-14 13:00:32.330578: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-14 13:00:32.330586: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-14 13:00:32.331633: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5022 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-14 13:00:41.831835: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-14 13:00:41.997307: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-14 13:00:43.525696: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 13:00:43.526282: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 13:00:43.526790: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 13:00:43.527336: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 13:00:43.527842: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 13:00:43.528345: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 13:00:43.528855: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 13:00:43.528893: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-14 13:00:43.529594: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 13:00:43.529613: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-14 13:00:43.536836: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 13:00:43.536874: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-14 13:00:43.537388: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 13:00:43.537405: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-14 13:00:43.543958: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) frolocal folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 6 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 42 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 36 Detection mask done ! Trying to reset tf kernel 2692852 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3911 tf kernel not reseted sub process len(results) : 6 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 6 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5647 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0012624263763427734 nb_pixel_total : 31984 time to create 1 rle with old method : 0.03675484657287598 length of segment : 299 time for calcul the mask position with numpy : 0.0017578601837158203 nb_pixel_total : 50070 time to create 1 rle with old method : 0.05658888816833496 length of segment : 364 time for calcul the mask position with numpy : 0.002418041229248047 nb_pixel_total : 84913 time to create 1 rle with old method : 0.09680843353271484 length of segment : 376 time for calcul the mask position with numpy : 0.0005893707275390625 nb_pixel_total : 30588 time to create 1 rle with old method : 0.03338432312011719 length of segment : 163 time for calcul the mask position with numpy : 0.000667572021484375 nb_pixel_total : 27374 time to create 1 rle with old method : 0.029427766799926758 length of segment : 269 time for calcul the mask position with numpy : 0.0005586147308349609 nb_pixel_total : 22938 time to create 1 rle with old method : 0.02497410774230957 length of segment : 234 time for calcul the mask position with numpy : 0.0005857944488525391 nb_pixel_total : 28128 time to create 1 rle with old method : 0.0313725471496582 length of segment : 143 time for calcul the mask position with numpy : 0.0025873184204101562 nb_pixel_total : 117946 time to create 1 rle with old method : 0.13217449188232422 length of segment : 339 time for calcul the mask position with numpy : 0.0005486011505126953 nb_pixel_total : 17879 time to create 1 rle with old method : 0.01979994773864746 length of segment : 175 time for calcul the mask position with numpy : 0.000751495361328125 nb_pixel_total : 17908 time to create 1 rle with old method : 0.020105361938476562 length of segment : 128 time for calcul the mask position with numpy : 0.00034928321838378906 nb_pixel_total : 17678 time to create 1 rle with old method : 0.020456552505493164 length of segment : 132 time for calcul the mask position with numpy : 0.0010547637939453125 nb_pixel_total : 45773 time to create 1 rle with old method : 0.05218505859375 length of segment : 234 time for calcul the mask position with numpy : 0.002525806427001953 nb_pixel_total : 71952 time to create 1 rle with old method : 0.09580111503601074 length of segment : 546 time for calcul the mask position with numpy : 0.0012454986572265625 nb_pixel_total : 49922 time to create 1 rle with old method : 0.05667686462402344 length of segment : 336 time for calcul the mask position with numpy : 0.0002467632293701172 nb_pixel_total : 12078 time to create 1 rle with old method : 0.018518686294555664 length of segment : 163 time for calcul the mask position with numpy : 0.001873016357421875 nb_pixel_total : 106304 time to create 1 rle with old method : 0.1197659969329834 length of segment : 660 time for calcul the mask position with numpy : 0.0009922981262207031 nb_pixel_total : 44450 time to create 1 rle with old method : 0.05540347099304199 length of segment : 248 time for calcul the mask position with numpy : 0.0009660720825195312 nb_pixel_total : 51302 time to create 1 rle with old method : 0.05919384956359863 length of segment : 302 time for calcul the mask position with numpy : 0.0007226467132568359 nb_pixel_total : 24466 time to create 1 rle with old method : 0.02826690673828125 length of segment : 216 time for calcul the mask position with numpy : 0.0025742053985595703 nb_pixel_total : 86120 time to create 1 rle with old method : 0.0999155044555664 length of segment : 384 time for calcul the mask position with numpy : 0.0006990432739257812 nb_pixel_total : 12736 time to create 1 rle with old method : 0.014757394790649414 length of segment : 195 time for calcul the mask position with numpy : 0.005393266677856445 nb_pixel_total : 37805 time to create 1 rle with old method : 0.04702258110046387 length of segment : 210 time for calcul the mask position with numpy : 0.0007994174957275391 nb_pixel_total : 13350 time to create 1 rle with old method : 0.02199721336364746 length of segment : 192 time for calcul the mask position with numpy : 0.00705265998840332 nb_pixel_total : 20149 time to create 1 rle with old method : 0.02410411834716797 length of segment : 161 time for calcul the mask position with numpy : 0.008216142654418945 nb_pixel_total : 210622 time to create 1 rle with new method : 0.012720108032226562 length of segment : 522 time for calcul the mask position with numpy : 0.00075531005859375 nb_pixel_total : 15720 time to create 1 rle with old method : 0.020370006561279297 length of segment : 143 time for calcul the mask position with numpy : 0.004028797149658203 nb_pixel_total : 72150 time to create 1 rle with old method : 0.09139108657836914 length of segment : 505 time for calcul the mask position with numpy : 0.0005154609680175781 nb_pixel_total : 8895 time to create 1 rle with old method : 0.010655641555786133 length of segment : 117 time for calcul the mask position with numpy : 0.002820253372192383 nb_pixel_total : 46990 time to create 1 rle with old method : 0.055637359619140625 length of segment : 390 time for calcul the mask position with numpy : 0.0009357929229736328 nb_pixel_total : 11357 time to create 1 rle with old method : 0.013651847839355469 length of segment : 187 time for calcul the mask position with numpy : 0.0015316009521484375 nb_pixel_total : 37198 time to create 1 rle with old method : 0.0471804141998291 length of segment : 185 time for calcul the mask position with numpy : 0.0020351409912109375 nb_pixel_total : 49473 time to create 1 rle with old method : 0.05762910842895508 length of segment : 305 time for calcul the mask position with numpy : 0.00553584098815918 nb_pixel_total : 114309 time to create 1 rle with old method : 0.1594679355621338 length of segment : 869 time for calcul the mask position with numpy : 0.0016252994537353516 nb_pixel_total : 28132 time to create 1 rle with old method : 0.03430795669555664 length of segment : 267 time for calcul the mask position with numpy : 0.0012171268463134766 nb_pixel_total : 23754 time to create 1 rle with old method : 0.02789020538330078 length of segment : 185 time for calcul the mask position with numpy : 0.0005617141723632812 nb_pixel_total : 13068 time to create 1 rle with old method : 0.015519142150878906 length of segment : 141 time for calcul the mask position with numpy : 0.0008978843688964844 nb_pixel_total : 21373 time to create 1 rle with old method : 0.02484869956970215 length of segment : 168 time for calcul the mask position with numpy : 0.0011088848114013672 nb_pixel_total : 30108 time to create 1 rle with old method : 0.03494572639465332 length of segment : 224 time for calcul the mask position with numpy : 0.0036194324493408203 nb_pixel_total : 88287 time to create 1 rle with old method : 0.12783265113830566 length of segment : 362 time for calcul the mask position with numpy : 0.006413936614990234 nb_pixel_total : 89437 time to create 1 rle with old method : 0.10332798957824707 length of segment : 668 time for calcul the mask position with numpy : 0.00102996826171875 nb_pixel_total : 15220 time to create 1 rle with old method : 0.01828908920288086 length of segment : 148 time for calcul the mask position with numpy : 0.003576993942260742 nb_pixel_total : 48724 time to create 1 rle with old method : 0.05924105644226074 length of segment : 305 time for calcul the mask position with numpy : 0.0029799938201904297 nb_pixel_total : 46257 time to create 1 rle with old method : 0.09111404418945312 length of segment : 310 time for calcul the mask position with numpy : 0.002371072769165039 nb_pixel_total : 65908 time to create 1 rle with old method : 0.08337664604187012 length of segment : 291 time for calcul the mask position with numpy : 0.0005404949188232422 nb_pixel_total : 5725 time to create 1 rle with old method : 0.009924888610839844 length of segment : 109 time for calcul the mask position with numpy : 0.005606412887573242 nb_pixel_total : 106354 time to create 1 rle with old method : 0.13300251960754395 length of segment : 708 time for calcul the mask position with numpy : 0.0010485649108886719 nb_pixel_total : 17656 time to create 1 rle with old method : 0.02088618278503418 length of segment : 175 time for calcul the mask position with numpy : 0.11165285110473633 nb_pixel_total : 304160 time to create 1 rle with new method : 0.030309677124023438 length of segment : 607 time for calcul the mask position with numpy : 0.0016965866088867188 nb_pixel_total : 45397 time to create 1 rle with old method : 0.052847862243652344 length of segment : 300 time for calcul the mask position with numpy : 0.0021893978118896484 nb_pixel_total : 42417 time to create 1 rle with old method : 0.05001258850097656 length of segment : 301 time for calcul the mask position with numpy : 0.0008261203765869141 nb_pixel_total : 17694 time to create 1 rle with old method : 0.021280765533447266 length of segment : 129 time for calcul the mask position with numpy : 0.0013692378997802734 nb_pixel_total : 28998 time to create 1 rle with old method : 0.03433680534362793 length of segment : 282 time for calcul the mask position with numpy : 0.00511932373046875 nb_pixel_total : 152407 time to create 1 rle with new method : 0.00815439224243164 length of segment : 464 time for calcul the mask position with numpy : 0.0017764568328857422 nb_pixel_total : 49746 time to create 1 rle with old method : 0.0654442310333252 length of segment : 210 time for calcul the mask position with numpy : 0.001361846923828125 nb_pixel_total : 12092 time to create 1 rle with old method : 0.014657020568847656 length of segment : 349 time for calcul the mask position with numpy : 0.0007510185241699219 nb_pixel_total : 25099 time to create 1 rle with old method : 0.030234336853027344 length of segment : 171 time for calcul the mask position with numpy : 0.00025463104248046875 nb_pixel_total : 7282 time to create 1 rle with old method : 0.008984565734863281 length of segment : 77 time for calcul the mask position with numpy : 0.0051212310791015625 nb_pixel_total : 161311 time to create 1 rle with new method : 0.01409292221069336 length of segment : 554 time for calcul the mask position with numpy : 0.000499725341796875 nb_pixel_total : 28052 time to create 1 rle with old method : 0.04039192199707031 length of segment : 153 time for calcul the mask position with numpy : 0.0011949539184570312 nb_pixel_total : 29304 time to create 1 rle with old method : 0.04669070243835449 length of segment : 214 time for calcul the mask position with numpy : 0.005767822265625 nb_pixel_total : 199360 time to create 1 rle with new method : 0.015837669372558594 length of segment : 855 time for calcul the mask position with numpy : 0.004462242126464844 nb_pixel_total : 106369 time to create 1 rle with old method : 0.12425994873046875 length of segment : 525 time for calcul the mask position with numpy : 0.001264333724975586 nb_pixel_total : 30055 time to create 1 rle with old method : 0.034935951232910156 length of segment : 184 time for calcul the mask position with numpy : 0.0012395381927490234 nb_pixel_total : 26887 time to create 1 rle with old method : 0.03164482116699219 length of segment : 263 time for calcul the mask position with numpy : 0.0043604373931884766 nb_pixel_total : 127449 time to create 1 rle with old method : 0.14551854133605957 length of segment : 385 time for calcul the mask position with numpy : 0.0019249916076660156 nb_pixel_total : 48715 time to create 1 rle with old method : 0.05449366569519043 length of segment : 338 time for calcul the mask position with numpy : 0.0021283626556396484 nb_pixel_total : 53534 time to create 1 rle with old method : 0.06133151054382324 length of segment : 377 time for calcul the mask position with numpy : 0.017144203186035156 nb_pixel_total : 350051 time to create 1 rle with new method : 0.025731563568115234 length of segment : 805 time for calcul the mask position with numpy : 0.0037763118743896484 nb_pixel_total : 50308 time to create 1 rle with old method : 0.058916568756103516 length of segment : 488 time for calcul the mask position with numpy : 0.0028569698333740234 nb_pixel_total : 75657 time to create 1 rle with old method : 0.09018182754516602 length of segment : 454 time for calcul the mask position with numpy : 0.0018808841705322266 nb_pixel_total : 48851 time to create 1 rle with old method : 0.05624198913574219 length of segment : 355 time for calcul the mask position with numpy : 0.006164073944091797 nb_pixel_total : 188967 time to create 1 rle with new method : 0.012262821197509766 length of segment : 509 time for calcul the mask position with numpy : 0.0021309852600097656 nb_pixel_total : 48893 time to create 1 rle with old method : 0.056235551834106445 length of segment : 279 time for calcul the mask position with numpy : 0.002238750457763672 nb_pixel_total : 54094 time to create 1 rle with old method : 0.06486296653747559 length of segment : 357 time for calcul the mask position with numpy : 0.0005362033843994141 nb_pixel_total : 22128 time to create 1 rle with old method : 0.02553272247314453 length of segment : 172 time for calcul the mask position with numpy : 0.0011138916015625 nb_pixel_total : 16500 time to create 1 rle with old method : 0.02101588249206543 length of segment : 121 time for calcul the mask position with numpy : 0.0010039806365966797 nb_pixel_total : 40855 time to create 1 rle with old method : 0.04748392105102539 length of segment : 232 time for calcul the mask position with numpy : 0.001983165740966797 nb_pixel_total : 45396 time to create 1 rle with old method : 0.05340933799743652 length of segment : 207 time for calcul the mask position with numpy : 0.0021114349365234375 nb_pixel_total : 77824 time to create 1 rle with old method : 0.08914351463317871 length of segment : 304 time for calcul the mask position with numpy : 0.005026340484619141 nb_pixel_total : 143989 time to create 1 rle with old method : 0.16802120208740234 length of segment : 518 time for calcul the mask position with numpy : 0.0009963512420654297 nb_pixel_total : 39462 time to create 1 rle with old method : 0.06346774101257324 length of segment : 281 time for calcul the mask position with numpy : 0.0026497840881347656 nb_pixel_total : 55087 time to create 1 rle with old method : 0.0629267692565918 length of segment : 519 time for calcul the mask position with numpy : 0.0016236305236816406 nb_pixel_total : 29508 time to create 1 rle with old method : 0.0335695743560791 length of segment : 280 time for calcul the mask position with numpy : 0.004022359848022461 nb_pixel_total : 123137 time to create 1 rle with old method : 0.1400444507598877 length of segment : 502 time for calcul the mask position with numpy : 0.0063893795013427734 nb_pixel_total : 169987 time to create 1 rle with new method : 0.012771368026733398 length of segment : 489 time for calcul the mask position with numpy : 0.009975433349609375 nb_pixel_total : 338380 time to create 1 rle with new method : 0.030037879943847656 length of segment : 754 time for calcul the mask position with numpy : 0.0010256767272949219 nb_pixel_total : 26093 time to create 1 rle with old method : 0.030315637588500977 length of segment : 215 time for calcul the mask position with numpy : 0.0032958984375 nb_pixel_total : 81365 time to create 1 rle with old method : 0.09395194053649902 length of segment : 317 time for calcul the mask position with numpy : 0.0025959014892578125 nb_pixel_total : 64390 time to create 1 rle with old method : 0.07331204414367676 length of segment : 346 time for calcul the mask position with numpy : 0.002100706100463867 nb_pixel_total : 46148 time to create 1 rle with old method : 0.05306649208068848 length of segment : 351 time for calcul the mask position with numpy : 0.0043599605560302734 nb_pixel_total : 31078 time to create 1 rle with old method : 0.036746978759765625 length of segment : 424 time for calcul the mask position with numpy : 0.0038204193115234375 nb_pixel_total : 102392 time to create 1 rle with old method : 0.11723136901855469 length of segment : 375 time for calcul the mask position with numpy : 0.004807472229003906 nb_pixel_total : 132698 time to create 1 rle with old method : 0.1543717384338379 length of segment : 397 time for calcul the mask position with numpy : 0.0016148090362548828 nb_pixel_total : 41751 time to create 1 rle with old method : 0.05138802528381348 length of segment : 234 time for calcul the mask position with numpy : 0.002440929412841797 nb_pixel_total : 59574 time to create 1 rle with old method : 0.0735635757446289 length of segment : 392 time for calcul the mask position with numpy : 0.0050258636474609375 nb_pixel_total : 140344 time to create 1 rle with old method : 0.1590278148651123 length of segment : 542 time for calcul the mask position with numpy : 0.0023717880249023438 nb_pixel_total : 54381 time to create 1 rle with old method : 0.06338810920715332 length of segment : 386 time for calcul the mask position with numpy : 0.0021979808807373047 nb_pixel_total : 55826 time to create 1 rle with old method : 0.06747698783874512 length of segment : 388 time for calcul the mask position with numpy : 0.00032782554626464844 nb_pixel_total : 14254 time to create 1 rle with old method : 0.016812801361083984 length of segment : 212 time for calcul the mask position with numpy : 0.0017609596252441406 nb_pixel_total : 36289 time to create 1 rle with old method : 0.057706594467163086 length of segment : 264 time for calcul the mask position with numpy : 0.0013477802276611328 nb_pixel_total : 19642 time to create 1 rle with old method : 0.025251388549804688 length of segment : 149 time for calcul the mask position with numpy : 0.0006277561187744141 nb_pixel_total : 16176 time to create 1 rle with old method : 0.01915574073791504 length of segment : 170 time for calcul the mask position with numpy : 0.004375457763671875 nb_pixel_total : 100707 time to create 1 rle with old method : 0.12708067893981934 length of segment : 428 time for calcul the mask position with numpy : 0.0033652782440185547 nb_pixel_total : 79983 time to create 1 rle with old method : 0.09405040740966797 length of segment : 412 time for calcul the mask position with numpy : 0.00047469139099121094 nb_pixel_total : 24007 time to create 1 rle with old method : 0.02905869483947754 length of segment : 192 time for calcul the mask position with numpy : 0.002298593521118164 nb_pixel_total : 40220 time to create 1 rle with old method : 0.047449588775634766 length of segment : 351 time for calcul the mask position with numpy : 0.002855062484741211 nb_pixel_total : 75101 time to create 1 rle with old method : 0.11024117469787598 length of segment : 256 time for calcul the mask position with numpy : 0.004536151885986328 nb_pixel_total : 137961 time to create 1 rle with old method : 0.16124749183654785 length of segment : 442 time for calcul the mask position with numpy : 0.0011746883392333984 nb_pixel_total : 35918 time to create 1 rle with old method : 0.04173541069030762 length of segment : 243 time for calcul the mask position with numpy : 0.006528139114379883 nb_pixel_total : 188238 time to create 1 rle with new method : 0.012289047241210938 length of segment : 561 time for calcul the mask position with numpy : 0.0009639263153076172 nb_pixel_total : 25727 time to create 1 rle with old method : 0.0325927734375 length of segment : 242 time for calcul the mask position with numpy : 0.005595684051513672 nb_pixel_total : 81012 time to create 1 rle with old method : 0.10490179061889648 length of segment : 607 time for calcul the mask position with numpy : 0.001617431640625 nb_pixel_total : 37551 time to create 1 rle with old method : 0.044246673583984375 length of segment : 290 time for calcul the mask position with numpy : 0.0003883838653564453 nb_pixel_total : 9176 time to create 1 rle with old method : 0.011269569396972656 length of segment : 83 time for calcul the mask position with numpy : 0.0017414093017578125 nb_pixel_total : 40581 time to create 1 rle with old method : 0.04709982872009277 length of segment : 252 time for calcul the mask position with numpy : 0.0028421878814697266 nb_pixel_total : 85294 time to create 1 rle with old method : 0.10354280471801758 length of segment : 422 time for calcul the mask position with numpy : 0.0012700557708740234 nb_pixel_total : 30620 time to create 1 rle with old method : 0.036179304122924805 length of segment : 211 time for calcul the mask position with numpy : 0.0009703636169433594 nb_pixel_total : 23102 time to create 1 rle with old method : 0.03342580795288086 length of segment : 155 time for calcul the mask position with numpy : 0.0008618831634521484 nb_pixel_total : 29098 time to create 1 rle with old method : 0.03637266159057617 length of segment : 241 time for calcul the mask position with numpy : 0.0032958984375 nb_pixel_total : 59207 time to create 1 rle with old method : 0.0937337875366211 length of segment : 365 time for calcul the mask position with numpy : 0.003561258316040039 nb_pixel_total : 103434 time to create 1 rle with old method : 0.1197199821472168 length of segment : 379 time for calcul the mask position with numpy : 0.0033431053161621094 nb_pixel_total : 63353 time to create 1 rle with old method : 0.07308745384216309 length of segment : 754 time for calcul the mask position with numpy : 0.0005316734313964844 nb_pixel_total : 21910 time to create 1 rle with old method : 0.026909589767456055 length of segment : 237 time for calcul the mask position with numpy : 0.0062103271484375 nb_pixel_total : 139894 time to create 1 rle with old method : 0.16448450088500977 length of segment : 734 time for calcul the mask position with numpy : 0.0010154247283935547 nb_pixel_total : 18245 time to create 1 rle with old method : 0.024813175201416016 length of segment : 243 time for calcul the mask position with numpy : 0.002544879913330078 nb_pixel_total : 65496 time to create 1 rle with old method : 0.07652020454406738 length of segment : 363 time for calcul the mask position with numpy : 0.0066852569580078125 nb_pixel_total : 165929 time to create 1 rle with new method : 0.012601375579833984 length of segment : 680 time for calcul the mask position with numpy : 0.0024309158325195312 nb_pixel_total : 75922 time to create 1 rle with old method : 0.08771800994873047 length of segment : 226 time spent for convertir_results : 14.335615873336792 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 128 chid ids of type : 3594 Number RLEs to save : 42648 save missing photos in datou_result : time spend for datou_step_exec : 68.28457713127136 time spend to save output : 3.913541793823242 total time spend for step 1 : 72.1981189250946 step2:crop_condition Wed May 14 13:01:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 6 ! batch 1 Loaded 128 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 112 About to insert : list_path_to_insert length 112 new photo from crops ! About to upload 112 photos upload in portfolio : 3736932 init cache_photo without model_param we have 112 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747220536_2691911 we have uploaded 112 photos in the portfolio 3736932 time of upload the photos Elapsed time : 27.030808687210083 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 3736932 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747220567_2691911 we have uploaded 12 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.072828531265259 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747220571_2691911 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7434518337249756 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747220573_2691911 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.48888325691223145 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747220576_2691911 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0202319622039795 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1358156702, 1358156671, 1358156636, 1358156579, 1358156514, 1358156068] Looping around the photos to save general results len do output : 128 /1358180941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358180999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358181304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156702', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156671', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156636', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156579', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156514', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156068', None, None, None, None, None, '2848510') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 390 time used for this insertion : 0.05445456504821777 save_final save missing photos in datou_result : time spend for datou_step_exec : 75.7927098274231 time spend to save output : 0.05835700035095215 total time spend for step 2 : 75.85106682777405 step3:rle_unique_nms_with_priority Wed May 14 13:02:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 128 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 11.38210415840149 time for calcul the mask position with numpy : 1.5570149421691895 nb_pixel_total : 7440748 time to create 1 rle with new method : 1.3228094577789307 time for calcul the mask position with numpy : 0.024128198623657227 nb_pixel_total : 24466 time to create 1 rle with old method : 0.027461767196655273 time for calcul the mask position with numpy : 0.023998022079467773 nb_pixel_total : 51301 time to create 1 rle with old method : 0.05642127990722656 time for calcul the mask position with numpy : 0.023875951766967773 nb_pixel_total : 44450 time to create 1 rle with old method : 0.048200130462646484 time for calcul the mask position with numpy : 0.024775981903076172 nb_pixel_total : 106304 time to create 1 rle with old method : 0.11780810356140137 time for calcul the mask position with numpy : 0.022984743118286133 nb_pixel_total : 12078 time to create 1 rle with old method : 0.013700485229492188 time for calcul the mask position with numpy : 0.0235595703125 nb_pixel_total : 49922 time to create 1 rle with old method : 0.057271718978881836 time for calcul the mask position with numpy : 0.0262908935546875 nb_pixel_total : 71952 time to create 1 rle with old method : 0.08155369758605957 time for calcul the mask position with numpy : 0.024910926818847656 nb_pixel_total : 45773 time to create 1 rle with old method : 0.051259756088256836 time for calcul the mask position with numpy : 0.024549007415771484 nb_pixel_total : 17678 time to create 1 rle with old method : 0.019862651824951172 time for calcul the mask position with numpy : 0.02437734603881836 nb_pixel_total : 17908 time to create 1 rle with old method : 0.020186662673950195 time for calcul the mask position with numpy : 0.02523970603942871 nb_pixel_total : 17879 time to create 1 rle with old method : 0.020507097244262695 time for calcul the mask position with numpy : 0.025358915328979492 nb_pixel_total : 117946 time to create 1 rle with old method : 0.13113617897033691 time for calcul the mask position with numpy : 0.024492502212524414 nb_pixel_total : 28128 time to create 1 rle with old method : 0.03197503089904785 time for calcul the mask position with numpy : 0.023967981338500977 nb_pixel_total : 22938 time to create 1 rle with old method : 0.025202274322509766 time for calcul the mask position with numpy : 0.024790287017822266 nb_pixel_total : 27374 time to create 1 rle with old method : 0.02989363670349121 time for calcul the mask position with numpy : 0.025131940841674805 nb_pixel_total : 30588 time to create 1 rle with old method : 0.03452301025390625 time for calcul the mask position with numpy : 0.02485179901123047 nb_pixel_total : 84913 time to create 1 rle with old method : 0.09576821327209473 time for calcul the mask position with numpy : 0.025411605834960938 nb_pixel_total : 50070 time to create 1 rle with old method : 0.05722522735595703 time for calcul the mask position with numpy : 0.025075674057006836 nb_pixel_total : 31984 time to create 1 rle with old method : 0.03541398048400879 create new chi : 4.339921236038208 time to delete rle : 0.02247166633605957 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 12814 TO DO : save crop sub photo not yet done ! save time : 0.79437255859375 nb_obj : 26 nb_hashtags : 3 time to prepare the origin masks : 4.365687370300293 time for calcul the mask position with numpy : 0.7876811027526855 nb_pixel_total : 7089875 time to create 1 rle with new method : 0.9303662776947021 time for calcul the mask position with numpy : 0.03371071815490723 nb_pixel_total : 49473 time to create 1 rle with old method : 0.05602407455444336 time for calcul the mask position with numpy : 0.03383803367614746 nb_pixel_total : 46990 time to create 1 rle with old method : 0.05128359794616699 time for calcul the mask position with numpy : 0.0333867073059082 nb_pixel_total : 72150 time to create 1 rle with old method : 0.07812929153442383 time for calcul the mask position with numpy : 0.03280162811279297 nb_pixel_total : 27854 time to create 1 rle with old method : 0.030525684356689453 time for calcul the mask position with numpy : 0.03209185600280762 nb_pixel_total : 12736 time to create 1 rle with old method : 0.013816356658935547 time for calcul the mask position with numpy : 0.032579898834228516 nb_pixel_total : 88287 time to create 1 rle with old method : 0.09758639335632324 time for calcul the mask position with numpy : 0.033109426498413086 nb_pixel_total : 65553 time to create 1 rle with old method : 0.07368731498718262 time for calcul the mask position with numpy : 0.03282475471496582 nb_pixel_total : 15720 time to create 1 rle with old method : 0.01781606674194336 time for calcul the mask position with numpy : 0.03224635124206543 nb_pixel_total : 11357 time to create 1 rle with old method : 0.01256108283996582 time for calcul the mask position with numpy : 0.03299736976623535 nb_pixel_total : 13068 time to create 1 rle with old method : 0.014765262603759766 time for calcul the mask position with numpy : 0.03290367126464844 nb_pixel_total : 210622 time to create 1 rle with new method : 0.8803665637969971 time for calcul the mask position with numpy : 0.034322500228881836 nb_pixel_total : 37805 time to create 1 rle with old method : 0.04359841346740723 time for calcul the mask position with numpy : 0.03343963623046875 nb_pixel_total : 5725 time to create 1 rle with old method : 0.0063898563385009766 time for calcul the mask position with numpy : 0.03282332420349121 nb_pixel_total : 15220 time to create 1 rle with old method : 0.017368316650390625 time for calcul the mask position with numpy : 0.03313851356506348 nb_pixel_total : 8895 time to create 1 rle with old method : 0.010097026824951172 time for calcul the mask position with numpy : 0.033478498458862305 nb_pixel_total : 86120 time to create 1 rle with old method : 0.0967552661895752 time for calcul the mask position with numpy : 0.033184051513671875 nb_pixel_total : 89437 time to create 1 rle with old method : 0.09857964515686035 time for calcul the mask position with numpy : 0.03283548355102539 nb_pixel_total : 106927 time to create 1 rle with old method : 0.11943435668945312 time for calcul the mask position with numpy : 0.03230929374694824 nb_pixel_total : 21373 time to create 1 rle with old method : 0.024106979370117188 time for calcul the mask position with numpy : 0.034665584564208984 nb_pixel_total : 20149 time to create 1 rle with old method : 0.03267502784729004 time for calcul the mask position with numpy : 0.03871941566467285 nb_pixel_total : 30108 time to create 1 rle with old method : 0.03438377380371094 time for calcul the mask position with numpy : 0.032839298248291016 nb_pixel_total : 45930 time to create 1 rle with old method : 0.050519704818725586 time for calcul the mask position with numpy : 0.03309273719787598 nb_pixel_total : 23754 time to create 1 rle with old method : 0.02736949920654297 time for calcul the mask position with numpy : 0.032659292221069336 nb_pixel_total : 13350 time to create 1 rle with old method : 0.014647960662841797 time for calcul the mask position with numpy : 0.03363990783691406 nb_pixel_total : 37198 time to create 1 rle with old method : 0.04247736930847168 time for calcul the mask position with numpy : 0.03330349922180176 nb_pixel_total : 48724 time to create 1 rle with old method : 0.05596113204956055 create new chi : 4.656617879867554 time to delete rle : 0.003535032272338867 batch 1 Loaded 53 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++Number RLEs to save : 16855 TO DO : save crop sub photo not yet done ! save time : 1.0909864902496338 nb_obj : 17 nb_hashtags : 2 time to prepare the origin masks : 9.909122467041016 time for calcul the mask position with numpy : 1.0596470832824707 nb_pixel_total : 6979890 time to create 1 rle with new method : 1.3997924327850342 time for calcul the mask position with numpy : 0.04065108299255371 nb_pixel_total : 104601 time to create 1 rle with old method : 0.11904048919677734 time for calcul the mask position with numpy : 0.04263925552368164 nb_pixel_total : 194318 time to create 1 rle with new method : 1.1474084854125977 time for calcul the mask position with numpy : 0.039948463439941406 nb_pixel_total : 29304 time to create 1 rle with old method : 0.035803794860839844 time for calcul the mask position with numpy : 0.04604172706604004 nb_pixel_total : 27754 time to create 1 rle with old method : 0.04176688194274902 time for calcul the mask position with numpy : 0.04094529151916504 nb_pixel_total : 149231 time to create 1 rle with old method : 0.1726078987121582 time for calcul the mask position with numpy : 0.04048323631286621 nb_pixel_total : 7282 time to create 1 rle with old method : 0.008787393569946289 time for calcul the mask position with numpy : 0.04044032096862793 nb_pixel_total : 25099 time to create 1 rle with old method : 0.028769254684448242 time for calcul the mask position with numpy : 0.03946828842163086 nb_pixel_total : 12092 time to create 1 rle with old method : 0.01436758041381836 time for calcul the mask position with numpy : 0.040801286697387695 nb_pixel_total : 49746 time to create 1 rle with old method : 0.05740976333618164 time for calcul the mask position with numpy : 0.04224276542663574 nb_pixel_total : 152407 time to create 1 rle with new method : 1.3746874332427979 time for calcul the mask position with numpy : 0.03890419006347656 nb_pixel_total : 28998 time to create 1 rle with old method : 0.03215217590332031 time for calcul the mask position with numpy : 0.03316950798034668 nb_pixel_total : 17694 time to create 1 rle with old method : 0.02046966552734375 time for calcul the mask position with numpy : 0.027284860610961914 nb_pixel_total : 42417 time to create 1 rle with old method : 0.04726409912109375 time for calcul the mask position with numpy : 0.024585962295532227 nb_pixel_total : 45397 time to create 1 rle with old method : 0.04893636703491211 time for calcul the mask position with numpy : 0.02693915367126465 nb_pixel_total : 304160 time to create 1 rle with new method : 1.1222155094146729 time for calcul the mask position with numpy : 0.026398897171020508 nb_pixel_total : 17656 time to create 1 rle with old method : 0.019896507263183594 time for calcul the mask position with numpy : 0.025813817977905273 nb_pixel_total : 106354 time to create 1 rle with old method : 0.1473984718322754 create new chi : 7.632292985916138 time to delete rle : 0.002861499786376953 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 13875 TO DO : save crop sub photo not yet done ! save time : 0.9267401695251465 nb_obj : 20 nb_hashtags : 2 time to prepare the origin masks : 11.447138547897339 time for calcul the mask position with numpy : 0.8161880970001221 nb_pixel_total : 6749698 time to create 1 rle with new method : 1.711958646774292 time for calcul the mask position with numpy : 0.0348358154296875 nb_pixel_total : 55087 time to create 1 rle with old method : 0.06290841102600098 time for calcul the mask position with numpy : 0.024572372436523438 nb_pixel_total : 39462 time to create 1 rle with old method : 0.04483461380004883 time for calcul the mask position with numpy : 0.026436328887939453 nb_pixel_total : 143989 time to create 1 rle with old method : 0.1625514030456543 time for calcul the mask position with numpy : 0.024143218994140625 nb_pixel_total : 77824 time to create 1 rle with old method : 0.09206438064575195 time for calcul the mask position with numpy : 0.025437355041503906 nb_pixel_total : 45396 time to create 1 rle with old method : 0.051944732666015625 time for calcul the mask position with numpy : 0.025671005249023438 nb_pixel_total : 40855 time to create 1 rle with old method : 0.04603934288024902 time for calcul the mask position with numpy : 0.024142742156982422 nb_pixel_total : 16500 time to create 1 rle with old method : 0.01910233497619629 time for calcul the mask position with numpy : 0.024165630340576172 nb_pixel_total : 22128 time to create 1 rle with old method : 0.02461099624633789 time for calcul the mask position with numpy : 0.02436971664428711 nb_pixel_total : 54094 time to create 1 rle with old method : 0.05988645553588867 time for calcul the mask position with numpy : 0.024335384368896484 nb_pixel_total : 48893 time to create 1 rle with old method : 0.05290031433105469 time for calcul the mask position with numpy : 0.025741100311279297 nb_pixel_total : 188967 time to create 1 rle with new method : 1.138895034790039 time for calcul the mask position with numpy : 0.025254487991333008 nb_pixel_total : 48851 time to create 1 rle with old method : 0.05688977241516113 time for calcul the mask position with numpy : 0.02784252166748047 nb_pixel_total : 75657 time to create 1 rle with old method : 0.0870366096496582 time for calcul the mask position with numpy : 0.025191545486450195 nb_pixel_total : 50308 time to create 1 rle with old method : 0.0565488338470459 time for calcul the mask position with numpy : 0.028328657150268555 nb_pixel_total : 350051 time to create 1 rle with new method : 1.0708208084106445 time for calcul the mask position with numpy : 0.023929834365844727 nb_pixel_total : 53534 time to create 1 rle with old method : 0.059007883071899414 time for calcul the mask position with numpy : 0.024890661239624023 nb_pixel_total : 48715 time to create 1 rle with old method : 0.052786827087402344 time for calcul the mask position with numpy : 0.02423858642578125 nb_pixel_total : 127449 time to create 1 rle with old method : 0.1412363052368164 time for calcul the mask position with numpy : 0.025484561920166016 nb_pixel_total : 26887 time to create 1 rle with old method : 0.02948927879333496 time for calcul the mask position with numpy : 0.024126291275024414 nb_pixel_total : 30055 time to create 1 rle with old method : 0.03293466567993164 create new chi : 6.480525493621826 time to delete rle : 0.002239227294921875 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 16456 TO DO : save crop sub photo not yet done ! save time : 0.997586727142334 nb_obj : 24 nb_hashtags : 2 time to prepare the origin masks : 15.384892225265503 time for calcul the mask position with numpy : 0.7579026222229004 nb_pixel_total : 6466671 time to create 1 rle with new method : 2.6897943019866943 time for calcul the mask position with numpy : 0.038762807846069336 nb_pixel_total : 40220 time to create 1 rle with old method : 0.043589115142822266 time for calcul the mask position with numpy : 0.025347471237182617 nb_pixel_total : 24007 time to create 1 rle with old method : 0.027115345001220703 time for calcul the mask position with numpy : 0.02457571029663086 nb_pixel_total : 79983 time to create 1 rle with old method : 0.08851385116577148 time for calcul the mask position with numpy : 0.025411128997802734 nb_pixel_total : 100707 time to create 1 rle with old method : 0.11440634727478027 time for calcul the mask position with numpy : 0.02418208122253418 nb_pixel_total : 16176 time to create 1 rle with old method : 0.0176389217376709 time for calcul the mask position with numpy : 0.024155616760253906 nb_pixel_total : 19642 time to create 1 rle with old method : 0.02126622200012207 time for calcul the mask position with numpy : 0.022964954376220703 nb_pixel_total : 36289 time to create 1 rle with old method : 0.03922414779663086 time for calcul the mask position with numpy : 0.023436784744262695 nb_pixel_total : 13728 time to create 1 rle with old method : 0.015456676483154297 time for calcul the mask position with numpy : 0.0247037410736084 nb_pixel_total : 55826 time to create 1 rle with old method : 0.06408405303955078 time for calcul the mask position with numpy : 0.024865150451660156 nb_pixel_total : 54381 time to create 1 rle with old method : 0.059191226959228516 time for calcul the mask position with numpy : 0.02609729766845703 nb_pixel_total : 140344 time to create 1 rle with old method : 0.1628704071044922 time for calcul the mask position with numpy : 0.02504873275756836 nb_pixel_total : 59574 time to create 1 rle with old method : 0.06638455390930176 time for calcul the mask position with numpy : 0.029135465621948242 nb_pixel_total : 41751 time to create 1 rle with old method : 0.05142331123352051 time for calcul the mask position with numpy : 0.025006771087646484 nb_pixel_total : 132623 time to create 1 rle with old method : 0.14797115325927734 time for calcul the mask position with numpy : 0.026382923126220703 nb_pixel_total : 102392 time to create 1 rle with old method : 0.11924004554748535 time for calcul the mask position with numpy : 0.025608539581298828 nb_pixel_total : 31078 time to create 1 rle with old method : 0.03588724136352539 time for calcul the mask position with numpy : 0.026378393173217773 nb_pixel_total : 46148 time to create 1 rle with old method : 0.05432581901550293 time for calcul the mask position with numpy : 0.02987074851989746 nb_pixel_total : 64390 time to create 1 rle with old method : 0.07605242729187012 time for calcul the mask position with numpy : 0.029700517654418945 nb_pixel_total : 81365 time to create 1 rle with old method : 0.10744071006774902 time for calcul the mask position with numpy : 0.025153636932373047 nb_pixel_total : 26093 time to create 1 rle with old method : 0.02919626235961914 time for calcul the mask position with numpy : 0.02627730369567871 nb_pixel_total : 338380 time to create 1 rle with new method : 0.8834221363067627 time for calcul the mask position with numpy : 0.026251554489135742 nb_pixel_total : 169987 time to create 1 rle with new method : 2.24741268157959 time for calcul the mask position with numpy : 0.02631545066833496 nb_pixel_total : 123137 time to create 1 rle with old method : 0.14107513427734375 time for calcul the mask position with numpy : 0.02460336685180664 nb_pixel_total : 29508 time to create 1 rle with old method : 0.035880327224731445 create new chi : 8.821293830871582 time to delete rle : 0.005751848220825195 batch 1 Loaded 49 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++Number RLEs to save : 19228 TO DO : save crop sub photo not yet done ! save time : 1.252619981765747 nb_obj : 22 nb_hashtags : 2 time to prepare the origin masks : 14.630990743637085 time for calcul the mask position with numpy : 0.596630334854126 nb_pixel_total : 6854035 time to create 1 rle with new method : 1.7247142791748047 time for calcul the mask position with numpy : 0.04035687446594238 nb_pixel_total : 75922 time to create 1 rle with old method : 0.08550381660461426 time for calcul the mask position with numpy : 0.042656898498535156 nb_pixel_total : 105112 time to create 1 rle with old method : 0.1280813217163086 time for calcul the mask position with numpy : 0.047606468200683594 nb_pixel_total : 65496 time to create 1 rle with old method : 0.09131836891174316 time for calcul the mask position with numpy : 0.046447038650512695 nb_pixel_total : 18245 time to create 1 rle with old method : 0.02125835418701172 time for calcul the mask position with numpy : 0.04144001007080078 nb_pixel_total : 128829 time to create 1 rle with old method : 0.14846515655517578 time for calcul the mask position with numpy : 0.040105581283569336 nb_pixel_total : 21388 time to create 1 rle with old method : 0.02441716194152832 time for calcul the mask position with numpy : 0.04089975357055664 nb_pixel_total : 63353 time to create 1 rle with old method : 0.07254552841186523 time for calcul the mask position with numpy : 0.044812679290771484 nb_pixel_total : 103434 time to create 1 rle with old method : 0.11786508560180664 time for calcul the mask position with numpy : 0.040181636810302734 nb_pixel_total : 59207 time to create 1 rle with old method : 0.0677652359008789 time for calcul the mask position with numpy : 0.03866004943847656 nb_pixel_total : 29098 time to create 1 rle with old method : 0.03310108184814453 time for calcul the mask position with numpy : 0.03777122497558594 nb_pixel_total : 23102 time to create 1 rle with old method : 0.0257723331451416 time for calcul the mask position with numpy : 0.03894925117492676 nb_pixel_total : 30620 time to create 1 rle with old method : 0.036893367767333984 time for calcul the mask position with numpy : 0.03533816337585449 nb_pixel_total : 85294 time to create 1 rle with old method : 0.09504246711730957 time for calcul the mask position with numpy : 0.02730560302734375 nb_pixel_total : 40581 time to create 1 rle with old method : 0.05011916160583496 time for calcul the mask position with numpy : 0.026316404342651367 nb_pixel_total : 9176 time to create 1 rle with old method : 0.010621070861816406 time for calcul the mask position with numpy : 0.02624654769897461 nb_pixel_total : 37551 time to create 1 rle with old method : 0.04330945014953613 time for calcul the mask position with numpy : 0.03156018257141113 nb_pixel_total : 81012 time to create 1 rle with old method : 0.09095454216003418 time for calcul the mask position with numpy : 0.0277252197265625 nb_pixel_total : 25727 time to create 1 rle with old method : 0.02946329116821289 time for calcul the mask position with numpy : 0.026378631591796875 nb_pixel_total : 188238 time to create 1 rle with new method : 1.058603048324585 time for calcul the mask position with numpy : 0.024956941604614258 nb_pixel_total : 35918 time to create 1 rle with old method : 0.04026317596435547 time for calcul the mask position with numpy : 0.025438547134399414 nb_pixel_total : 137961 time to create 1 rle with old method : 0.1536729335784912 time for calcul the mask position with numpy : 0.028630495071411133 nb_pixel_total : 75101 time to create 1 rle with old method : 0.1121060848236084 create new chi : 5.708268880844116 time to delete rle : 0.0038902759552001953 batch 1 Loaded 45 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 17510 TO DO : save crop sub photo not yet done ! save time : 1.0541200637817383 map_output_result : {1358156702: (0.0, 'Should be the crop_list due to order', 0), 1358156671: (0.0, 'Should be the crop_list due to order', 0), 1358156636: (0.0, 'Should be the crop_list due to order', 0), 1358156579: (0.0, 'Should be the crop_list due to order', 0), 1358156514: (0.0, 'Should be the crop_list due to order', 0), 1358156068: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1358156702, 1358156671, 1358156636, 1358156579, 1358156514, 1358156068] Looping around the photos to save general results len do output : 6 /1358156702.Didn't retrieve data . /1358156671.Didn't retrieve data . /1358156636.Didn't retrieve data . /1358156579.Didn't retrieve data . /1358156514.Didn't retrieve data . /1358156068.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156702', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156671', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156636', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156579', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156514', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156068', None, None, None, None, None, '2848510') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.011478900909423828 save_final save missing photos in datou_result : time spend for datou_step_exec : 112.40973258018494 time spend to save output : 0.011904716491699219 total time spend for step 3 : 112.42163729667664 step4:ventilate_hashtags_in_portfolio Wed May 14 13:04:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22960477 get user id for portfolio 22960477 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22960477 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pehd','autre','mal_croppe','pet_clair','carton','background','environnement','flou','papier','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22960477 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pehd','autre','mal_croppe','pet_clair','carton','background','environnement','flou','papier','pet_fonce')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22960477 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pehd','autre','mal_croppe','pet_clair','carton','background','environnement','flou','papier','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22961554,22961555,22961556,22961557,22961558,22961559,22961560,22961561,22961562,22961563,22961564?tags=metal,pehd,autre,mal_croppe,pet_clair,carton,background,environnement,flou,papier,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1358156702, 1358156671, 1358156636, 1358156579, 1358156514, 1358156068] Looping around the photos to save general results len do output : 1 /22960477. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156702', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156671', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156636', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156579', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156514', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156068', None, None, None, None, None, '2848510') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.014358282089233398 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5736782550811768 time spend to save output : 0.014622688293457031 total time spend for step 4 : 1.5883009433746338 step5:final Wed May 14 13:04:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1358156702: ('0.16447810169110086',), 1358156671: ('0.16447810169110086',), 1358156636: ('0.16447810169110086',), 1358156579: ('0.16447810169110086',), 1358156514: ('0.16447810169110086',), 1358156068: ('0.16447810169110086',)} new output for save of step final : {1358156702: ('0.16447810169110086',), 1358156671: ('0.16447810169110086',), 1358156636: ('0.16447810169110086',), 1358156579: ('0.16447810169110086',), 1358156514: ('0.16447810169110086',), 1358156068: ('0.16447810169110086',)} [1358156702, 1358156671, 1358156636, 1358156579, 1358156514, 1358156068] Looping around the photos to save general results len do output : 6 /1358156702.Didn't retrieve data . /1358156671.Didn't retrieve data . /1358156636.Didn't retrieve data . /1358156579.Didn't retrieve data . /1358156514.Didn't retrieve data . /1358156068.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156702', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156671', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156636', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156579', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156514', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156068', None, None, None, None, None, '2848510') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.012873172760009766 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13231205940246582 time spend to save output : 0.013251066207885742 total time spend for step 5 : 0.14556312561035156 step6:blur_detection Wed May 14 13:04:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb.jpg resize: (2160, 3840) 1358156702 -5.984537885348072 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da.jpg resize: (2160, 3840) 1358156671 -5.923937210296091 treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99.jpg resize: (2160, 3840) 1358156636 -6.478584066377382 treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250.jpg resize: (2160, 3840) 1358156579 -6.681899398548661 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41.jpg resize: (2160, 3840) 1358156514 -6.7600201187836575 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1.jpg resize: (2160, 3840) 1358156068 -5.9156614828984875 treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047053_0.png resize: (173, 121) 1358180941 -1.5784652105136525 treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047058_0.png resize: (307, 247) 1358180942 -3.6535007297809714 treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047063_0.png resize: (201, 184) 1358180944 2.765378557521142 treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047057_0.png resize: (384, 425) 1358180946 -3.2004171460283 treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047048_0.png resize: (163, 240) 1358180947 -4.030143134611996 treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047046_0.png resize: (294, 312) 1358180948 -2.7822181912338033 treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047051_0.png resize: (134, 292) 1358180950 -1.570100415228129 treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047047_0.png resize: (359, 459) 1358180952 -1.0283471739382386 treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047052_0.png resize: (330, 596) 1358180953 0.6075453731894312 treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047061_0.png resize: (225, 292) 1358180954 -3.178020755257305 treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047062_0.png resize: (282, 283) 1358180957 -1.5450791514875546 treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047055_0.png resize: (131, 178) 1358180958 -0.017468707881701812 treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047059_0.png resize: (157, 94) 1358180959 -4.141391564683958 treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047050_0.png resize: (234, 146) 1358180962 -1.6872683508508726 treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047060_0.png resize: (450, 339) 1358180964 -3.8138478485734453 treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047045_0.png resize: (286, 233) 1358180965 -1.1206638532526367 treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047049_0.png resize: (269, 129) 1358180966 -2.9396495905395046 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047088_0.png resize: (285, 260) 1358180969 -0.2938964331342912 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047073_0.png resize: (415, 259) 1358180970 -2.0844439365841714 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047071_0.png resize: (492, 276) 1358180971 -3.8158133720253313 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047076_0.png resize: (300, 240) 1358180973 -2.707146250378078 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047064_0.png resize: (362, 368) 1358180975 -2.17767401662571 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047083_0.png resize: (326, 365) 1358180976 -2.410911704912322 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047084_0.png resize: (525, 362) 1358180978 -3.8212426425410086 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047086_0.png resize: (233, 423) 1358180980 -3.086095515606977 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047066_0.png resize: (209, 274) 1358180981 -3.438871695338273 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047069_0.png resize: (480, 588) 1358180982 -2.806093231411864 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047077_0.png resize: (531, 446) 1358180985 -3.9961216277136558 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047075_0.png resize: (175, 303) 1358180986 -3.7418352194947757 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047079_0.png resize: (185, 205) 1358180987 -3.6922442039324217 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047081_0.png resize: (160, 205) 1358180989 -2.7840432822477164 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047082_0.png resize: (218, 227) 1358180992 -0.988387797474379 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047065_0.png resize: (185, 88) 1358180993 -1.1521201311130915 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047087_0.png resize: (237, 366) 1358180994 -2.471317485547407 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047085_0.png resize: (147, 163) 1358180996 -1.4644087971495232 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047068_0.png resize: (160, 236) 1358180998 -1.1489432897044904 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047067_0.png resize: (192, 93) 1358180999 -0.7797604316164443 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047072_0.png resize: (117, 116) 1358181001 -2.340398205405236 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047089_0.png resize: (108, 66) 1358181003 -0.7142193715689482 treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047090_0.png resize: (367, 538) 1358181004 0.45048971171158253 treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047105_0.png resize: (550, 726) 1358181005 -0.22303343786377827 treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047106_0.png resize: (458, 489) 1358181007 -2.8956078194091655 treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047098_0.png resize: (200, 336) 1358181009 -1.7913088726194735 treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047102_0.png resize: (402, 701) 1358181010 -2.97300638633252 treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047101_0.png resize: (77, 110) 1358181012 -4.123407327279184 treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047100_0.png resize: (169, 191) 1358181014 1.3390106902077452 treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047097_0.png resize: (382, 555) 1358181015 -4.482012177799501 treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047103_0.png resize: (152, 198) 1358181017 -2.676443659382202 treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047099_0.png resize: (190, 190) 1358181019 -2.6063620133363297 treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047091_0.png resize: (172, 159) 1358181020 -1.1103908953685055 treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047092_0.png resize: (562, 764) 1358181021 -3.433167755070111 treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047093_0.png resize: (271, 237) 1358181023 -3.439991415358643 treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047095_0.png resize: (125, 183) 1358181025 3.9116054083512686 treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047122_0.png resize: (207, 295) 1358181026 -1.9094588659962646 treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047124_0.png resize: (467, 396) 1358181028 -2.6772316122763056 treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047116_0.png resize: (481, 649) 1358181029 -3.0816311703602124 treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047110_0.png resize: (335, 281) 1358181031 -1.2366916948221456 treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047107_0.png resize: (181, 241) 1358181032 1.4891755536494653 treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047118_0.png resize: (331, 260) 1358181034 -3.2633784749298558 treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047125_0.png resize: (247, 221) 1358181036 -3.0381177022827153 treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047108_0.png resize: (232, 198) 1358181037 -2.0346615766466494 treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047112_0.png resize: (782, 711) 1358181039 -3.4618294940404444 treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047109_0.png resize: (374, 516) 1358181041 -2.4708722052974683 treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047119_0.png resize: (172, 172) 1358181042 -3.3959764240893997 treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047117_0.png resize: (277, 251) 1358181043 -2.572423183557954 treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047114_0.png resize: (383, 301) 1358181045 -4.0782413310717445 treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047120_0.png resize: (120, 278) 1358181047 -2.24239344917376 treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047111_0.png resize: (377, 206) 1358181048 -2.7966350709209573 treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047113_0.png resize: (364, 532) 1358181050 -2.9251704966646352 treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047126_0.png resize: (381, 244) 1358181052 -1.3578149013645 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047148_0.png resize: (385, 322) 1358181053 -2.8091471877789878 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047131_0.png resize: (215, 169) 1358181055 -3.8084624675718177 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047146_0.png resize: (135, 163) 1358181057 -3.030864111085637 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047139_0.png resize: (335, 337) 1358181058 -2.7309020221055107 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047134_0.png resize: (329, 267) 1358181060 -2.0591701313879693 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047128_0.png resize: (435, 519) 1358181062 -2.918749001788475 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047136_0.png resize: (375, 513) 1358181063 -3.4751124830430355 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047144_0.png resize: (249, 237) 1358181065 -0.37014281505903335 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047127_0.png resize: (254, 206) 1358181066 -2.5140454316245817 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047130_0.png resize: (738, 703) 1358181068 -3.3092310868090054 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047140_0.png resize: (531, 419) 1358181069 -1.7412476532505188 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047149_0.png resize: (192, 185) 1358181071 -3.0463775719494497 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047129_0.png resize: (478, 509) 1358181073 -3.5627424664438507 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047137_0.png resize: (339, 615) 1358181074 -4.47947900362895 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047143_0.png resize: (148, 159) 1358181076 -3.573259442289805 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047147_0.png resize: (392, 452) 1358181077 -3.9463972703052854 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047150_0.png resize: (391, 195) 1358181079 -2.2462439742584595 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047133_0.png resize: (300, 299) 1358181081 -3.4717822608194093 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047145_0.png resize: (164, 321) 1358181082 -2.496924638537083 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047141_0.png resize: (383, 204) 1358181084 -3.1446521946746433 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047135_0.png resize: (372, 448) 1358181086 -2.9638074551071005 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047156_0.png resize: (596, 225) 1358181087 -2.991730672722085 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047153_0.png resize: (240, 191) 1358181088 1.0728812584720238 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047151_0.png resize: (255, 438) 1358181092 0.08864641239374593 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047172_0.png resize: (219, 442) 1358181093 -1.2335232848654702 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047152_0.png resize: (395, 506) 1358181094 -3.8234367400596874 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047158_0.png resize: (75, 191) 1358181096 -4.3324952958196805 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047168_0.png resize: (495, 433) 1358181098 -3.0384328379901113 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047155_0.png resize: (237, 189) 1358181099 -3.0534414110942896 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047163_0.png resize: (222, 172) 1358181100 -4.003778161863387 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047154_0.png resize: (410, 686) 1358181103 -4.473698977600244 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047161_0.png resize: (206, 203) 1358181104 1.8819580128613806 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047159_0.png resize: (227, 322) 1358181105 -2.218253603480154 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047157_0.png resize: (279, 198) 1358181107 -3.3932941520936173 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047169_0.png resize: (193, 203) 1358181109 -1.9273587317440026 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047160_0.png resize: (395, 306) 1358181111 -2.9558185833040795 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047167_0.png resize: (197, 192) 1358181112 -3.4667391345444285 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047162_0.png resize: (154, 243) 1358181115 -3.414351490321696 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047164_0.png resize: (261, 472) 1358181116 -2.9898111194256667 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047171_0.png resize: (517, 588) 1358181117 -3.8481744026688385 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047170_0.png resize: (251, 356) 1358181119 -2.808722518354211 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047166_0.png resize: (537, 321) 1358181121 -3.571152017537232 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047080_0.png resize: (141, 133) 1358181204 -2.788039178903465 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047078_0.png resize: (267, 161) 1358181205 -3.803422045405435 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047074_0.png resize: (184, 117) 1358181206 -4.004818848990891 treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047096_0.png resize: (231, 211) 1358181209 -3.8117744722504945 treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047094_0.png resize: (298, 241) 1358181210 -4.162863467079178 treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047104_0.png resize: (213, 260) 1358181211 -3.1840101562782883 treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047123_0.png resize: (304, 431) 1358181214 -2.6098412926009216 treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047121_0.png resize: (228, 221) 1358181215 -3.4963059950244006 treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047115_0.png resize: (355, 208) 1358181216 -3.6203703146818507 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047132_0.png resize: (317, 471) 1358181217 -2.776646938558476 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047138_0.png resize: (229, 229) 1358181220 -3.8595389786525103 treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047142_0.png resize: (388, 214) 1358181221 -3.899865101518779 treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047054_0.png resize: (128, 180) 1358181251 -2.8563919914514977 treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047070_0.png resize: (143, 136) 1358181252 -3.6055094147553817 treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047165_0.png resize: (375, 395) 1358181276 -4.650421380009097 treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047056_0.png resize: (231, 227) 1358181304 -1.9417213330842809 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 134 time used for this insertion : 0.01698756217956543 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 134 time used for this insertion : 0.028916358947753906 save missing photos in datou_result : time spend for datou_step_exec : 30.9757342338562 time spend to save output : 0.051473140716552734 total time spend for step 6 : 31.027207374572754 step7:brightness Wed May 14 13:05:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb.jpg treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da.jpg treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99.jpg treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250.jpg treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41.jpg treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1.jpg treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047053_0.png treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047058_0.png treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047063_0.png treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047057_0.png treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047048_0.png treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047046_0.png treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047051_0.png treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047047_0.png treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047052_0.png treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047061_0.png treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047062_0.png treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047055_0.png treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047059_0.png treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047050_0.png treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047060_0.png treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047045_0.png treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047049_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047088_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047073_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047071_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047076_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047064_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047083_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047084_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047086_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047066_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047069_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047077_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047075_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047079_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047081_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047082_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047065_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047087_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047085_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047068_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047067_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047072_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047089_0.png treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047090_0.png treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047105_0.png treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047106_0.png treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047098_0.png treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047102_0.png treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047101_0.png treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047100_0.png treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047097_0.png treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047103_0.png treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047099_0.png treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047091_0.png treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047092_0.png treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047093_0.png treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047095_0.png treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047122_0.png treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047124_0.png treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047116_0.png treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047110_0.png treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047107_0.png treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047118_0.png treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047125_0.png treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047108_0.png treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047112_0.png treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047109_0.png treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047119_0.png treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047117_0.png treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047114_0.png treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047120_0.png treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047111_0.png treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047113_0.png treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047126_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047148_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047131_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047146_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047139_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047134_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047128_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047136_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047144_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047127_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047130_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047140_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047149_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047129_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047137_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047143_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047147_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047150_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047133_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047145_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047141_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047135_0.png treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047156_0.png treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047153_0.png treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047151_0.png treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047172_0.png treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047152_0.png treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047158_0.png treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047168_0.png treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047155_0.png treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047163_0.png treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047154_0.png treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047161_0.png treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047159_0.png treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047157_0.png treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047169_0.png treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047160_0.png treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047167_0.png treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047162_0.png treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047164_0.png treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047171_0.png treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047170_0.png treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047166_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047080_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047078_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047074_0.png treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047096_0.png treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047094_0.png treat image : temp/1747220428_2691911_1358156636_6024885cf89222e8bee55a6afbd18e99_rle_crop_3797047104_0.png treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047123_0.png treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047121_0.png treat image : temp/1747220428_2691911_1358156579_1ed9b60e305e2e36fc152c9665a08250_rle_crop_3797047115_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047132_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047138_0.png treat image : temp/1747220428_2691911_1358156514_9fce367f21f34badabbdae9dde8fcb41_rle_crop_3797047142_0.png treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047054_0.png treat image : temp/1747220428_2691911_1358156671_80c45e4a826255ae292525c15a17d5da_rle_crop_3797047070_0.png treat image : temp/1747220428_2691911_1358156068_a68ccbae4f26dec395332468657bd9f1_rle_crop_3797047165_0.png treat image : temp/1747220428_2691911_1358156702_7acd0e155a9285d32a8394dcd5640efb_rle_crop_3797047056_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 134 time used for this insertion : 0.029133319854736328 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 134 time used for this insertion : 0.031810760498046875 save missing photos in datou_result : time spend for datou_step_exec : 8.925106763839722 time spend to save output : 0.06664776802062988 total time spend for step 7 : 8.991754531860352 step8:velours_tree Wed May 14 13:05:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.1899404525756836 time spend to save output : 6.413459777832031e-05 total time spend for step 8 : 0.19000458717346191 step9:send_mail_cod Wed May 14 13:05:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22960477_14-05-2025_13_05_31.pdf 22961554 change filename to text .change filename to text .imagette229615541747220731 22961555 imagette229615551747220731 22961556 change filename to text .imagette229615561747220731 22961557 imagette229615571747220731 22961558 change filename to text .imagette229615581747220731 22961559 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229615591747220731 22961560 imagette229615601747220732 22961562 imagette229615621747220732 22961563 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229615631747220732 22961564 imagette229615641747220733 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22960477 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22961554,22961555,22961556,22961557,22961558,22961559,22961560,22961561,22961562,22961563,22961564?tags=metal,pehd,autre,mal_croppe,pet_clair,carton,background,environnement,flou,papier,pet_fonce args[1358156702] : ((1358156702, -5.984537885348072, 492609224), (1358156702, 1.2614636677789155, 2107752395), '0.16447810169110086') We are sending mail with results at report@fotonower.com args[1358156671] : ((1358156671, -5.923937210296091, 492609224), (1358156671, 0.9207257622582683, 2107752395), '0.16447810169110086') We are sending mail with results at report@fotonower.com args[1358156636] : ((1358156636, -6.478584066377382, 492609224), (1358156636, 1.8172589605240588, 2107752395), '0.16447810169110086') We are sending mail with results at report@fotonower.com args[1358156579] : ((1358156579, -6.681899398548661, 492609224), (1358156579, 1.193813736434796, 2107752395), '0.16447810169110086') We are sending mail with results at report@fotonower.com args[1358156514] : ((1358156514, -6.7600201187836575, 492609224), (1358156514, 1.1606788020459904, 2107752395), '0.16447810169110086') We are sending mail with results at report@fotonower.com args[1358156068] : ((1358156068, -5.9156614828984875, 492609224), (1358156068, 0.6812621820743285, 2107752395), '0.16447810169110086') We are sending mail with results at report@fotonower.com refus_total : 0.16447810169110086 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22960477 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22960477_14-05-2025_13_05_31.pdf results_Auto_P22960477_14-05-2025_13_05_31.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22960477_14-05-2025_13_05_31.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22960477','results_Auto_P22960477_14-05-2025_13_05_31.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22960477_14-05-2025_13_05_31.pdf','pdf','','0.43','0.16447810169110086') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22960477

https://www.fotonower.com/image?json=false&list_photos_id=1358156702
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358156671
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358156636
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358156579
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358156514
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358156068
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 16.45%
Veuillez trouver les photos des contaminants.

exemples de contaminants: metal: https://www.fotonower.com/view/22961554?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22961556?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22961558?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22961559?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22961563?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22960477_14-05-2025_13_05_31.pdf.

Lien vers velours :https://www.fotonower.com/velours/22961554,22961555,22961556,22961557,22961558,22961559,22961560,22961561,22961562,22961563,22961564?tags=metal,pehd,autre,mal_croppe,pet_clair,carton,background,environnement,flou,papier,pet_fonce.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 14 May 2025 11:05:36 GMT Content-Length: 0 Connection: close X-Message-Id: gNaG7XFiTiy1hDaJP9PyIg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1358156702, 1358156671, 1358156636, 1358156579, 1358156514, 1358156068] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156702', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156671', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156636', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156579', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156514', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156068', None, None, None, None, None, '2848510') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.012149333953857422 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.091109752655029 time spend to save output : 0.012336015701293945 total time spend for step 9 : 5.103445768356323 step10:split_time_score Wed May 14 13:05:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 6),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 14052025 22960477 Nombre de photos uploadées : 6 / 23040 (0%) 14052025 22960477 Nombre de photos taguées (types de déchets): 0 / 6 (0%) 14052025 22960477 Nombre de photos taguées (volume) : 0 / 6 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 5.4836273193359375e-06 ?????? elapsed_time : fill_and_build_computed_from_old_data 0.00036907196044921875 elapsed_time : insert_dashboard_record_day_entry 0.026406526565551758 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.15093270158179015 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22948162_14-05-2025_07_47_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22948162 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22948162 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22948165 order by id desc limit 1 Qualite : 0.09967562451774692 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22949538_14-05-2025_08_24_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22949538 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22949538 AND mptpi.`type`=3594 To do Qualite : 0.19506076388888893 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22953035_14-05-2025_10_24_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22953035 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22953035 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22955733 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22958945 order by id desc limit 1 Qualite : 0.16447810169110086 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22960477_14-05-2025_13_05_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22960477 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22960477 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'14052025': {'nb_upload': 6, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1358156702, 1358156671, 1358156636, 1358156579, 1358156514, 1358156068] Looping around the photos to save general results len do output : 1 /22960477Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156702', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156671', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156636', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156579', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156514', None, None, None, None, None, '2848510') ('3318', None, None, None, None, None, None, None, '2848510') ('3318', '22960477', '1358156068', None, None, None, None, None, '2848510') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.01498103141784668 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.066991090774536 time spend to save output : 0.01518702507019043 total time spend for step 10 : 3.0821781158447266 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 6 set_done_treatment 131.02user 140.42system 5:15.02elapsed 86%CPU (0avgtext+0avgdata 4917756maxresident)k 597776inputs+103368outputs (314major+12302109minor)pagefaults 0swaps