python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2467086 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2805084'] with mtr_portfolio_ids : ['22787314'] and first list_photo_ids : [] new path : /proc/2467086/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 2.0462119579315186 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed May 7 21:20:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10440 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-07 21:20:33.853161: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-07 21:20:33.879068: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-07 21:20:33.880995: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f296c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-07 21:20:33.881029: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-07 21:20:33.885217: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-07 21:20:34.022436: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xf7cf670 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-07 21:20:34.022493: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-07 21:20:34.023752: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-07 21:20:34.024196: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-07 21:20:34.027228: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-07 21:20:34.030109: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-07 21:20:34.030601: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-07 21:20:34.033508: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-07 21:20:34.034807: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-07 21:20:34.040073: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-07 21:20:34.041586: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-07 21:20:34.041678: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-07 21:20:34.042470: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-07 21:20:34.042486: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-07 21:20:34.042496: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-07 21:20:34.043883: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9671 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-07 21:20:34.313445: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-07 21:20:34.313577: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-07 21:20:34.313607: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-07 21:20:34.313632: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-07 21:20:34.313657: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-07 21:20:34.313682: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-07 21:20:34.313707: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-07 21:20:34.313732: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-07 21:20:34.315774: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-07 21:20:34.317155: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-07 21:20:34.317214: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-07 21:20:34.317246: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-07 21:20:34.317274: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-07 21:20:34.317305: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-07 21:20:34.317332: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-07 21:20:34.317361: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-07 21:20:34.317389: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-07 21:20:34.319130: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-07 21:20:34.319179: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-07 21:20:34.319193: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-07 21:20:34.319204: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-07 21:20:34.320999: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9671 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-07 21:20:46.885116: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-07 21:20:47.102683: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 9 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 41 Detection mask done ! Trying to reset tf kernel 2467839 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 334 tf kernel not reseted sub process len(results) : 9 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 9 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9400 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0013303756713867188 nb_pixel_total : 27413 time to create 1 rle with old method : 0.03095388412475586 length of segment : 350 time for calcul the mask position with numpy : 0.002681255340576172 nb_pixel_total : 85653 time to create 1 rle with old method : 0.09266352653503418 length of segment : 354 time for calcul the mask position with numpy : 0.0015048980712890625 nb_pixel_total : 65588 time to create 1 rle with old method : 0.07197046279907227 length of segment : 289 time for calcul the mask position with numpy : 0.0038917064666748047 nb_pixel_total : 141110 time to create 1 rle with old method : 0.16307759284973145 length of segment : 603 time for calcul the mask position with numpy : 0.0008344650268554688 nb_pixel_total : 29558 time to create 1 rle with old method : 0.058347225189208984 length of segment : 202 time for calcul the mask position with numpy : 0.00031757354736328125 nb_pixel_total : 11076 time to create 1 rle with old method : 0.013358831405639648 length of segment : 140 time for calcul the mask position with numpy : 0.0018389225006103516 nb_pixel_total : 50272 time to create 1 rle with old method : 0.059159278869628906 length of segment : 440 time for calcul the mask position with numpy : 0.0009419918060302734 nb_pixel_total : 58389 time to create 1 rle with old method : 0.07725667953491211 length of segment : 201 time for calcul the mask position with numpy : 0.0029876232147216797 nb_pixel_total : 108073 time to create 1 rle with old method : 0.137542724609375 length of segment : 573 time for calcul the mask position with numpy : 0.020132780075073242 nb_pixel_total : 494801 time to create 1 rle with new method : 0.05677914619445801 length of segment : 1456 time for calcul the mask position with numpy : 0.0020599365234375 nb_pixel_total : 90973 time to create 1 rle with old method : 0.12333846092224121 length of segment : 524 time for calcul the mask position with numpy : 0.014068365097045898 nb_pixel_total : 313853 time to create 1 rle with new method : 0.22280216217041016 length of segment : 1251 time for calcul the mask position with numpy : 0.0011234283447265625 nb_pixel_total : 60636 time to create 1 rle with old method : 0.06835317611694336 length of segment : 307 time for calcul the mask position with numpy : 0.0009140968322753906 nb_pixel_total : 43765 time to create 1 rle with old method : 0.05410575866699219 length of segment : 306 time for calcul the mask position with numpy : 0.0006449222564697266 nb_pixel_total : 11262 time to create 1 rle with old method : 0.013323068618774414 length of segment : 149 time for calcul the mask position with numpy : 0.00464940071105957 nb_pixel_total : 122414 time to create 1 rle with old method : 0.1390676498413086 length of segment : 531 time for calcul the mask position with numpy : 0.0024085044860839844 nb_pixel_total : 66068 time to create 1 rle with old method : 0.0767822265625 length of segment : 397 time for calcul the mask position with numpy : 0.0011451244354248047 nb_pixel_total : 24440 time to create 1 rle with old method : 0.02815699577331543 length of segment : 223 time for calcul the mask position with numpy : 0.001027822494506836 nb_pixel_total : 20358 time to create 1 rle with old method : 0.025594234466552734 length of segment : 152 time for calcul the mask position with numpy : 0.0021827220916748047 nb_pixel_total : 41026 time to create 1 rle with old method : 0.06317138671875 length of segment : 307 time for calcul the mask position with numpy : 0.001401662826538086 nb_pixel_total : 53353 time to create 1 rle with old method : 0.06089973449707031 length of segment : 147 time for calcul the mask position with numpy : 0.0016701221466064453 nb_pixel_total : 54669 time to create 1 rle with old method : 0.0626833438873291 length of segment : 227 time for calcul the mask position with numpy : 0.007177829742431641 nb_pixel_total : 155340 time to create 1 rle with new method : 0.01421666145324707 length of segment : 598 time for calcul the mask position with numpy : 0.0015170574188232422 nb_pixel_total : 39840 time to create 1 rle with old method : 0.04506492614746094 length of segment : 311 time for calcul the mask position with numpy : 0.010406255722045898 nb_pixel_total : 362569 time to create 1 rle with new method : 0.07019972801208496 length of segment : 1216 time for calcul the mask position with numpy : 0.0009570121765136719 nb_pixel_total : 25708 time to create 1 rle with old method : 0.029607295989990234 length of segment : 162 time for calcul the mask position with numpy : 0.005051612854003906 nb_pixel_total : 212621 time to create 1 rle with new method : 0.008432865142822266 length of segment : 376 time for calcul the mask position with numpy : 0.0014524459838867188 nb_pixel_total : 49542 time to create 1 rle with old method : 0.05610489845275879 length of segment : 683 time for calcul the mask position with numpy : 0.0057942867279052734 nb_pixel_total : 189055 time to create 1 rle with new method : 0.00676274299621582 length of segment : 373 time for calcul the mask position with numpy : 0.0041882991790771484 nb_pixel_total : 153063 time to create 1 rle with new method : 0.009894847869873047 length of segment : 526 time for calcul the mask position with numpy : 0.003500223159790039 nb_pixel_total : 139883 time to create 1 rle with old method : 0.1596527099609375 length of segment : 370 time for calcul the mask position with numpy : 0.0022001266479492188 nb_pixel_total : 86503 time to create 1 rle with old method : 0.09598779678344727 length of segment : 432 time for calcul the mask position with numpy : 0.0008614063262939453 nb_pixel_total : 30162 time to create 1 rle with old method : 0.03324770927429199 length of segment : 194 time for calcul the mask position with numpy : 0.015722036361694336 nb_pixel_total : 505750 time to create 1 rle with new method : 0.0646371841430664 length of segment : 1723 time for calcul the mask position with numpy : 0.000835418701171875 nb_pixel_total : 24540 time to create 1 rle with old method : 0.029957056045532227 length of segment : 176 time for calcul the mask position with numpy : 0.004057407379150391 nb_pixel_total : 134861 time to create 1 rle with old method : 0.15066027641296387 length of segment : 826 time for calcul the mask position with numpy : 0.0017271041870117188 nb_pixel_total : 57135 time to create 1 rle with old method : 0.08526444435119629 length of segment : 259 time for calcul the mask position with numpy : 0.004734039306640625 nb_pixel_total : 180659 time to create 1 rle with new method : 0.007184743881225586 length of segment : 529 time for calcul the mask position with numpy : 0.0022125244140625 nb_pixel_total : 67112 time to create 1 rle with old method : 0.07516622543334961 length of segment : 591 time for calcul the mask position with numpy : 0.0024559497833251953 nb_pixel_total : 84870 time to create 1 rle with old method : 0.10564064979553223 length of segment : 282 time for calcul the mask position with numpy : 0.0035338401794433594 nb_pixel_total : 97318 time to create 1 rle with old method : 0.12886905670166016 length of segment : 383 time for calcul the mask position with numpy : 0.005523681640625 nb_pixel_total : 185793 time to create 1 rle with new method : 0.012686014175415039 length of segment : 491 time for calcul the mask position with numpy : 0.007025003433227539 nb_pixel_total : 262746 time to create 1 rle with new method : 0.01085662841796875 length of segment : 403 time for calcul the mask position with numpy : 0.007684230804443359 nb_pixel_total : 271129 time to create 1 rle with new method : 0.01506948471069336 length of segment : 368 time for calcul the mask position with numpy : 0.004766225814819336 nb_pixel_total : 151228 time to create 1 rle with new method : 0.007228851318359375 length of segment : 510 time for calcul the mask position with numpy : 0.00042510032653808594 nb_pixel_total : 9350 time to create 1 rle with old method : 0.010818719863891602 length of segment : 103 time for calcul the mask position with numpy : 0.00041031837463378906 nb_pixel_total : 12206 time to create 1 rle with old method : 0.01476907730102539 length of segment : 85 time for calcul the mask position with numpy : 0.003900289535522461 nb_pixel_total : 151757 time to create 1 rle with new method : 0.005475759506225586 length of segment : 359 time for calcul the mask position with numpy : 0.0029773712158203125 nb_pixel_total : 118317 time to create 1 rle with old method : 0.13771462440490723 length of segment : 402 time for calcul the mask position with numpy : 0.0018303394317626953 nb_pixel_total : 57552 time to create 1 rle with old method : 0.06586456298828125 length of segment : 363 time for calcul the mask position with numpy : 0.001859426498413086 nb_pixel_total : 51482 time to create 1 rle with old method : 0.06046485900878906 length of segment : 270 time for calcul the mask position with numpy : 0.0018546581268310547 nb_pixel_total : 74301 time to create 1 rle with old method : 0.08480215072631836 length of segment : 247 time for calcul the mask position with numpy : 0.0008792877197265625 nb_pixel_total : 38523 time to create 1 rle with old method : 0.05910992622375488 length of segment : 202 time for calcul the mask position with numpy : 0.004443645477294922 nb_pixel_total : 111649 time to create 1 rle with old method : 0.12626934051513672 length of segment : 450 time for calcul the mask position with numpy : 0.0009894371032714844 nb_pixel_total : 27867 time to create 1 rle with old method : 0.03268599510192871 length of segment : 182 time for calcul the mask position with numpy : 0.0024056434631347656 nb_pixel_total : 51366 time to create 1 rle with old method : 0.06200814247131348 length of segment : 293 time for calcul the mask position with numpy : 0.0005500316619873047 nb_pixel_total : 15961 time to create 1 rle with old method : 0.02058100700378418 length of segment : 110 time for calcul the mask position with numpy : 0.0005543231964111328 nb_pixel_total : 12251 time to create 1 rle with old method : 0.014624834060668945 length of segment : 149 time for calcul the mask position with numpy : 0.0005648136138916016 nb_pixel_total : 12016 time to create 1 rle with old method : 0.014600515365600586 length of segment : 113 time for calcul the mask position with numpy : 0.001046895980834961 nb_pixel_total : 25206 time to create 1 rle with old method : 0.02946329116821289 length of segment : 210 time for calcul the mask position with numpy : 0.0018413066864013672 nb_pixel_total : 39338 time to create 1 rle with old method : 0.04543042182922363 length of segment : 319 time for calcul the mask position with numpy : 0.0037353038787841797 nb_pixel_total : 124990 time to create 1 rle with old method : 0.14503693580627441 length of segment : 640 time for calcul the mask position with numpy : 0.00055694580078125 nb_pixel_total : 14789 time to create 1 rle with old method : 0.01831507682800293 length of segment : 107 time for calcul the mask position with numpy : 0.005980014801025391 nb_pixel_total : 206220 time to create 1 rle with new method : 0.013179779052734375 length of segment : 790 time for calcul the mask position with numpy : 0.0005691051483154297 nb_pixel_total : 21944 time to create 1 rle with old method : 0.02507495880126953 length of segment : 188 time for calcul the mask position with numpy : 0.0007436275482177734 nb_pixel_total : 17996 time to create 1 rle with old method : 0.02043461799621582 length of segment : 207 time for calcul the mask position with numpy : 0.0012412071228027344 nb_pixel_total : 30612 time to create 1 rle with old method : 0.03450918197631836 length of segment : 334 time for calcul the mask position with numpy : 0.0031554698944091797 nb_pixel_total : 94988 time to create 1 rle with old method : 0.11052799224853516 length of segment : 527 time for calcul the mask position with numpy : 0.00033092498779296875 nb_pixel_total : 13042 time to create 1 rle with old method : 0.015054941177368164 length of segment : 217 time for calcul the mask position with numpy : 0.0010197162628173828 nb_pixel_total : 28358 time to create 1 rle with old method : 0.032424211502075195 length of segment : 268 time for calcul the mask position with numpy : 0.002188444137573242 nb_pixel_total : 71215 time to create 1 rle with old method : 0.08145356178283691 length of segment : 362 time for calcul the mask position with numpy : 0.00047779083251953125 nb_pixel_total : 13453 time to create 1 rle with old method : 0.01568150520324707 length of segment : 104 time for calcul the mask position with numpy : 0.0010824203491210938 nb_pixel_total : 28067 time to create 1 rle with old method : 0.03250741958618164 length of segment : 282 time for calcul the mask position with numpy : 0.0006568431854248047 nb_pixel_total : 18201 time to create 1 rle with old method : 0.020870208740234375 length of segment : 153 time for calcul the mask position with numpy : 0.001009225845336914 nb_pixel_total : 28545 time to create 1 rle with old method : 0.033234357833862305 length of segment : 177 time for calcul the mask position with numpy : 0.0005626678466796875 nb_pixel_total : 15292 time to create 1 rle with old method : 0.017887592315673828 length of segment : 140 time for calcul the mask position with numpy : 0.00044727325439453125 nb_pixel_total : 8942 time to create 1 rle with old method : 0.01077580451965332 length of segment : 154 time for calcul the mask position with numpy : 0.0007550716400146484 nb_pixel_total : 29710 time to create 1 rle with old method : 0.034645795822143555 length of segment : 169 time for calcul the mask position with numpy : 0.003159761428833008 nb_pixel_total : 91306 time to create 1 rle with old method : 0.10360431671142578 length of segment : 496 time for calcul the mask position with numpy : 0.002574920654296875 nb_pixel_total : 85809 time to create 1 rle with old method : 0.10269308090209961 length of segment : 374 time for calcul the mask position with numpy : 0.0005648136138916016 nb_pixel_total : 10542 time to create 1 rle with old method : 0.01289510726928711 length of segment : 129 time for calcul the mask position with numpy : 0.0014948844909667969 nb_pixel_total : 41816 time to create 1 rle with old method : 0.04969978332519531 length of segment : 232 time for calcul the mask position with numpy : 0.0012254714965820312 nb_pixel_total : 29014 time to create 1 rle with old method : 0.033757925033569336 length of segment : 333 time for calcul the mask position with numpy : 0.0006551742553710938 nb_pixel_total : 30216 time to create 1 rle with old method : 0.03485298156738281 length of segment : 131 time for calcul the mask position with numpy : 0.001352071762084961 nb_pixel_total : 33193 time to create 1 rle with old method : 0.04002547264099121 length of segment : 287 time for calcul the mask position with numpy : 0.0013425350189208984 nb_pixel_total : 33836 time to create 1 rle with old method : 0.03835773468017578 length of segment : 200 time for calcul the mask position with numpy : 0.0010678768157958984 nb_pixel_total : 27782 time to create 1 rle with old method : 0.03172922134399414 length of segment : 163 time for calcul the mask position with numpy : 0.0010306835174560547 nb_pixel_total : 29177 time to create 1 rle with old method : 0.03357338905334473 length of segment : 182 time for calcul the mask position with numpy : 0.0012013912200927734 nb_pixel_total : 25212 time to create 1 rle with old method : 0.029222726821899414 length of segment : 265 time for calcul the mask position with numpy : 0.0014901161193847656 nb_pixel_total : 36175 time to create 1 rle with old method : 0.041362762451171875 length of segment : 202 time for calcul the mask position with numpy : 0.0012519359588623047 nb_pixel_total : 17074 time to create 1 rle with old method : 0.025892972946166992 length of segment : 218 time for calcul the mask position with numpy : 0.0008816719055175781 nb_pixel_total : 16879 time to create 1 rle with old method : 0.027934551239013672 length of segment : 166 time for calcul the mask position with numpy : 0.0013763904571533203 nb_pixel_total : 26416 time to create 1 rle with old method : 0.04426431655883789 length of segment : 154 time for calcul the mask position with numpy : 0.0011985301971435547 nb_pixel_total : 24894 time to create 1 rle with old method : 0.040985822677612305 length of segment : 212 time for calcul the mask position with numpy : 0.001190185546875 nb_pixel_total : 21191 time to create 1 rle with old method : 0.03482365608215332 length of segment : 263 time for calcul the mask position with numpy : 0.0020170211791992188 nb_pixel_total : 42510 time to create 1 rle with old method : 0.0671989917755127 length of segment : 253 time for calcul the mask position with numpy : 0.0013704299926757812 nb_pixel_total : 27911 time to create 1 rle with old method : 0.035144805908203125 length of segment : 200 time for calcul the mask position with numpy : 0.0012068748474121094 nb_pixel_total : 28872 time to create 1 rle with old method : 0.03391575813293457 length of segment : 189 time for calcul the mask position with numpy : 0.002146482467651367 nb_pixel_total : 68045 time to create 1 rle with old method : 0.07837939262390137 length of segment : 282 time for calcul the mask position with numpy : 0.0011441707611083984 nb_pixel_total : 36900 time to create 1 rle with old method : 0.042764902114868164 length of segment : 176 time for calcul the mask position with numpy : 0.0004432201385498047 nb_pixel_total : 13643 time to create 1 rle with old method : 0.016061067581176758 length of segment : 135 time for calcul the mask position with numpy : 0.0004150867462158203 nb_pixel_total : 9343 time to create 1 rle with old method : 0.011191844940185547 length of segment : 92 time for calcul the mask position with numpy : 0.00026726722717285156 nb_pixel_total : 3977 time to create 1 rle with old method : 0.0047686100006103516 length of segment : 87 time for calcul the mask position with numpy : 0.0055925846099853516 nb_pixel_total : 138442 time to create 1 rle with old method : 0.1544177532196045 length of segment : 499 time for calcul the mask position with numpy : 0.0021555423736572266 nb_pixel_total : 42320 time to create 1 rle with old method : 0.04980921745300293 length of segment : 303 time for calcul the mask position with numpy : 0.003240346908569336 nb_pixel_total : 76891 time to create 1 rle with old method : 0.09559392929077148 length of segment : 296 time for calcul the mask position with numpy : 0.0013985633850097656 nb_pixel_total : 20252 time to create 1 rle with old method : 0.023631811141967773 length of segment : 252 time for calcul the mask position with numpy : 0.0008971691131591797 nb_pixel_total : 26082 time to create 1 rle with old method : 0.030266761779785156 length of segment : 143 time for calcul the mask position with numpy : 0.0001518726348876953 nb_pixel_total : 4863 time to create 1 rle with old method : 0.005937814712524414 length of segment : 95 time for calcul the mask position with numpy : 0.003276824951171875 nb_pixel_total : 100663 time to create 1 rle with old method : 0.11537766456604004 length of segment : 378 time for calcul the mask position with numpy : 0.0063626766204833984 nb_pixel_total : 180884 time to create 1 rle with new method : 0.010894060134887695 length of segment : 675 time for calcul the mask position with numpy : 0.0009996891021728516 nb_pixel_total : 23426 time to create 1 rle with old method : 0.02742314338684082 length of segment : 136 time for calcul the mask position with numpy : 0.005234241485595703 nb_pixel_total : 137690 time to create 1 rle with old method : 0.15769147872924805 length of segment : 517 time for calcul the mask position with numpy : 0.0004892349243164062 nb_pixel_total : 17589 time to create 1 rle with old method : 0.01999974250793457 length of segment : 179 time for calcul the mask position with numpy : 0.00039958953857421875 nb_pixel_total : 6970 time to create 1 rle with old method : 0.008240222930908203 length of segment : 99 time for calcul the mask position with numpy : 0.004160642623901367 nb_pixel_total : 144491 time to create 1 rle with old method : 0.160963773727417 length of segment : 509 time for calcul the mask position with numpy : 0.0009784698486328125 nb_pixel_total : 30161 time to create 1 rle with old method : 0.034848928451538086 length of segment : 224 time for calcul the mask position with numpy : 0.004702329635620117 nb_pixel_total : 108849 time to create 1 rle with old method : 0.12235164642333984 length of segment : 368 time for calcul the mask position with numpy : 0.0012295246124267578 nb_pixel_total : 26123 time to create 1 rle with old method : 0.02983832359313965 length of segment : 244 time for calcul the mask position with numpy : 0.002385854721069336 nb_pixel_total : 50539 time to create 1 rle with old method : 0.05771160125732422 length of segment : 239 time for calcul the mask position with numpy : 0.001943349838256836 nb_pixel_total : 69248 time to create 1 rle with old method : 0.07891988754272461 length of segment : 357 time for calcul the mask position with numpy : 0.0005879402160644531 nb_pixel_total : 9746 time to create 1 rle with old method : 0.01122593879699707 length of segment : 114 time for calcul the mask position with numpy : 0.0007176399230957031 nb_pixel_total : 18561 time to create 1 rle with old method : 0.021262407302856445 length of segment : 248 time for calcul the mask position with numpy : 0.0016944408416748047 nb_pixel_total : 23111 time to create 1 rle with old method : 0.026683807373046875 length of segment : 312 time for calcul the mask position with numpy : 0.0009531974792480469 nb_pixel_total : 18919 time to create 1 rle with old method : 0.02176213264465332 length of segment : 163 time for calcul the mask position with numpy : 0.004854679107666016 nb_pixel_total : 124199 time to create 1 rle with old method : 0.14064764976501465 length of segment : 270 time for calcul the mask position with numpy : 0.0025975704193115234 nb_pixel_total : 43149 time to create 1 rle with old method : 0.048686981201171875 length of segment : 284 time for calcul the mask position with numpy : 0.003753185272216797 nb_pixel_total : 72031 time to create 1 rle with old method : 0.08127427101135254 length of segment : 563 time for calcul the mask position with numpy : 0.004203319549560547 nb_pixel_total : 114079 time to create 1 rle with old method : 0.12683415412902832 length of segment : 386 time for calcul the mask position with numpy : 0.0012927055358886719 nb_pixel_total : 28785 time to create 1 rle with old method : 0.03795576095581055 length of segment : 365 time for calcul the mask position with numpy : 0.0008952617645263672 nb_pixel_total : 11426 time to create 1 rle with old method : 0.018172502517700195 length of segment : 146 time for calcul the mask position with numpy : 0.0019621849060058594 nb_pixel_total : 45902 time to create 1 rle with old method : 0.0522153377532959 length of segment : 374 time for calcul the mask position with numpy : 0.0004620552062988281 nb_pixel_total : 9569 time to create 1 rle with old method : 0.011133670806884766 length of segment : 103 time for calcul the mask position with numpy : 0.0006263256072998047 nb_pixel_total : 14152 time to create 1 rle with old method : 0.01640915870666504 length of segment : 172 time for calcul the mask position with numpy : 0.0012352466583251953 nb_pixel_total : 31401 time to create 1 rle with old method : 0.036127567291259766 length of segment : 153 time for calcul the mask position with numpy : 0.0009627342224121094 nb_pixel_total : 16597 time to create 1 rle with old method : 0.019020557403564453 length of segment : 324 time for calcul the mask position with numpy : 0.0008177757263183594 nb_pixel_total : 15093 time to create 1 rle with old method : 0.01757073402404785 length of segment : 182 time for calcul the mask position with numpy : 0.0004892349243164062 nb_pixel_total : 9152 time to create 1 rle with old method : 0.010643720626831055 length of segment : 133 time for calcul the mask position with numpy : 0.000484466552734375 nb_pixel_total : 11018 time to create 1 rle with old method : 0.013091802597045898 length of segment : 87 time for calcul the mask position with numpy : 0.0037910938262939453 nb_pixel_total : 101671 time to create 1 rle with old method : 0.115631103515625 length of segment : 472 time for calcul the mask position with numpy : 0.004471540451049805 nb_pixel_total : 93404 time to create 1 rle with old method : 0.1060323715209961 length of segment : 669 time for calcul the mask position with numpy : 0.002521991729736328 nb_pixel_total : 65635 time to create 1 rle with old method : 0.07413220405578613 length of segment : 578 time for calcul the mask position with numpy : 0.0005011558532714844 nb_pixel_total : 10350 time to create 1 rle with old method : 0.012119054794311523 length of segment : 107 time for calcul the mask position with numpy : 0.0003783702850341797 nb_pixel_total : 11864 time to create 1 rle with old method : 0.01624464988708496 length of segment : 77 time for calcul the mask position with numpy : 0.00035691261291503906 nb_pixel_total : 5084 time to create 1 rle with old method : 0.008513450622558594 length of segment : 101 time for calcul the mask position with numpy : 0.0004115104675292969 nb_pixel_total : 8858 time to create 1 rle with old method : 0.01478886604309082 length of segment : 135 time for calcul the mask position with numpy : 0.003737211227416992 nb_pixel_total : 41002 time to create 1 rle with old method : 0.04664301872253418 length of segment : 501 time spent for convertir_results : 15.867990016937256 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 147 chid ids of type : 3594 Number RLEs to save : 47540 save missing photos in datou_result : time spend for datou_step_exec : 71.25881314277649 time spend to save output : 3.1661062240600586 total time spend for step 1 : 74.42491936683655 step2:crop_condition Wed May 7 21:21:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 147 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 87 About to insert : list_path_to_insert length 87 new photo from crops ! About to upload 87 photos upload in portfolio : 3736932 init cache_photo without model_param we have 87 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746645734_2467086 we have uploaded 87 photos in the portfolio 3736932 time of upload the photos Elapsed time : 21.27748465538025 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746645760_2467086 we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.921034336090088 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746645765_2467086 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8807344436645508 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 38 About to insert : list_path_to_insert length 38 new photo from crops ! About to upload 38 photos upload in portfolio : 3736932 init cache_photo without model_param we have 38 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746645781_2467086 we have uploaded 38 photos in the portfolio 3736932 time of upload the photos Elapsed time : 19.62880039215088 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746645803_2467086 we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.499884843826294 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746645805_2467086 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5258057117462158 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1356800727, 1356800723, 1356800719, 1356800716, 1356800680, 1356753798, 1356753796, 1356753793, 1356753791] Looping around the photos to save general results len do output : 147 /1356859615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356859753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356860997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356861002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356861003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356861004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356861006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356861010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356861011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356861013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356861017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356861018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356861019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356861022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356861025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356861026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356861028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356861032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356861123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356861125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356861128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356861129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356861131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356861168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800727', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800723', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800719', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800716', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800680', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753798', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753796', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753793', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753791', None, None, None, None, None, '2805084') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 450 time used for this insertion : 0.030624866485595703 save_final save missing photos in datou_result : time spend for datou_step_exec : 100.45811915397644 time spend to save output : 0.03478717803955078 total time spend for step 2 : 100.49290633201599 step3:rle_unique_nms_with_priority Wed May 7 21:23:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 147 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 19 nb_hashtags : 4 time to prepare the origin masks : 7.987819671630859 time for calcul the mask position with numpy : 0.6184566020965576 nb_pixel_total : 5330201 time to create 1 rle with new method : 1.0036907196044922 time for calcul the mask position with numpy : 0.021452903747558594 nb_pixel_total : 20358 time to create 1 rle with old method : 0.022814273834228516 time for calcul the mask position with numpy : 0.021553993225097656 nb_pixel_total : 24440 time to create 1 rle with old method : 0.0273895263671875 time for calcul the mask position with numpy : 0.024378538131713867 nb_pixel_total : 66068 time to create 1 rle with old method : 0.07546854019165039 time for calcul the mask position with numpy : 0.025547266006469727 nb_pixel_total : 122414 time to create 1 rle with old method : 0.13912343978881836 time for calcul the mask position with numpy : 0.021096229553222656 nb_pixel_total : 11262 time to create 1 rle with old method : 0.0126190185546875 time for calcul the mask position with numpy : 0.020746469497680664 nb_pixel_total : 43765 time to create 1 rle with old method : 0.050022125244140625 time for calcul the mask position with numpy : 0.021628856658935547 nb_pixel_total : 50326 time to create 1 rle with old method : 0.05671072006225586 time for calcul the mask position with numpy : 0.022930383682250977 nb_pixel_total : 304042 time to create 1 rle with new method : 0.6255078315734863 time for calcul the mask position with numpy : 0.022527217864990234 nb_pixel_total : 90973 time to create 1 rle with old method : 0.10093140602111816 time for calcul the mask position with numpy : 0.025173425674438477 nb_pixel_total : 409259 time to create 1 rle with new method : 0.6165256500244141 time for calcul the mask position with numpy : 0.027384042739868164 nb_pixel_total : 108073 time to create 1 rle with old method : 0.11997079849243164 time for calcul the mask position with numpy : 0.03469443321228027 nb_pixel_total : 58389 time to create 1 rle with old method : 0.06502842903137207 time for calcul the mask position with numpy : 0.03557300567626953 nb_pixel_total : 50272 time to create 1 rle with old method : 0.07806754112243652 time for calcul the mask position with numpy : 0.035475969314575195 nb_pixel_total : 11076 time to create 1 rle with old method : 0.012385129928588867 time for calcul the mask position with numpy : 0.03489327430725098 nb_pixel_total : 29558 time to create 1 rle with old method : 0.03290271759033203 time for calcul the mask position with numpy : 0.03390836715698242 nb_pixel_total : 141110 time to create 1 rle with old method : 0.1579732894897461 time for calcul the mask position with numpy : 0.0322573184967041 nb_pixel_total : 65588 time to create 1 rle with old method : 0.07948756217956543 time for calcul the mask position with numpy : 0.02947402000427246 nb_pixel_total : 85653 time to create 1 rle with old method : 0.12024712562561035 time for calcul the mask position with numpy : 0.023746013641357422 nb_pixel_total : 27413 time to create 1 rle with old method : 0.03080463409423828 create new chi : 4.637839078903198 time to delete rle : 0.019184350967407227 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 18477 TO DO : save crop sub photo not yet done ! save time : 1.1788859367370605 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 5.649923801422119 time for calcul the mask position with numpy : 0.4896092414855957 nb_pixel_total : 4957246 time to create 1 rle with new method : 0.9869322776794434 time for calcul the mask position with numpy : 0.04001498222351074 nb_pixel_total : 499660 time to create 1 rle with new method : 0.5142571926116943 time for calcul the mask position with numpy : 0.024487972259521484 nb_pixel_total : 30162 time to create 1 rle with old method : 0.033766746520996094 time for calcul the mask position with numpy : 0.022668123245239258 nb_pixel_total : 86503 time to create 1 rle with old method : 0.09483838081359863 time for calcul the mask position with numpy : 0.023512601852416992 nb_pixel_total : 139883 time to create 1 rle with old method : 0.1517958641052246 time for calcul the mask position with numpy : 0.02383732795715332 nb_pixel_total : 153063 time to create 1 rle with new method : 0.41761207580566406 time for calcul the mask position with numpy : 0.02319025993347168 nb_pixel_total : 189055 time to create 1 rle with new method : 1.134965419769287 time for calcul the mask position with numpy : 0.023021697998046875 nb_pixel_total : 49542 time to create 1 rle with old method : 0.05660843849182129 time for calcul the mask position with numpy : 0.023674964904785156 nb_pixel_total : 212621 time to create 1 rle with new method : 0.6055071353912354 time for calcul the mask position with numpy : 0.024653196334838867 nb_pixel_total : 25708 time to create 1 rle with old method : 0.03012394905090332 time for calcul the mask position with numpy : 0.03516983985900879 nb_pixel_total : 362569 time to create 1 rle with new method : 0.7614624500274658 time for calcul the mask position with numpy : 0.02274012565612793 nb_pixel_total : 39840 time to create 1 rle with old method : 0.043039560317993164 time for calcul the mask position with numpy : 0.026012659072875977 nb_pixel_total : 155340 time to create 1 rle with new method : 0.7875864505767822 time for calcul the mask position with numpy : 0.021081209182739258 nb_pixel_total : 54669 time to create 1 rle with old method : 0.06029677391052246 time for calcul the mask position with numpy : 0.022940635681152344 nb_pixel_total : 53353 time to create 1 rle with old method : 0.05958080291748047 time for calcul the mask position with numpy : 0.023192882537841797 nb_pixel_total : 41026 time to create 1 rle with old method : 0.04540681838989258 create new chi : 6.853384256362915 time to delete rle : 0.003599405288696289 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++++++++++Number RLEs to save : 17266 TO DO : save crop sub photo not yet done ! save time : 1.0124282836914062 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 4.944128751754761 time for calcul the mask position with numpy : 0.5112640857696533 nb_pixel_total : 5523504 time to create 1 rle with new method : 0.4682178497314453 time for calcul the mask position with numpy : 0.03518319129943848 nb_pixel_total : 9350 time to create 1 rle with old method : 0.010461807250976562 time for calcul the mask position with numpy : 0.024839401245117188 nb_pixel_total : 151228 time to create 1 rle with new method : 0.40831708908081055 time for calcul the mask position with numpy : 0.02407550811767578 nb_pixel_total : 271129 time to create 1 rle with new method : 0.5467746257781982 time for calcul the mask position with numpy : 0.023492813110351562 nb_pixel_total : 262746 time to create 1 rle with new method : 0.8751561641693115 time for calcul the mask position with numpy : 0.021905899047851562 nb_pixel_total : 185788 time to create 1 rle with new method : 1.2441296577453613 time for calcul the mask position with numpy : 0.022523164749145508 nb_pixel_total : 97318 time to create 1 rle with old method : 0.10909819602966309 time for calcul the mask position with numpy : 0.023787975311279297 nb_pixel_total : 84870 time to create 1 rle with old method : 0.10132050514221191 time for calcul the mask position with numpy : 0.02338886260986328 nb_pixel_total : 67112 time to create 1 rle with old method : 0.07568883895874023 time for calcul the mask position with numpy : 0.024871349334716797 nb_pixel_total : 180659 time to create 1 rle with new method : 0.8366012573242188 time for calcul the mask position with numpy : 0.022897958755493164 nb_pixel_total : 57135 time to create 1 rle with old method : 0.06391096115112305 time for calcul the mask position with numpy : 0.02293992042541504 nb_pixel_total : 134861 time to create 1 rle with old method : 0.15083622932434082 time for calcul the mask position with numpy : 0.0232541561126709 nb_pixel_total : 24540 time to create 1 rle with old method : 0.027317285537719727 create new chi : 5.880690574645996 time to delete rle : 0.001956462860107422 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++Number RLEs to save : 11987 TO DO : save crop sub photo not yet done ! save time : 0.7221288681030273 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 4.537652254104614 time for calcul the mask position with numpy : 0.7035744190216064 nb_pixel_total : 6355220 time to create 1 rle with new method : 0.8001742362976074 time for calcul the mask position with numpy : 0.021952390670776367 nb_pixel_total : 51366 time to create 1 rle with old method : 0.06128382682800293 time for calcul the mask position with numpy : 0.02062082290649414 nb_pixel_total : 27867 time to create 1 rle with old method : 0.031091928482055664 time for calcul the mask position with numpy : 0.021294832229614258 nb_pixel_total : 111649 time to create 1 rle with old method : 0.12720060348510742 time for calcul the mask position with numpy : 0.021670103073120117 nb_pixel_total : 38523 time to create 1 rle with old method : 0.04266214370727539 time for calcul the mask position with numpy : 0.021311521530151367 nb_pixel_total : 74301 time to create 1 rle with old method : 0.08186149597167969 time for calcul the mask position with numpy : 0.021758079528808594 nb_pixel_total : 51482 time to create 1 rle with old method : 0.057593584060668945 time for calcul the mask position with numpy : 0.022063493728637695 nb_pixel_total : 57552 time to create 1 rle with old method : 0.0644540786743164 time for calcul the mask position with numpy : 0.022323131561279297 nb_pixel_total : 118317 time to create 1 rle with old method : 0.13061046600341797 time for calcul the mask position with numpy : 0.022222280502319336 nb_pixel_total : 151757 time to create 1 rle with new method : 1.1329636573791504 time for calcul the mask position with numpy : 0.03440356254577637 nb_pixel_total : 12206 time to create 1 rle with old method : 0.013799190521240234 create new chi : 3.542173147201538 time to delete rle : 0.0019609928131103516 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 7866 TO DO : save crop sub photo not yet done ! save time : 0.607213020324707 nb_obj : 16 nb_hashtags : 4 time to prepare the origin masks : 6.503294944763184 time for calcul the mask position with numpy : 0.6690943241119385 nb_pixel_total : 6333394 time to create 1 rle with new method : 0.6229286193847656 time for calcul the mask position with numpy : 0.03388333320617676 nb_pixel_total : 13453 time to create 1 rle with old method : 0.014401912689208984 time for calcul the mask position with numpy : 0.03499960899353027 nb_pixel_total : 71215 time to create 1 rle with old method : 0.07840991020202637 time for calcul the mask position with numpy : 0.037615299224853516 nb_pixel_total : 28358 time to create 1 rle with old method : 0.030958175659179688 time for calcul the mask position with numpy : 0.033338069915771484 nb_pixel_total : 8605 time to create 1 rle with old method : 0.009623527526855469 time for calcul the mask position with numpy : 0.03494620323181152 nb_pixel_total : 94988 time to create 1 rle with old method : 0.11082863807678223 time for calcul the mask position with numpy : 0.038559675216674805 nb_pixel_total : 30612 time to create 1 rle with old method : 0.03398013114929199 time for calcul the mask position with numpy : 0.033284664154052734 nb_pixel_total : 17996 time to create 1 rle with old method : 0.01963210105895996 time for calcul the mask position with numpy : 0.03386974334716797 nb_pixel_total : 21944 time to create 1 rle with old method : 0.024406909942626953 time for calcul the mask position with numpy : 0.024927139282226562 nb_pixel_total : 206220 time to create 1 rle with new method : 0.6610400676727295 time for calcul the mask position with numpy : 0.020427227020263672 nb_pixel_total : 14789 time to create 1 rle with old method : 0.016078472137451172 time for calcul the mask position with numpy : 0.02110743522644043 nb_pixel_total : 103894 time to create 1 rle with old method : 0.11201643943786621 time for calcul the mask position with numpy : 0.02114081382751465 nb_pixel_total : 39338 time to create 1 rle with old method : 0.042724609375 time for calcul the mask position with numpy : 0.020955562591552734 nb_pixel_total : 25206 time to create 1 rle with old method : 0.027370452880859375 time for calcul the mask position with numpy : 0.021251201629638672 nb_pixel_total : 12016 time to create 1 rle with old method : 0.01340937614440918 time for calcul the mask position with numpy : 0.021475791931152344 nb_pixel_total : 12251 time to create 1 rle with old method : 0.014358758926391602 time for calcul the mask position with numpy : 0.027638912200927734 nb_pixel_total : 15961 time to create 1 rle with old method : 0.01713728904724121 create new chi : 3.0424795150756836 time to delete rle : 0.0016105175018310547 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 11061 TO DO : save crop sub photo not yet done ! save time : 0.6570093631744385 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 6.255799293518066 time for calcul the mask position with numpy : 0.6382589340209961 nb_pixel_total : 6599777 time to create 1 rle with new method : 1.0460948944091797 time for calcul the mask position with numpy : 0.021944522857666016 nb_pixel_total : 33193 time to create 1 rle with old method : 0.03692460060119629 time for calcul the mask position with numpy : 0.020658016204833984 nb_pixel_total : 30026 time to create 1 rle with old method : 0.0352625846862793 time for calcul the mask position with numpy : 0.023311614990234375 nb_pixel_total : 29014 time to create 1 rle with old method : 0.04690885543823242 time for calcul the mask position with numpy : 0.022379398345947266 nb_pixel_total : 41816 time to create 1 rle with old method : 0.04719281196594238 time for calcul the mask position with numpy : 0.020838260650634766 nb_pixel_total : 10542 time to create 1 rle with old method : 0.011886358261108398 time for calcul the mask position with numpy : 0.02092576026916504 nb_pixel_total : 85809 time to create 1 rle with old method : 0.09541630744934082 time for calcul the mask position with numpy : 0.022290468215942383 nb_pixel_total : 91306 time to create 1 rle with old method : 0.09892749786376953 time for calcul the mask position with numpy : 0.02095484733581543 nb_pixel_total : 29710 time to create 1 rle with old method : 0.0323030948638916 time for calcul the mask position with numpy : 0.021698474884033203 nb_pixel_total : 8942 time to create 1 rle with old method : 0.010033369064331055 time for calcul the mask position with numpy : 0.021053075790405273 nb_pixel_total : 15292 time to create 1 rle with old method : 0.01761770248413086 time for calcul the mask position with numpy : 0.019961118698120117 nb_pixel_total : 28545 time to create 1 rle with old method : 0.0312652587890625 time for calcul the mask position with numpy : 0.02162647247314453 nb_pixel_total : 18201 time to create 1 rle with old method : 0.023067712783813477 time for calcul the mask position with numpy : 0.02079463005065918 nb_pixel_total : 28067 time to create 1 rle with old method : 0.031035423278808594 create new chi : 2.5195188522338867 time to delete rle : 0.0012784004211425781 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 8252 TO DO : save crop sub photo not yet done ! save time : 0.5090959072113037 nb_obj : 18 nb_hashtags : 4 time to prepare the origin masks : 6.247772216796875 time for calcul the mask position with numpy : 0.5355854034423828 nb_pixel_total : 6560403 time to create 1 rle with new method : 1.0459716320037842 time for calcul the mask position with numpy : 0.02106785774230957 nb_pixel_total : 3977 time to create 1 rle with old method : 0.004357337951660156 time for calcul the mask position with numpy : 0.03520393371582031 nb_pixel_total : 9343 time to create 1 rle with old method : 0.010371685028076172 time for calcul the mask position with numpy : 0.03509354591369629 nb_pixel_total : 13643 time to create 1 rle with old method : 0.014900684356689453 time for calcul the mask position with numpy : 0.021746397018432617 nb_pixel_total : 36900 time to create 1 rle with old method : 0.040239810943603516 time for calcul the mask position with numpy : 0.022946834564208984 nb_pixel_total : 68045 time to create 1 rle with old method : 0.07623934745788574 time for calcul the mask position with numpy : 0.020264863967895508 nb_pixel_total : 28872 time to create 1 rle with old method : 0.031668901443481445 time for calcul the mask position with numpy : 0.020505428314208984 nb_pixel_total : 27911 time to create 1 rle with old method : 0.03058481216430664 time for calcul the mask position with numpy : 0.021336078643798828 nb_pixel_total : 42510 time to create 1 rle with old method : 0.046331167221069336 time for calcul the mask position with numpy : 0.021692991256713867 nb_pixel_total : 21191 time to create 1 rle with old method : 0.023605823516845703 time for calcul the mask position with numpy : 0.021821975708007812 nb_pixel_total : 24894 time to create 1 rle with old method : 0.026913166046142578 time for calcul the mask position with numpy : 0.02015399932861328 nb_pixel_total : 26416 time to create 1 rle with old method : 0.028751134872436523 time for calcul the mask position with numpy : 0.022083520889282227 nb_pixel_total : 16879 time to create 1 rle with old method : 0.02023625373840332 time for calcul the mask position with numpy : 0.02099895477294922 nb_pixel_total : 17074 time to create 1 rle with old method : 0.019199609756469727 time for calcul the mask position with numpy : 0.024116992950439453 nb_pixel_total : 36175 time to create 1 rle with old method : 0.040261030197143555 time for calcul the mask position with numpy : 0.02174067497253418 nb_pixel_total : 25212 time to create 1 rle with old method : 0.028287410736083984 time for calcul the mask position with numpy : 0.022615432739257812 nb_pixel_total : 29177 time to create 1 rle with old method : 0.03231239318847656 time for calcul the mask position with numpy : 0.023494482040405273 nb_pixel_total : 27782 time to create 1 rle with old method : 0.031137466430664062 time for calcul the mask position with numpy : 0.024925947189331055 nb_pixel_total : 33836 time to create 1 rle with old method : 0.038007497787475586 create new chi : 2.5878517627716064 time to delete rle : 0.001421213150024414 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 9038 TO DO : save crop sub photo not yet done ! save time : 0.5681300163269043 nb_obj : 21 nb_hashtags : 3 time to prepare the origin masks : 8.003610134124756 time for calcul the mask position with numpy : 0.7071340084075928 nb_pixel_total : 5795292 time to create 1 rle with new method : 0.9411096572875977 time for calcul the mask position with numpy : 0.02198052406311035 nb_pixel_total : 23111 time to create 1 rle with old method : 0.02615976333618164 time for calcul the mask position with numpy : 0.02231597900390625 nb_pixel_total : 18561 time to create 1 rle with old method : 0.02038097381591797 time for calcul the mask position with numpy : 0.02074599266052246 nb_pixel_total : 9746 time to create 1 rle with old method : 0.010946989059448242 time for calcul the mask position with numpy : 0.021678924560546875 nb_pixel_total : 67611 time to create 1 rle with old method : 0.07558012008666992 time for calcul the mask position with numpy : 0.02156209945678711 nb_pixel_total : 50539 time to create 1 rle with old method : 0.05555295944213867 time for calcul the mask position with numpy : 0.026218414306640625 nb_pixel_total : 26123 time to create 1 rle with old method : 0.028890609741210938 time for calcul the mask position with numpy : 0.023183822631835938 nb_pixel_total : 108849 time to create 1 rle with old method : 0.12300777435302734 time for calcul the mask position with numpy : 0.021432876586914062 nb_pixel_total : 30161 time to create 1 rle with old method : 0.03395438194274902 time for calcul the mask position with numpy : 0.02336263656616211 nb_pixel_total : 144491 time to create 1 rle with old method : 0.1754286289215088 time for calcul the mask position with numpy : 0.02080702781677246 nb_pixel_total : 6970 time to create 1 rle with old method : 0.007566928863525391 time for calcul the mask position with numpy : 0.02040696144104004 nb_pixel_total : 17589 time to create 1 rle with old method : 0.019489765167236328 time for calcul the mask position with numpy : 0.02286529541015625 nb_pixel_total : 137690 time to create 1 rle with old method : 0.18155598640441895 time for calcul the mask position with numpy : 0.021970748901367188 nb_pixel_total : 23426 time to create 1 rle with old method : 0.026111364364624023 time for calcul the mask position with numpy : 0.02282571792602539 nb_pixel_total : 180568 time to create 1 rle with new method : 0.8786461353302002 time for calcul the mask position with numpy : 0.022443771362304688 nb_pixel_total : 100663 time to create 1 rle with old method : 0.1112828254699707 time for calcul the mask position with numpy : 0.023650407791137695 nb_pixel_total : 4863 time to create 1 rle with old method : 0.005507707595825195 time for calcul the mask position with numpy : 0.025120019912719727 nb_pixel_total : 26082 time to create 1 rle with old method : 0.02900075912475586 time for calcul the mask position with numpy : 0.0283811092376709 nb_pixel_total : 20252 time to create 1 rle with old method : 0.02296733856201172 time for calcul the mask position with numpy : 0.023616790771484375 nb_pixel_total : 76891 time to create 1 rle with old method : 0.11117744445800781 time for calcul the mask position with numpy : 0.021724224090576172 nb_pixel_total : 42320 time to create 1 rle with old method : 0.048456668853759766 time for calcul the mask position with numpy : 0.022235393524169922 nb_pixel_total : 138442 time to create 1 rle with old method : 0.16489171981811523 create new chi : 4.348629951477051 time to delete rle : 0.0024683475494384766 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 14491 TO DO : save crop sub photo not yet done ! save time : 0.8757648468017578 nb_obj : 23 nb_hashtags : 5 time to prepare the origin masks : 9.217499494552612 time for calcul the mask position with numpy : 0.8757040500640869 nb_pixel_total : 6148316 time to create 1 rle with new method : 0.7917020320892334 time for calcul the mask position with numpy : 0.02158975601196289 nb_pixel_total : 41002 time to create 1 rle with old method : 0.04460573196411133 time for calcul the mask position with numpy : 0.021456241607666016 nb_pixel_total : 8858 time to create 1 rle with old method : 0.009833812713623047 time for calcul the mask position with numpy : 0.020491838455200195 nb_pixel_total : 5084 time to create 1 rle with old method : 0.005525350570678711 time for calcul the mask position with numpy : 0.028744220733642578 nb_pixel_total : 11864 time to create 1 rle with old method : 0.012677907943725586 time for calcul the mask position with numpy : 0.03435158729553223 nb_pixel_total : 10350 time to create 1 rle with old method : 0.01128244400024414 time for calcul the mask position with numpy : 0.03439593315124512 nb_pixel_total : 65635 time to create 1 rle with old method : 0.07023882865905762 time for calcul the mask position with numpy : 0.022876501083374023 nb_pixel_total : 93404 time to create 1 rle with old method : 0.09774255752563477 time for calcul the mask position with numpy : 0.021527528762817383 nb_pixel_total : 101671 time to create 1 rle with old method : 0.10822010040283203 time for calcul the mask position with numpy : 0.02111363410949707 nb_pixel_total : 11018 time to create 1 rle with old method : 0.011952638626098633 time for calcul the mask position with numpy : 0.021555185317993164 nb_pixel_total : 9152 time to create 1 rle with old method : 0.010004997253417969 time for calcul the mask position with numpy : 0.02077484130859375 nb_pixel_total : 15093 time to create 1 rle with old method : 0.016510963439941406 time for calcul the mask position with numpy : 0.020617961883544922 nb_pixel_total : 15181 time to create 1 rle with old method : 0.016124725341796875 time for calcul the mask position with numpy : 0.021318674087524414 nb_pixel_total : 31401 time to create 1 rle with old method : 0.034642934799194336 time for calcul the mask position with numpy : 0.023865938186645508 nb_pixel_total : 14152 time to create 1 rle with old method : 0.016112327575683594 time for calcul the mask position with numpy : 0.022882938385009766 nb_pixel_total : 9569 time to create 1 rle with old method : 0.012542724609375 time for calcul the mask position with numpy : 0.0246279239654541 nb_pixel_total : 45902 time to create 1 rle with old method : 0.049260854721069336 time for calcul the mask position with numpy : 0.021741390228271484 nb_pixel_total : 11426 time to create 1 rle with old method : 0.012144327163696289 time for calcul the mask position with numpy : 0.022020339965820312 nb_pixel_total : 28785 time to create 1 rle with old method : 0.030627727508544922 time for calcul the mask position with numpy : 0.022489070892333984 nb_pixel_total : 114079 time to create 1 rle with old method : 0.1204526424407959 time for calcul the mask position with numpy : 0.021346569061279297 nb_pixel_total : 72031 time to create 1 rle with old method : 0.07697749137878418 time for calcul the mask position with numpy : 0.021044015884399414 nb_pixel_total : 43149 time to create 1 rle with old method : 0.04528379440307617 time for calcul the mask position with numpy : 0.020661592483520508 nb_pixel_total : 124199 time to create 1 rle with old method : 0.13134312629699707 time for calcul the mask position with numpy : 0.021387577056884766 nb_pixel_total : 18919 time to create 1 rle with old method : 0.020080089569091797 create new chi : 3.2036499977111816 time to delete rle : 0.002306699752807617 batch 1 Loaded 47 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 14688 TO DO : save crop sub photo not yet done ! save time : 0.936826229095459 map_output_result : {1356800727: (0.0, 'Should be the crop_list due to order', 0), 1356800723: (0.0, 'Should be the crop_list due to order', 0), 1356800719: (0.0, 'Should be the crop_list due to order', 0), 1356800716: (0.0, 'Should be the crop_list due to order', 0), 1356800680: (0.0, 'Should be the crop_list due to order', 0), 1356753798: (0.0, 'Should be the crop_list due to order', 0), 1356753796: (0.0, 'Should be the crop_list due to order', 0), 1356753793: (0.0, 'Should be the crop_list due to order', 0), 1356753791: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1356800727, 1356800723, 1356800719, 1356800716, 1356800680, 1356753798, 1356753796, 1356753793, 1356753791] Looping around the photos to save general results len do output : 9 /1356800727.Didn't retrieve data . /1356800723.Didn't retrieve data . /1356800719.Didn't retrieve data . /1356800716.Didn't retrieve data . /1356800680.Didn't retrieve data . /1356753798.Didn't retrieve data . /1356753796.Didn't retrieve data . /1356753793.Didn't retrieve data . /1356753791.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800727', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800723', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800719', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800716', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800680', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753798', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753796', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753793', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753791', None, None, None, None, None, '2805084') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.012898921966552734 save_final save missing photos in datou_result : time spend for datou_step_exec : 104.21403312683105 time spend to save output : 0.013328790664672852 total time spend for step 3 : 104.22736191749573 step4:ventilate_hashtags_in_portfolio Wed May 7 21:25:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22787314 get user id for portfolio 22787314 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22787314 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','mal_croppe','carton','autre','flou','pet_clair','metal','pehd','papier','pet_fonce','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22787314 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','mal_croppe','carton','autre','flou','pet_clair','metal','pehd','papier','pet_fonce','environnement')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22787314 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','mal_croppe','carton','autre','flou','pet_clair','metal','pehd','papier','pet_fonce','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22788029,22788030,22788031,22788032,22788033,22788034,22788035,22788036,22788037,22788038,22788039?tags=background,mal_croppe,carton,autre,flou,pet_clair,metal,pehd,papier,pet_fonce,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1356800727, 1356800723, 1356800719, 1356800716, 1356800680, 1356753798, 1356753796, 1356753793, 1356753791] Looping around the photos to save general results len do output : 1 /22787314. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800727', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800723', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800719', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800716', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800680', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753798', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753796', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753793', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753791', None, None, None, None, None, '2805084') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.013841390609741211 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5189225673675537 time spend to save output : 0.014105796813964844 total time spend for step 4 : 1.5330283641815186 step5:final Wed May 7 21:25:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1356800727: ('0.15521626056544008',), 1356800723: ('0.15521626056544008',), 1356800719: ('0.15521626056544008',), 1356800716: ('0.15521626056544008',), 1356800680: ('0.15521626056544008',), 1356753798: ('0.15521626056544008',), 1356753796: ('0.15521626056544008',), 1356753793: ('0.15521626056544008',), 1356753791: ('0.15521626056544008',)} new output for save of step final : {1356800727: ('0.15521626056544008',), 1356800723: ('0.15521626056544008',), 1356800719: ('0.15521626056544008',), 1356800716: ('0.15521626056544008',), 1356800680: ('0.15521626056544008',), 1356753798: ('0.15521626056544008',), 1356753796: ('0.15521626056544008',), 1356753793: ('0.15521626056544008',), 1356753791: ('0.15521626056544008',)} [1356800727, 1356800723, 1356800719, 1356800716, 1356800680, 1356753798, 1356753796, 1356753793, 1356753791] Looping around the photos to save general results len do output : 9 /1356800727.Didn't retrieve data . /1356800723.Didn't retrieve data . /1356800719.Didn't retrieve data . /1356800716.Didn't retrieve data . /1356800680.Didn't retrieve data . /1356753798.Didn't retrieve data . /1356753796.Didn't retrieve data . /1356753793.Didn't retrieve data . /1356753791.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800727', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800723', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800719', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800716', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800680', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753798', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753796', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753793', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753791', None, None, None, None, None, '2805084') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.013073205947875977 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10541796684265137 time spend to save output : 0.013519048690795898 total time spend for step 5 : 0.11893701553344727 step6:blur_detection Wed May 7 21:25:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5.jpg resize: (2160, 3264) 1356800727 -1.4417966278016954 treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67.jpg resize: (2160, 3264) 1356800723 -0.9078252386886517 treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa.jpg resize: (2160, 3264) 1356800719 2.194761551114932 treat image : temp/1746645629_2467086_1356800716_ddcd7c0a0853cdb156e1706e0444740f.jpg resize: (2160, 3264) 1356800716 -2.0640079222745458 treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9.jpg resize: (2160, 3264) 1356800680 1.5385897541163094 treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe.jpg resize: (2160, 3264) 1356753798 -3.40210936562494 treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289.jpg resize: (2160, 3264) 1356753796 -0.833973275810394 treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a.jpg resize: (2160, 3264) 1356753793 0.2708967451655281 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0.jpg resize: (2160, 3264) 1356753791 -2.1584677497332683 treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465231_0.png resize: (226, 253) 1356859615 -2.7788182294612187 treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465233_0.png resize: (268, 331) 1356859618 -2.4299570498712932 treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465234_0.png resize: (600, 355) 1356859619 -0.682970486701343 treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465235_0.png resize: (198, 225) 1356859620 0.12154792364189189 treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465237_0.png resize: (351, 316) 1356859621 -2.378668878955542 treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465241_0.png resize: (522, 276) 1356859624 -2.5043137530759347 treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465242_0.png resize: (1015, 1285) 1356859625 -0.39764685996491883 treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465243_0.png resize: (302, 244) 1356859626 -0.7304301495807183 treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465245_0.png resize: (149, 103) 1356859628 -1.372550284027279 treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465246_0.png resize: (526, 307) 1356859630 -1.0689317770529445 treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465247_0.png resize: (283, 332) 1356859631 -1.9261946318425653 treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465250_0.png resize: (306, 222) 1356859632 -1.014580085147716 treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465254_0.png resize: (311, 235) 1356859635 -2.1928047285143353 treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465255_0.png resize: (1215, 461) 1356859636 -0.7008105640152571 treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465258_0.png resize: (495, 154) 1356859637 -2.346427252840256 treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465259_0.png resize: (324, 693) 1356859640 -0.5645629457965871 treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465260_0.png resize: (487, 680) 1356859642 -0.958500172848287 treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465261_0.png resize: (370, 497) 1356859643 -0.282644601911954 treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465262_0.png resize: (355, 314) 1356859644 -1.2387337019353204 treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465264_0.png resize: (1033, 996) 1356859647 -1.3487738286052875 treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465266_0.png resize: (484, 477) 1356859648 -1.0851296937245403 treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465268_0.png resize: (513, 521) 1356859649 -0.27758114968464304 treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465269_0.png resize: (587, 193) 1356859652 -1.1532110876796935 treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465270_0.png resize: (262, 434) 1356859653 -0.8780582436604237 treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465271_0.png resize: (383, 359) 1356859654 -0.45747361012634113 treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465272_0.png resize: (468, 660) 1356859656 -1.1772706692679122 treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465273_0.png resize: (350, 881) 1356859658 0.14766620780336404 treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465275_0.png resize: (510, 545) 1356859659 -0.1913147221857811 treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465276_0.png resize: (103, 104) 1356859660 2.0192232670391483 treat image : temp/1746645629_2467086_1356800716_ddcd7c0a0853cdb156e1706e0444740f_rle_crop_3789465277_0.png resize: (81, 192) 1356859663 0.2062248923090497 treat image : temp/1746645629_2467086_1356800716_ddcd7c0a0853cdb156e1706e0444740f_rle_crop_3789465286_0.png resize: (287, 226) 1356859664 0.21915403430652117 treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465287_0.png resize: (105, 187) 1356859665 -0.2304066194627938 treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465288_0.png resize: (148, 107) 1356859667 -0.6175191172831801 treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465289_0.png resize: (113, 183) 1356859669 -1.60850139331362 treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465291_0.png resize: (288, 245) 1356859670 -1.1643968232119184 treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465293_0.png resize: (105, 192) 1356859671 -0.6621298351012878 treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465295_0.png resize: (174, 150) 1356859674 0.5316471297817479 treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465297_0.png resize: (312, 173) 1356859675 -1.422110013005055 treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465298_0.png resize: (512, 326) 1356859676 -0.3445734282488771 treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465299_0.png resize: (217, 98) 1356859678 -1.1878544538387161 treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465301_0.png resize: (362, 304) 1356859680 -1.141723530627892 treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465303_0.png resize: (235, 184) 1356859681 -2.937140288861421 treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465305_0.png resize: (177, 267) 1356859682 -1.2779164575908928 treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465306_0.png resize: (137, 153) 1356859685 -1.0971217697612459 treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465307_0.png resize: (150, 81) 1356859686 -1.4967897654110733 treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465309_0.png resize: (477, 356) 1356859687 -1.7400517321743825 treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465311_0.png resize: (129, 154) 1356859689 -3.439146497988737 treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465313_0.png resize: (228, 221) 1356859691 -2.3059543363821313 treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465316_0.png resize: (200, 256) 1356859692 -1.0970049811510558 treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465317_0.png resize: (162, 213) 1356859694 0.6925426257643515 treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465319_0.png resize: (263, 143) 1356859696 -1.13276322807539 treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465321_0.png resize: (177, 188) 1356859697 -1.9759283766656737 treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465322_0.png resize: (147, 137) 1356859698 0.7186490660159491 treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465325_0.png resize: (263, 109) 1356859700 -0.5703984617587468 treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465329_0.png resize: (279, 308) 1356859702 -0.7102615722048843 treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465333_0.png resize: (87, 60) 1356859703 -0.3096245711864782 treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465334_0.png resize: (498, 475) 1356859705 -0.8640209526080316 treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465336_0.png resize: (279, 342) 1356859707 0.20941394129202712 treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465337_0.png resize: (249, 182) 1356859708 -0.7234689846469764 treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465338_0.png resize: (143, 231) 1356859709 -0.4800573593824643 treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465339_0.png resize: (95, 60) 1356859712 2.380695504210145 treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465341_0.png resize: (607, 442) 1356859713 -0.44221621898306934 treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465342_0.png resize: (135, 247) 1356859714 -1.783966466344019 treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465343_0.png resize: (440, 536) 1356859716 -1.038477032480728 treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465344_0.png resize: (179, 148) 1356859718 -1.9285637590636064 treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465345_0.png resize: (99, 100) 1356859719 -0.6780544046083725 treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465346_0.png resize: (476, 377) 1356859720 0.747350358427642 treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465347_0.png resize: (222, 181) 1356859723 -0.40410102236004836 treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465349_0.png resize: (244, 175) 1356859724 -0.2710053405235551 treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465351_0.png resize: (357, 346) 1356859725 -0.43505940491753664 treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465352_0.png resize: (113, 105) 1356859727 0.9017076959225709 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465355_0.png resize: (162, 172) 1356859729 -1.0495513741054874 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465357_0.png resize: (275, 269) 1356859730 -0.8505618448628628 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465358_0.png resize: (528, 192) 1356859731 -1.5716957193796885 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465360_0.png resize: (247, 192) 1356859734 -2.0637074155762405 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465361_0.png resize: (146, 142) 1356859735 -2.307319652064425 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465362_0.png resize: (344, 200) 1356859736 -0.877019502019966 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465363_0.png resize: (102, 118) 1356859738 -1.4799707468498788 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465364_0.png resize: (163, 110) 1356859740 -0.6948836628160111 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465366_0.png resize: (231, 129) 1356859741 -2.607371344521847 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465367_0.png resize: (180, 122) 1356859743 -1.4183154946248326 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465368_0.png resize: (133, 96) 1356859745 -1.4367428814047427 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465369_0.png resize: (86, 158) 1356859746 1.2700819330647284 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465371_0.png resize: (669, 280) 1356859748 -0.3506371904807908 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465372_0.png resize: (357, 298) 1356859750 -0.9742884343025143 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465376_0.png resize: (135, 92) 1356859751 -2.372025153957442 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465377_0.png resize: (284, 336) 1356859753 -2.2771393674897364 treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465236_0.png resize: (140, 138) 1356860112 -2.0352689392640095 treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465249_0.png resize: (151, 259) 1356860114 -1.3414953499820232 treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465253_0.png resize: (528, 708) 1356860116 -1.4400454792898534 treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465263_0.png resize: (194, 203) 1356860117 -0.7634065048337045 treat image : temp/1746645629_2467086_1356800716_ddcd7c0a0853cdb156e1706e0444740f_rle_crop_3789465284_0.png resize: (416, 485) 1356860118 -0.26472490276460997 treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465294_0.png resize: (763, 446) 1356860120 -0.11048355314868981 treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465304_0.png resize: (150, 154) 1356860122 -0.10944937282176416 treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465308_0.png resize: (169, 240) 1356860123 -1.4760401447385878 treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465312_0.png resize: (232, 294) 1356860125 -1.8445217809867238 treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465320_0.png resize: (202, 235) 1356860127 0.11645615847410587 treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465327_0.png resize: (199, 195) 1356860130 -0.5680487658856098 treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465331_0.png resize: (135, 167) 1356860133 -1.030192495561582 treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465335_0.png resize: (302, 237) 1356860135 -1.7593571729781377 treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465353_0.png resize: (243, 95) 1356860136 -0.23908285070046428 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465375_0.png resize: (98, 88) 1356860137 -1.8873658335314636 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465374_0.png resize: (77, 188) 1356860165 -3.3971911835895026 treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465232_0.png resize: (306, 431) 1356860951 -1.559632319981264 treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465238_0.png resize: (201, 354) 1356860952 -1.630155131893268 treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465239_0.png resize: (573, 363) 1356860954 -2.2202570358136584 treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465240_0.png resize: (916, 889) 1356860958 -2.646051680021955 treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465248_0.png resize: (223, 162) 1356860959 -2.464433864785482 treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465251_0.png resize: (139, 526) 1356860960 -1.044995090958047 treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465252_0.png resize: (221, 422) 1356860964 -1.6443922445389716 treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465256_0.png resize: (162, 269) 1356860966 -1.9741761717627133 treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465257_0.png resize: (370, 719) 1356860967 -0.5017001856818821 treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465267_0.png resize: (254, 284) 1356860969 0.6122889423062413 treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465274_0.png resize: (346, 1240) 1356860973 -0.39217301663056503 treat image : temp/1746645629_2467086_1356800716_ddcd7c0a0853cdb156e1706e0444740f_rle_crop_3789465278_0.png resize: (352, 621) 1356860974 1.0694834135660036 treat image : temp/1746645629_2467086_1356800716_ddcd7c0a0853cdb156e1706e0444740f_rle_crop_3789465279_0.png resize: (387, 400) 1356860975 -1.0014343539339767 treat image : temp/1746645629_2467086_1356800716_ddcd7c0a0853cdb156e1706e0444740f_rle_crop_3789465280_0.png resize: (267, 369) 1356860980 -2.534244546876089 treat image : temp/1746645629_2467086_1356800716_ddcd7c0a0853cdb156e1706e0444740f_rle_crop_3789465281_0.png resize: (267, 286) 1356860981 -1.5235145290090435 treat image : temp/1746645629_2467086_1356800716_ddcd7c0a0853cdb156e1706e0444740f_rle_crop_3789465282_0.png resize: (243, 416) 1356860982 -3.1222013801471946 treat image : temp/1746645629_2467086_1356800716_ddcd7c0a0853cdb156e1706e0444740f_rle_crop_3789465283_0.png resize: (198, 261) 1356860985 -1.1081037908956597 treat image : temp/1746645629_2467086_1356800716_ddcd7c0a0853cdb156e1706e0444740f_rle_crop_3789465285_0.png resize: (167, 215) 1356860988 -2.1083868767377396 treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465296_0.png resize: (207, 108) 1356860989 -0.16740169086074813 treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465300_0.png resize: (159, 273) 1356860991 -1.7330083722893297 treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465302_0.png resize: (101, 172) 1356860995 -0.2855326487479431 treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465310_0.png resize: (371, 315) 1356860996 -2.654878537948646 treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465314_0.png resize: (129, 284) 1356860997 -0.7327173130722955 treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465315_0.png resize: (233, 290) 1356861002 -1.79906907517292 treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465318_0.png resize: (182, 199) 1356861003 -1.7776697649022992 treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465323_0.png resize: (154, 233) 1356861004 -1.2267677214086217 treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465324_0.png resize: (212, 143) 1356861006 -1.3347716342200564 treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465326_0.png resize: (223, 262) 1356861010 -0.9770978423869192 treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465328_0.png resize: (180, 224) 1356861011 -2.043840943367439 treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465330_0.png resize: (170, 271) 1356861013 -0.9588970723582402 treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465340_0.png resize: (378, 328) 1356861017 -0.717753490001994 treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465348_0.png resize: (362, 383) 1356861018 -1.7652232565322268 treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465350_0.png resize: (207, 341) 1356861019 -1.051152137353941 treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465354_0.png resize: (224, 191) 1356861022 -1.718551500162342 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465356_0.png resize: (269, 599) 1356861025 -0.9137446245819209 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465359_0.png resize: (354, 391) 1356861026 -1.293726146935877 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465365_0.png resize: (150, 270) 1356861028 -3.0349897942328266 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465370_0.png resize: (452, 324) 1356861032 -1.0048846256682653 treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465265_0.png resize: (176, 174) 1356861123 -0.4898031554463858 treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465290_0.png resize: (210, 178) 1356861125 -0.49881436354053227 treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465292_0.png resize: (601, 312) 1356861128 -0.0938010031254701 treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465332_0.png resize: (92, 132) 1356861129 -0.7820305208376973 treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465373_0.png resize: (106, 121) 1356861131 0.1571937920195492 treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465244_0.png resize: (306, 194) 1356861168 -1.0795056415913038 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 156 time used for this insertion : 0.018720626831054688 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 156 time used for this insertion : 0.031095504760742188 save missing photos in datou_result : time spend for datou_step_exec : 35.254026889801025 time spend to save output : 0.05542635917663574 total time spend for step 6 : 35.30945324897766 step7:brightness Wed May 7 21:25:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5.jpg treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67.jpg treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa.jpg treat image : temp/1746645629_2467086_1356800716_ddcd7c0a0853cdb156e1706e0444740f.jpg treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9.jpg treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe.jpg treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289.jpg treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a.jpg treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0.jpg treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465231_0.png treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465233_0.png treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465234_0.png treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465235_0.png treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465237_0.png treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465241_0.png treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465242_0.png treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465243_0.png treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465245_0.png treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465246_0.png treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465247_0.png treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465250_0.png treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465254_0.png treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465255_0.png treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465258_0.png treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465259_0.png treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465260_0.png treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465261_0.png treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465262_0.png treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465264_0.png treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465266_0.png treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465268_0.png treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465269_0.png treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465270_0.png treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465271_0.png treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465272_0.png treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465273_0.png treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465275_0.png treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465276_0.png treat image : temp/1746645629_2467086_1356800716_ddcd7c0a0853cdb156e1706e0444740f_rle_crop_3789465277_0.png treat image : temp/1746645629_2467086_1356800716_ddcd7c0a0853cdb156e1706e0444740f_rle_crop_3789465286_0.png treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465287_0.png treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465288_0.png treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465289_0.png treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465291_0.png treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465293_0.png treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465295_0.png treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465297_0.png treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465298_0.png treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465299_0.png treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465301_0.png treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465303_0.png treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465305_0.png treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465306_0.png treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465307_0.png treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465309_0.png treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465311_0.png treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465313_0.png treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465316_0.png treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465317_0.png treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465319_0.png treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465321_0.png treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465322_0.png treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465325_0.png treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465329_0.png treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465333_0.png treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465334_0.png treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465336_0.png treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465337_0.png treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465338_0.png treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465339_0.png treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465341_0.png treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465342_0.png treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465343_0.png treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465344_0.png treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465345_0.png treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465346_0.png treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465347_0.png treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465349_0.png treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465351_0.png treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465352_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465355_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465357_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465358_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465360_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465361_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465362_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465363_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465364_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465366_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465367_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465368_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465369_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465371_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465372_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465376_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465377_0.png treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465236_0.png treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465249_0.png treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465253_0.png treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465263_0.png treat image : temp/1746645629_2467086_1356800716_ddcd7c0a0853cdb156e1706e0444740f_rle_crop_3789465284_0.png treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465294_0.png treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465304_0.png treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465308_0.png treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465312_0.png treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465320_0.png treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465327_0.png treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465331_0.png treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465335_0.png treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465353_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465375_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465374_0.png treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465232_0.png treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465238_0.png treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465239_0.png treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465240_0.png treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465248_0.png treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465251_0.png treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465252_0.png treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465256_0.png treat image : temp/1746645629_2467086_1356800723_3d482f3069f22360f3bda1f938364b67_rle_crop_3789465257_0.png treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465267_0.png treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465274_0.png treat image : temp/1746645629_2467086_1356800716_ddcd7c0a0853cdb156e1706e0444740f_rle_crop_3789465278_0.png treat image : temp/1746645629_2467086_1356800716_ddcd7c0a0853cdb156e1706e0444740f_rle_crop_3789465279_0.png treat image : temp/1746645629_2467086_1356800716_ddcd7c0a0853cdb156e1706e0444740f_rle_crop_3789465280_0.png treat image : temp/1746645629_2467086_1356800716_ddcd7c0a0853cdb156e1706e0444740f_rle_crop_3789465281_0.png treat image : temp/1746645629_2467086_1356800716_ddcd7c0a0853cdb156e1706e0444740f_rle_crop_3789465282_0.png treat image : temp/1746645629_2467086_1356800716_ddcd7c0a0853cdb156e1706e0444740f_rle_crop_3789465283_0.png treat image : temp/1746645629_2467086_1356800716_ddcd7c0a0853cdb156e1706e0444740f_rle_crop_3789465285_0.png treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465296_0.png treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465300_0.png treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465302_0.png treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465310_0.png treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465314_0.png treat image : temp/1746645629_2467086_1356753798_1070ab1c6fe531c662ad68b0b92691fe_rle_crop_3789465315_0.png treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465318_0.png treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465323_0.png treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465324_0.png treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465326_0.png treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465328_0.png treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465330_0.png treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465340_0.png treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465348_0.png treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465350_0.png treat image : temp/1746645629_2467086_1356753793_c8a6c3b4f57f15a41e8154d5e700a61a_rle_crop_3789465354_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465356_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465359_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465365_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465370_0.png treat image : temp/1746645629_2467086_1356800719_6b00332577991d1d9f4a487ecd6010fa_rle_crop_3789465265_0.png treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465290_0.png treat image : temp/1746645629_2467086_1356800680_408e0599deccb35e459cc860db5170d9_rle_crop_3789465292_0.png treat image : temp/1746645629_2467086_1356753796_470f1d7a47a80ec0a2b0e206afc7b289_rle_crop_3789465332_0.png treat image : temp/1746645629_2467086_1356753791_61d0ccd5c2889d510ff7cd540ee3a3f0_rle_crop_3789465373_0.png treat image : temp/1746645629_2467086_1356800727_1b45ce532005883ad54f4811bfa643a5_rle_crop_3789465244_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 156 time used for this insertion : 0.018224477767944336 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 156 time used for this insertion : 0.030822038650512695 save missing photos in datou_result : time spend for datou_step_exec : 8.871131896972656 time spend to save output : 0.05396580696105957 total time spend for step 7 : 8.925097703933716 step8:velours_tree Wed May 7 21:25:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.17775416374206543 time spend to save output : 4.1961669921875e-05 total time spend for step 8 : 0.1777961254119873 step9:send_mail_cod Wed May 7 21:25:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22787314_07-05-2025_21_25_56.pdf 22788029 imagette227880291746645956 22788030 imagette227880301746645956 22788031 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227880311746645956 22788032 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227880321746645957 22788033 imagette227880331746645957 22788034 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227880341746645957 22788035 change filename to text .imagette227880351746645959 22788036 change filename to text .imagette227880361746645959 22788037 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227880371746645959 22788038 imagette227880381746645960 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22787314 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22788029,22788030,22788031,22788032,22788033,22788034,22788035,22788036,22788037,22788038,22788039?tags=background,mal_croppe,carton,autre,flou,pet_clair,metal,pehd,papier,pet_fonce,environnement args[1356800727] : ((1356800727, -1.4417966278016954, 492688767), (1356800727, -0.10138623026653089, 496442774), '0.15521626056544008') We are sending mail with results at report@fotonower.com args[1356800723] : ((1356800723, -0.9078252386886517, 492688767), (1356800723, 0.13957493585466188, 2107752395), '0.15521626056544008') We are sending mail with results at report@fotonower.com args[1356800719] : ((1356800719, 2.194761551114932, 492688767), (1356800719, 0.019502433629641498, 2107752395), '0.15521626056544008') We are sending mail with results at report@fotonower.com args[1356800716] : ((1356800716, -2.0640079222745458, 492609224), (1356800716, 0.7372466501279645, 2107752395), '0.15521626056544008') We are sending mail with results at report@fotonower.com args[1356800680] : ((1356800680, 1.5385897541163094, 492688767), (1356800680, -0.05249098215316761, 2107752395), '0.15521626056544008') We are sending mail with results at report@fotonower.com args[1356753798] : ((1356753798, -3.40210936562494, 492609224), (1356753798, 0.14912644952057402, 2107752395), '0.15521626056544008') We are sending mail with results at report@fotonower.com args[1356753796] : ((1356753796, -0.833973275810394, 492688767), (1356753796, -0.034290499741732726, 2107752395), '0.15521626056544008') We are sending mail with results at report@fotonower.com args[1356753793] : ((1356753793, 0.2708967451655281, 492688767), (1356753793, 0.06554043366378996, 2107752395), '0.15521626056544008') We are sending mail with results at report@fotonower.com args[1356753791] : ((1356753791, -2.1584677497332683, 492609224), (1356753791, -0.10170950125964598, 496442774), '0.15521626056544008') We are sending mail with results at report@fotonower.com refus_total : 0.15521626056544008 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22787314 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22787314_07-05-2025_21_25_56.pdf results_Auto_P22787314_07-05-2025_21_25_56.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22787314_07-05-2025_21_25_56.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22787314','results_Auto_P22787314_07-05-2025_21_25_56.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22787314_07-05-2025_21_25_56.pdf','pdf','','0.61','0.15521626056544008') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22787314

https://www.fotonower.com/image?json=false&list_photos_id=1356800727
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356800723
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356800719
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.194761551114932)
https://www.fotonower.com/image?json=false&list_photos_id=1356800716
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356800680
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.5385897541163094)
https://www.fotonower.com/image?json=false&list_photos_id=1356753798
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356753796
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356753793
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356753791
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 15.52%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/22788031?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22788032?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22788034?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/22788035?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/22788036?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22788037?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22787314_07-05-2025_21_25_56.pdf.

Lien vers velours :https://www.fotonower.com/velours/22788029,22788030,22788031,22788032,22788033,22788034,22788035,22788036,22788037,22788038,22788039?tags=background,mal_croppe,carton,autre,flou,pet_clair,metal,pehd,papier,pet_fonce,environnement.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 07 May 2025 19:26:03 GMT Content-Length: 0 Connection: close X-Message-Id: Mket-LYRQXKQWapHzOdAZw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1356800727, 1356800723, 1356800719, 1356800716, 1356800680, 1356753798, 1356753796, 1356753793, 1356753791] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800727', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800723', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800719', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800716', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800680', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753798', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753796', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753793', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753791', None, None, None, None, None, '2805084') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014014005661010742 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.994187831878662 time spend to save output : 0.014319658279418945 total time spend for step 9 : 7.008507490158081 step10:split_time_score Wed May 7 21:26:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('17', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 07052025 22787314 Nombre de photos uploadées : 9 / 23040 (0%) 07052025 22787314 Nombre de photos taguées (types de déchets): 0 / 9 (0%) 07052025 22787314 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 4.0531158447265625e-06 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.0003936290740966797 elapsed_time : insert_dashboard_record_day_entry 0.023225069046020508 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.11345237892610745 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22755885_07-05-2025_08_15_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22755885 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22755885 AND mptpi.`type`=3594 To do Qualite : 0.13392497985884166 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22758212_07-05-2025_09_15_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22758212 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22758212 AND mptpi.`type`=3594 To do Qualite : 0.04687108504624727 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22758941_07-05-2025_09_41_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22758941 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22758941 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22773719 order by id desc limit 1 Qualite : 0.13204628494916487 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22773739_07-05-2025_16_37_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22773739 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22773739 AND mptpi.`type`=3594 To do Qualite : 0.15027050906723088 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22773740_07-05-2025_17_38_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22773740 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22773740 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22787288 order by id desc limit 1 Qualite : 0.14444157220179737 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22773755_07-05-2025_18_34_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22773755 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22773755 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22787289 order by id desc limit 1 Qualite : 0.03329469809169341 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22773759_07-05-2025_16_12_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22773759 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22773759 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22787309 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22787310 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22787311 order by id desc limit 1 Qualite : 0.15521626056544008 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22787314_07-05-2025_21_25_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22787314 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22787314 AND mptpi.`type`=3594 To do Qualite : 0.03521087491683661 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22787316_07-05-2025_21_22_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22787316 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22787316 AND mptpi.`type`=3726 To do Qualite : 0.12926770341624308 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22787324_07-05-2025_21_15_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22787324 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22787324 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'07052025': {'nb_upload': 9, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1356800727, 1356800723, 1356800719, 1356800716, 1356800680, 1356753798, 1356753796, 1356753793, 1356753791] Looping around the photos to save general results len do output : 1 /22787314Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800727', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800723', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800719', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800716', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356800680', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753798', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753796', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753793', None, None, None, None, None, '2805084') ('3318', None, None, None, None, None, None, None, '2805084') ('3318', '22787314', '1356753791', None, None, None, None, None, '2805084') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.013384580612182617 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.059542655944824 time spend to save output : 0.013644218444824219 total time spend for step 10 : 6.073186874389648 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 148.19user 130.09system 5:45.10elapsed 80%CPU (0avgtext+0avgdata 4957792maxresident)k 590408inputs+86488outputs (8198major+12664233minor)pagefaults 0swaps