python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 604886 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3670588'] with mtr_portfolio_ids : ['26582094'] and first list_photo_ids : [] new path : /proc/604886/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 7 ; length of list_pids : 7 ; length of list_args : 7 time to download the photos : 1.3482494354248047 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Sep 5 15:40:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10375 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-05 15:40:33.366668: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-05 15:40:33.392628: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-05 15:40:33.394607: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fc694000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-05 15:40:33.394666: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-05 15:40:33.398612: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-05 15:40:33.551805: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2989ab20 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-05 15:40:33.551858: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-05 15:40:33.553277: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-05 15:40:33.554050: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 15:40:33.558632: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 15:40:33.561782: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-05 15:40:33.563127: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-05 15:40:33.566685: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-05 15:40:33.568190: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-05 15:40:33.575792: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-05 15:40:33.577636: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-05 15:40:33.577723: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 15:40:33.578468: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-05 15:40:33.578484: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-05 15:40:33.578493: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-05 15:40:33.579789: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9609 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-05 15:40:33.895936: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-05 15:40:33.896074: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 15:40:33.896100: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 15:40:33.896123: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-05 15:40:33.896143: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-05 15:40:33.896164: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-05 15:40:33.896184: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-05 15:40:33.896205: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-05 15:40:33.897777: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-05 15:40:33.899400: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-05 15:40:33.899443: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 15:40:33.899465: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 15:40:33.899484: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-05 15:40:33.899504: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-05 15:40:33.899523: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-05 15:40:33.899542: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-05 15:40:33.899561: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-05 15:40:33.901159: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-05 15:40:33.901213: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-05 15:40:33.901222: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-05 15:40:33.901230: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-05 15:40:33.902542: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9609 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-05 15:40:43.576166: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 15:40:43.787760: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 39 Detection mask done ! Trying to reset tf kernel 605397 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 116 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5405 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0068531036376953125 nb_pixel_total : 128150 time to create 1 rle with old method : 0.15945839881896973 length of segment : 397 time for calcul the mask position with numpy : 0.012844562530517578 nb_pixel_total : 257697 time to create 1 rle with new method : 0.02282261848449707 length of segment : 642 time for calcul the mask position with numpy : 0.0064656734466552734 nb_pixel_total : 194110 time to create 1 rle with new method : 0.014689207077026367 length of segment : 482 time for calcul the mask position with numpy : 0.0015077590942382812 nb_pixel_total : 26091 time to create 1 rle with old method : 0.03144121170043945 length of segment : 237 time for calcul the mask position with numpy : 0.011947154998779297 nb_pixel_total : 105482 time to create 1 rle with old method : 0.13011884689331055 length of segment : 489 time for calcul the mask position with numpy : 0.007978200912475586 nb_pixel_total : 176167 time to create 1 rle with new method : 0.014981269836425781 length of segment : 498 time for calcul the mask position with numpy : 0.005296945571899414 nb_pixel_total : 139235 time to create 1 rle with old method : 0.17320966720581055 length of segment : 448 time for calcul the mask position with numpy : 0.0042438507080078125 nb_pixel_total : 90696 time to create 1 rle with old method : 0.11303257942199707 length of segment : 462 time for calcul the mask position with numpy : 0.0009496212005615234 nb_pixel_total : 20136 time to create 1 rle with old method : 0.024435043334960938 length of segment : 209 time for calcul the mask position with numpy : 0.006781578063964844 nb_pixel_total : 184480 time to create 1 rle with new method : 0.01660752296447754 length of segment : 517 time for calcul the mask position with numpy : 0.0014748573303222656 nb_pixel_total : 27416 time to create 1 rle with old method : 0.03687024116516113 length of segment : 240 time for calcul the mask position with numpy : 0.0024292469024658203 nb_pixel_total : 74301 time to create 1 rle with old method : 0.092498779296875 length of segment : 276 time for calcul the mask position with numpy : 0.0006957054138183594 nb_pixel_total : 15793 time to create 1 rle with old method : 0.020129919052124023 length of segment : 143 time for calcul the mask position with numpy : 0.001338958740234375 nb_pixel_total : 36574 time to create 1 rle with old method : 0.04912900924682617 length of segment : 336 time for calcul the mask position with numpy : 0.011721611022949219 nb_pixel_total : 183839 time to create 1 rle with new method : 0.2933661937713623 length of segment : 582 time for calcul the mask position with numpy : 0.0017881393432617188 nb_pixel_total : 35565 time to create 1 rle with old method : 0.04245162010192871 length of segment : 215 time for calcul the mask position with numpy : 0.0006358623504638672 nb_pixel_total : 10212 time to create 1 rle with old method : 0.012926816940307617 length of segment : 156 time for calcul the mask position with numpy : 0.0014081001281738281 nb_pixel_total : 41198 time to create 1 rle with old method : 0.07223033905029297 length of segment : 227 time for calcul the mask position with numpy : 0.002981901168823242 nb_pixel_total : 100300 time to create 1 rle with old method : 0.1190798282623291 length of segment : 612 time for calcul the mask position with numpy : 0.005743980407714844 nb_pixel_total : 169788 time to create 1 rle with new method : 0.009276151657104492 length of segment : 405 time for calcul the mask position with numpy : 0.0031614303588867188 nb_pixel_total : 86638 time to create 1 rle with old method : 0.10297489166259766 length of segment : 345 time for calcul the mask position with numpy : 0.006361484527587891 nb_pixel_total : 135000 time to create 1 rle with old method : 0.16540098190307617 length of segment : 597 time for calcul the mask position with numpy : 0.0011010169982910156 nb_pixel_total : 36627 time to create 1 rle with old method : 0.04472541809082031 length of segment : 285 time for calcul the mask position with numpy : 0.0021436214447021484 nb_pixel_total : 42539 time to create 1 rle with old method : 0.05130457878112793 length of segment : 298 time for calcul the mask position with numpy : 0.0014567375183105469 nb_pixel_total : 38701 time to create 1 rle with old method : 0.04724478721618652 length of segment : 365 time for calcul the mask position with numpy : 0.003015279769897461 nb_pixel_total : 51745 time to create 1 rle with old method : 0.06314706802368164 length of segment : 606 time for calcul the mask position with numpy : 0.002493619918823242 nb_pixel_total : 67698 time to create 1 rle with old method : 0.08057832717895508 length of segment : 362 time for calcul the mask position with numpy : 0.0036056041717529297 nb_pixel_total : 58358 time to create 1 rle with old method : 0.0724177360534668 length of segment : 479 time for calcul the mask position with numpy : 0.0007040500640869141 nb_pixel_total : 6660 time to create 1 rle with old method : 0.011964082717895508 length of segment : 106 time for calcul the mask position with numpy : 0.002448558807373047 nb_pixel_total : 49376 time to create 1 rle with old method : 0.058249711990356445 length of segment : 290 time for calcul the mask position with numpy : 0.0005197525024414062 nb_pixel_total : 7856 time to create 1 rle with old method : 0.009588003158569336 length of segment : 152 time for calcul the mask position with numpy : 0.0011589527130126953 nb_pixel_total : 15143 time to create 1 rle with old method : 0.018429279327392578 length of segment : 181 time for calcul the mask position with numpy : 0.0054473876953125 nb_pixel_total : 112201 time to create 1 rle with old method : 0.1533641815185547 length of segment : 504 time for calcul the mask position with numpy : 0.0028641223907470703 nb_pixel_total : 55759 time to create 1 rle with old method : 0.06658458709716797 length of segment : 293 time for calcul the mask position with numpy : 0.002422809600830078 nb_pixel_total : 63465 time to create 1 rle with old method : 0.07580065727233887 length of segment : 285 time for calcul the mask position with numpy : 0.0016548633575439453 nb_pixel_total : 25474 time to create 1 rle with old method : 0.030620098114013672 length of segment : 205 time for calcul the mask position with numpy : 0.0026116371154785156 nb_pixel_total : 37358 time to create 1 rle with old method : 0.05232739448547363 length of segment : 303 time for calcul the mask position with numpy : 0.0064699649810791016 nb_pixel_total : 79750 time to create 1 rle with old method : 0.09527039527893066 length of segment : 677 time for calcul the mask position with numpy : 0.0009114742279052734 nb_pixel_total : 33497 time to create 1 rle with old method : 0.04223060607910156 length of segment : 310 time for calcul the mask position with numpy : 0.0060329437255859375 nb_pixel_total : 163800 time to create 1 rle with new method : 0.009310245513916016 length of segment : 458 time for calcul the mask position with numpy : 0.0031425952911376953 nb_pixel_total : 59349 time to create 1 rle with old method : 0.08122014999389648 length of segment : 374 time for calcul the mask position with numpy : 0.00864553451538086 nb_pixel_total : 265484 time to create 1 rle with new method : 0.01638960838317871 length of segment : 538 time for calcul the mask position with numpy : 0.0018200874328613281 nb_pixel_total : 44753 time to create 1 rle with old method : 0.052704811096191406 length of segment : 414 time for calcul the mask position with numpy : 0.007179975509643555 nb_pixel_total : 108965 time to create 1 rle with old method : 0.13282489776611328 length of segment : 993 time for calcul the mask position with numpy : 0.004693269729614258 nb_pixel_total : 123945 time to create 1 rle with old method : 0.17972397804260254 length of segment : 391 time for calcul the mask position with numpy : 0.005811214447021484 nb_pixel_total : 99353 time to create 1 rle with old method : 0.12969422340393066 length of segment : 472 time for calcul the mask position with numpy : 0.0063517093658447266 nb_pixel_total : 156869 time to create 1 rle with new method : 0.014702558517456055 length of segment : 558 time for calcul the mask position with numpy : 0.0019767284393310547 nb_pixel_total : 36275 time to create 1 rle with old method : 0.04226231575012207 length of segment : 248 time for calcul the mask position with numpy : 0.0018768310546875 nb_pixel_total : 37765 time to create 1 rle with old method : 0.04431295394897461 length of segment : 286 time for calcul the mask position with numpy : 0.0025742053985595703 nb_pixel_total : 64328 time to create 1 rle with old method : 0.07827472686767578 length of segment : 322 time for calcul the mask position with numpy : 0.004202842712402344 nb_pixel_total : 81001 time to create 1 rle with old method : 0.10646748542785645 length of segment : 414 time for calcul the mask position with numpy : 0.0013599395751953125 nb_pixel_total : 19441 time to create 1 rle with old method : 0.02453446388244629 length of segment : 221 time for calcul the mask position with numpy : 0.0023174285888671875 nb_pixel_total : 30643 time to create 1 rle with old method : 0.04331851005554199 length of segment : 579 time for calcul the mask position with numpy : 0.0024285316467285156 nb_pixel_total : 36078 time to create 1 rle with old method : 0.047336578369140625 length of segment : 386 time for calcul the mask position with numpy : 0.0006465911865234375 nb_pixel_total : 12126 time to create 1 rle with old method : 0.014760255813598633 length of segment : 119 time for calcul the mask position with numpy : 0.001247406005859375 nb_pixel_total : 25435 time to create 1 rle with old method : 0.030701637268066406 length of segment : 240 time for calcul the mask position with numpy : 0.0017352104187011719 nb_pixel_total : 26362 time to create 1 rle with old method : 0.03440403938293457 length of segment : 217 time for calcul the mask position with numpy : 0.0036656856536865234 nb_pixel_total : 73003 time to create 1 rle with old method : 0.09678530693054199 length of segment : 411 time for calcul the mask position with numpy : 0.11012935638427734 nb_pixel_total : 709000 time to create 1 rle with new method : 0.2563903331756592 length of segment : 999 time for calcul the mask position with numpy : 0.0010471343994140625 nb_pixel_total : 15740 time to create 1 rle with old method : 0.019043922424316406 length of segment : 322 time for calcul the mask position with numpy : 0.005887269973754883 nb_pixel_total : 138925 time to create 1 rle with old method : 0.17479562759399414 length of segment : 365 time for calcul the mask position with numpy : 0.0034265518188476562 nb_pixel_total : 55135 time to create 1 rle with old method : 0.06638193130493164 length of segment : 728 time for calcul the mask position with numpy : 0.008973360061645508 nb_pixel_total : 151189 time to create 1 rle with new method : 0.020758867263793945 length of segment : 362 time for calcul the mask position with numpy : 0.0029256343841552734 nb_pixel_total : 91773 time to create 1 rle with old method : 0.10931253433227539 length of segment : 372 time for calcul the mask position with numpy : 0.0010128021240234375 nb_pixel_total : 35007 time to create 1 rle with old method : 0.04215550422668457 length of segment : 279 time for calcul the mask position with numpy : 0.008580923080444336 nb_pixel_total : 281851 time to create 1 rle with new method : 0.01564645767211914 length of segment : 648 time for calcul the mask position with numpy : 0.026574373245239258 nb_pixel_total : 649887 time to create 1 rle with new method : 0.11480903625488281 length of segment : 1518 time for calcul the mask position with numpy : 0.0009593963623046875 nb_pixel_total : 17654 time to create 1 rle with old method : 0.021288156509399414 length of segment : 415 time for calcul the mask position with numpy : 0.0025320053100585938 nb_pixel_total : 46691 time to create 1 rle with old method : 0.056543827056884766 length of segment : 307 time for calcul the mask position with numpy : 0.0011017322540283203 nb_pixel_total : 25720 time to create 1 rle with old method : 0.03129434585571289 length of segment : 211 time for calcul the mask position with numpy : 0.005128622055053711 nb_pixel_total : 129774 time to create 1 rle with old method : 0.15414857864379883 length of segment : 450 time for calcul the mask position with numpy : 0.004654407501220703 nb_pixel_total : 126498 time to create 1 rle with old method : 0.15480804443359375 length of segment : 651 time for calcul the mask position with numpy : 0.0030145645141601562 nb_pixel_total : 66902 time to create 1 rle with old method : 0.08627653121948242 length of segment : 466 time for calcul the mask position with numpy : 0.00536799430847168 nb_pixel_total : 134446 time to create 1 rle with old method : 0.15898942947387695 length of segment : 403 time for calcul the mask position with numpy : 0.021516084671020508 nb_pixel_total : 772846 time to create 1 rle with new method : 0.04723787307739258 length of segment : 852 time for calcul the mask position with numpy : 0.0026013851165771484 nb_pixel_total : 47010 time to create 1 rle with old method : 0.05693793296813965 length of segment : 445 time for calcul the mask position with numpy : 0.005910158157348633 nb_pixel_total : 142437 time to create 1 rle with old method : 0.17801523208618164 length of segment : 535 time for calcul the mask position with numpy : 0.003224611282348633 nb_pixel_total : 48033 time to create 1 rle with old method : 0.05872297286987305 length of segment : 345 time for calcul the mask position with numpy : 0.0006487369537353516 nb_pixel_total : 39027 time to create 1 rle with old method : 0.047481536865234375 length of segment : 172 time for calcul the mask position with numpy : 0.0003409385681152344 nb_pixel_total : 7069 time to create 1 rle with old method : 0.008754968643188477 length of segment : 90 time for calcul the mask position with numpy : 0.0024671554565429688 nb_pixel_total : 60662 time to create 1 rle with old method : 0.07418990135192871 length of segment : 400 time for calcul the mask position with numpy : 0.0009510517120361328 nb_pixel_total : 14804 time to create 1 rle with old method : 0.017876386642456055 length of segment : 321 time for calcul the mask position with numpy : 0.0006351470947265625 nb_pixel_total : 17101 time to create 1 rle with old method : 0.021007537841796875 length of segment : 130 time for calcul the mask position with numpy : 0.0017757415771484375 nb_pixel_total : 72561 time to create 1 rle with old method : 0.09194493293762207 length of segment : 296 time for calcul the mask position with numpy : 0.004803657531738281 nb_pixel_total : 116304 time to create 1 rle with old method : 0.14055562019348145 length of segment : 456 time for calcul the mask position with numpy : 0.005700349807739258 nb_pixel_total : 169731 time to create 1 rle with new method : 0.007905960083007812 length of segment : 535 time for calcul the mask position with numpy : 0.0009391307830810547 nb_pixel_total : 31232 time to create 1 rle with old method : 0.03791236877441406 length of segment : 133 time for calcul the mask position with numpy : 0.0033304691314697266 nb_pixel_total : 77341 time to create 1 rle with old method : 0.09377741813659668 length of segment : 518 time for calcul the mask position with numpy : 0.00313568115234375 nb_pixel_total : 125705 time to create 1 rle with old method : 0.16579055786132812 length of segment : 378 time for calcul the mask position with numpy : 0.0011970996856689453 nb_pixel_total : 18779 time to create 1 rle with old method : 0.022821664810180664 length of segment : 289 time for calcul the mask position with numpy : 0.0030565261840820312 nb_pixel_total : 76025 time to create 1 rle with old method : 0.09063076972961426 length of segment : 421 time for calcul the mask position with numpy : 0.006732940673828125 nb_pixel_total : 245531 time to create 1 rle with new method : 0.0115814208984375 length of segment : 567 time for calcul the mask position with numpy : 0.0007297992706298828 nb_pixel_total : 18332 time to create 1 rle with old method : 0.022405385971069336 length of segment : 222 time for calcul the mask position with numpy : 0.0016667842864990234 nb_pixel_total : 40788 time to create 1 rle with old method : 0.049558162689208984 length of segment : 209 time for calcul the mask position with numpy : 0.002122163772583008 nb_pixel_total : 48222 time to create 1 rle with old method : 0.058197736740112305 length of segment : 323 time for calcul the mask position with numpy : 0.0026569366455078125 nb_pixel_total : 70008 time to create 1 rle with old method : 0.08397531509399414 length of segment : 348 time for calcul the mask position with numpy : 0.00493168830871582 nb_pixel_total : 86041 time to create 1 rle with old method : 0.10372638702392578 length of segment : 522 time for calcul the mask position with numpy : 0.014310359954833984 nb_pixel_total : 309129 time to create 1 rle with new method : 0.02171015739440918 length of segment : 866 time for calcul the mask position with numpy : 0.002819538116455078 nb_pixel_total : 47490 time to create 1 rle with old method : 0.05628848075866699 length of segment : 390 time for calcul the mask position with numpy : 0.0008718967437744141 nb_pixel_total : 14592 time to create 1 rle with old method : 0.017903804779052734 length of segment : 129 time for calcul the mask position with numpy : 0.004189729690551758 nb_pixel_total : 113510 time to create 1 rle with old method : 0.13283491134643555 length of segment : 381 time for calcul the mask position with numpy : 0.0004229545593261719 nb_pixel_total : 8012 time to create 1 rle with old method : 0.009847640991210938 length of segment : 149 time for calcul the mask position with numpy : 0.0009737014770507812 nb_pixel_total : 13893 time to create 1 rle with old method : 0.01726698875427246 length of segment : 209 time for calcul the mask position with numpy : 0.013504981994628906 nb_pixel_total : 266072 time to create 1 rle with new method : 0.030079364776611328 length of segment : 1222 time for calcul the mask position with numpy : 0.008481979370117188 nb_pixel_total : 98637 time to create 1 rle with old method : 0.12096953392028809 length of segment : 578 time for calcul the mask position with numpy : 0.00867319107055664 nb_pixel_total : 88907 time to create 1 rle with old method : 0.10706925392150879 length of segment : 613 time for calcul the mask position with numpy : 0.002412080764770508 nb_pixel_total : 35901 time to create 1 rle with old method : 0.0431058406829834 length of segment : 346 time for calcul the mask position with numpy : 0.005671262741088867 nb_pixel_total : 125327 time to create 1 rle with old method : 0.14950799942016602 length of segment : 599 time for calcul the mask position with numpy : 0.006322145462036133 nb_pixel_total : 108932 time to create 1 rle with old method : 0.13105249404907227 length of segment : 684 time for calcul the mask position with numpy : 0.006882667541503906 nb_pixel_total : 119492 time to create 1 rle with old method : 0.1510634422302246 length of segment : 560 time for calcul the mask position with numpy : 0.0017020702362060547 nb_pixel_total : 31106 time to create 1 rle with old method : 0.03723764419555664 length of segment : 370 time for calcul the mask position with numpy : 0.0012576580047607422 nb_pixel_total : 18937 time to create 1 rle with old method : 0.023441076278686523 length of segment : 227 time for calcul the mask position with numpy : 0.0015611648559570312 nb_pixel_total : 26839 time to create 1 rle with old method : 0.03458213806152344 length of segment : 268 time for calcul the mask position with numpy : 0.002912759780883789 nb_pixel_total : 51407 time to create 1 rle with old method : 0.06133246421813965 length of segment : 437 time for calcul the mask position with numpy : 0.006374359130859375 nb_pixel_total : 101893 time to create 1 rle with old method : 0.12473797798156738 length of segment : 508 time for calcul the mask position with numpy : 0.0020186901092529297 nb_pixel_total : 29794 time to create 1 rle with old method : 0.049927473068237305 length of segment : 227 time for calcul the mask position with numpy : 0.004410982131958008 nb_pixel_total : 74997 time to create 1 rle with old method : 0.09195470809936523 length of segment : 384 time for calcul the mask position with numpy : 0.0012128353118896484 nb_pixel_total : 38844 time to create 1 rle with old method : 0.05204463005065918 length of segment : 289 time for calcul the mask position with numpy : 0.003694772720336914 nb_pixel_total : 84509 time to create 1 rle with old method : 0.1101539134979248 length of segment : 392 time for calcul the mask position with numpy : 0.0041081905364990234 nb_pixel_total : 92825 time to create 1 rle with old method : 0.13068008422851562 length of segment : 779 time for calcul the mask position with numpy : 0.002103567123413086 nb_pixel_total : 68125 time to create 1 rle with old method : 0.08364176750183105 length of segment : 184 time for calcul the mask position with numpy : 0.0008375644683837891 nb_pixel_total : 26518 time to create 1 rle with old method : 0.03341937065124512 length of segment : 121 time for calcul the mask position with numpy : 0.0018897056579589844 nb_pixel_total : 43256 time to create 1 rle with old method : 0.053228139877319336 length of segment : 318 time for calcul the mask position with numpy : 0.0018851757049560547 nb_pixel_total : 33693 time to create 1 rle with old method : 0.04074382781982422 length of segment : 668 time spent for convertir_results : 18.17092275619507 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 124 chid ids of type : 3594 Number RLEs to save : 50758 save missing photos in datou_result : time spend for datou_step_exec : 79.7284004688263 time spend to save output : 2.948486328125 total time spend for step 1 : 82.6768867969513 step2:crop_condition Fri Sep 5 15:41:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 7 ! batch 1 Loaded 124 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 110 About to insert : list_path_to_insert length 110 new photo from crops ! About to upload 110 photos upload in portfolio : 3736932 init cache_photo without model_param we have 110 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757079761_604886 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 110 photos in the portfolio 3736932 time of upload the photos Elapsed time : 29.20289421081543 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757079793_604886 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.3950304985046387 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757079798_604886 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.9293100833892822 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757079801_604886 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5532310009002686 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757079803_604886 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.608102560043335 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757079806_604886 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8415045738220215 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1381762898, 1381762896, 1381762893, 1381762875, 1381762869, 1381762724, 1381762721] Looping around the photos to save general results len do output : 124 /1381773961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381773999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381774229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762898', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762896', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762893', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762875', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762869', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762724', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762721', None, None, None, None, None, '3670588') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 379 time used for this insertion : 0.026978731155395508 save_final save missing photos in datou_result : time spend for datou_step_exec : 94.75881743431091 time spend to save output : 0.030728578567504883 total time spend for step 2 : 94.78954601287842 step3:rle_unique_nms_with_priority Fri Sep 5 15:43:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 124 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 19 nb_hashtags : 4 time to prepare the origin masks : 6.840139627456665 time for calcul the mask position with numpy : 0.34870004653930664 nb_pixel_total : 6447051 time to create 1 rle with new method : 0.8064837455749512 time for calcul the mask position with numpy : 0.026392221450805664 nb_pixel_total : 100300 time to create 1 rle with old method : 0.1223905086517334 time for calcul the mask position with numpy : 0.029044151306152344 nb_pixel_total : 41198 time to create 1 rle with old method : 0.04955911636352539 time for calcul the mask position with numpy : 0.027862071990966797 nb_pixel_total : 10212 time to create 1 rle with old method : 0.012124300003051758 time for calcul the mask position with numpy : 0.028356313705444336 nb_pixel_total : 35565 time to create 1 rle with old method : 0.04355597496032715 time for calcul the mask position with numpy : 0.02826857566833496 nb_pixel_total : 183805 time to create 1 rle with new method : 0.5176959037780762 time for calcul the mask position with numpy : 0.02547931671142578 nb_pixel_total : 36574 time to create 1 rle with old method : 0.042867422103881836 time for calcul the mask position with numpy : 0.0260159969329834 nb_pixel_total : 15734 time to create 1 rle with old method : 0.018447399139404297 time for calcul the mask position with numpy : 0.026747941970825195 nb_pixel_total : 74301 time to create 1 rle with old method : 0.11625981330871582 time for calcul the mask position with numpy : 0.02800583839416504 nb_pixel_total : 27416 time to create 1 rle with old method : 0.03680276870727539 time for calcul the mask position with numpy : 0.02869129180908203 nb_pixel_total : 184480 time to create 1 rle with new method : 0.3873941898345947 time for calcul the mask position with numpy : 0.02509284019470215 nb_pixel_total : 20136 time to create 1 rle with old method : 0.023624420166015625 time for calcul the mask position with numpy : 0.026285648345947266 nb_pixel_total : 90696 time to create 1 rle with old method : 0.10648775100708008 time for calcul the mask position with numpy : 0.02674245834350586 nb_pixel_total : 139235 time to create 1 rle with old method : 0.16247940063476562 time for calcul the mask position with numpy : 0.026660680770874023 nb_pixel_total : 176167 time to create 1 rle with new method : 1.036374568939209 time for calcul the mask position with numpy : 0.02595043182373047 nb_pixel_total : 105482 time to create 1 rle with old method : 0.13484477996826172 time for calcul the mask position with numpy : 0.025824308395385742 nb_pixel_total : 26091 time to create 1 rle with old method : 0.03378701210021973 time for calcul the mask position with numpy : 0.028546571731567383 nb_pixel_total : 194110 time to create 1 rle with new method : 0.5780761241912842 time for calcul the mask position with numpy : 0.030538558959960938 nb_pixel_total : 257697 time to create 1 rle with new method : 0.5307409763336182 time for calcul the mask position with numpy : 0.02805781364440918 nb_pixel_total : 128150 time to create 1 rle with old method : 0.15569424629211426 create new chi : 5.9663801193237305 time to delete rle : 0.049706220626831055 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 16455 TO DO : save crop sub photo not yet done ! save time : 0.8994402885437012 nb_obj : 14 nb_hashtags : 2 time to prepare the origin masks : 4.5870349407196045 time for calcul the mask position with numpy : 0.7607479095458984 nb_pixel_total : 7416224 time to create 1 rle with new method : 0.5467557907104492 time for calcul the mask position with numpy : 0.025260210037231445 nb_pixel_total : 112201 time to create 1 rle with old method : 0.14745306968688965 time for calcul the mask position with numpy : 0.024824142456054688 nb_pixel_total : 15143 time to create 1 rle with old method : 0.01961541175842285 time for calcul the mask position with numpy : 0.026363134384155273 nb_pixel_total : 7856 time to create 1 rle with old method : 0.011071920394897461 time for calcul the mask position with numpy : 0.025613784790039062 nb_pixel_total : 49376 time to create 1 rle with old method : 0.05756425857543945 time for calcul the mask position with numpy : 0.029906749725341797 nb_pixel_total : 6660 time to create 1 rle with old method : 0.00801849365234375 time for calcul the mask position with numpy : 0.02606058120727539 nb_pixel_total : 58358 time to create 1 rle with old method : 0.07361054420471191 time for calcul the mask position with numpy : 0.026387453079223633 nb_pixel_total : 67698 time to create 1 rle with old method : 0.07973003387451172 time for calcul the mask position with numpy : 0.02533411979675293 nb_pixel_total : 51745 time to create 1 rle with old method : 0.06104278564453125 time for calcul the mask position with numpy : 0.02572011947631836 nb_pixel_total : 38547 time to create 1 rle with old method : 0.04553627967834473 time for calcul the mask position with numpy : 0.029857635498046875 nb_pixel_total : 42539 time to create 1 rle with old method : 0.05490922927856445 time for calcul the mask position with numpy : 0.02586841583251953 nb_pixel_total : 36627 time to create 1 rle with old method : 0.04747605323791504 time for calcul the mask position with numpy : 0.02756357192993164 nb_pixel_total : 135000 time to create 1 rle with old method : 0.16374635696411133 time for calcul the mask position with numpy : 0.029158353805541992 nb_pixel_total : 86638 time to create 1 rle with old method : 0.10225057601928711 time for calcul the mask position with numpy : 0.025544166564941406 nb_pixel_total : 169788 time to create 1 rle with new method : 0.4669935703277588 create new chi : 3.0906591415405273 time to delete rle : 0.0017845630645751953 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 12100 TO DO : save crop sub photo not yet done ! save time : 0.7094128131866455 nb_obj : 25 nb_hashtags : 3 time to prepare the origin masks : 5.869900226593018 time for calcul the mask position with numpy : 0.35851263999938965 nb_pixel_total : 6554235 time to create 1 rle with new method : 0.5609278678894043 time for calcul the mask position with numpy : 0.026110410690307617 nb_pixel_total : 73003 time to create 1 rle with old method : 0.09085559844970703 time for calcul the mask position with numpy : 0.02674412727355957 nb_pixel_total : 20445 time to create 1 rle with old method : 0.02415919303894043 time for calcul the mask position with numpy : 0.026083707809448242 nb_pixel_total : 25435 time to create 1 rle with old method : 0.030132532119750977 time for calcul the mask position with numpy : 0.025822877883911133 nb_pixel_total : 12126 time to create 1 rle with old method : 0.014337539672851562 time for calcul the mask position with numpy : 0.02924036979675293 nb_pixel_total : 36078 time to create 1 rle with old method : 0.04342150688171387 time for calcul the mask position with numpy : 0.02604985237121582 nb_pixel_total : 30643 time to create 1 rle with old method : 0.04603433609008789 time for calcul the mask position with numpy : 0.03075385093688965 nb_pixel_total : 19441 time to create 1 rle with old method : 0.030632972717285156 time for calcul the mask position with numpy : 0.02758193016052246 nb_pixel_total : 81001 time to create 1 rle with old method : 0.1075735092163086 time for calcul the mask position with numpy : 0.02965998649597168 nb_pixel_total : 64328 time to create 1 rle with old method : 0.07514810562133789 time for calcul the mask position with numpy : 0.028383970260620117 nb_pixel_total : 37765 time to create 1 rle with old method : 0.04388260841369629 time for calcul the mask position with numpy : 0.026274681091308594 nb_pixel_total : 36275 time to create 1 rle with old method : 0.0516965389251709 time for calcul the mask position with numpy : 0.030104637145996094 nb_pixel_total : 156869 time to create 1 rle with new method : 0.5442061424255371 time for calcul the mask position with numpy : 0.025583267211914062 nb_pixel_total : 99353 time to create 1 rle with old method : 0.11517691612243652 time for calcul the mask position with numpy : 0.026269912719726562 nb_pixel_total : 123945 time to create 1 rle with old method : 0.14365172386169434 time for calcul the mask position with numpy : 0.025718212127685547 nb_pixel_total : 108965 time to create 1 rle with old method : 0.12908554077148438 time for calcul the mask position with numpy : 0.02575826644897461 nb_pixel_total : 44753 time to create 1 rle with old method : 0.052262306213378906 time for calcul the mask position with numpy : 0.027315855026245117 nb_pixel_total : 265484 time to create 1 rle with new method : 0.4425020217895508 time for calcul the mask position with numpy : 0.025269746780395508 nb_pixel_total : 59349 time to create 1 rle with old method : 0.0693202018737793 time for calcul the mask position with numpy : 0.026022911071777344 nb_pixel_total : 163800 time to create 1 rle with new method : 0.4574108123779297 time for calcul the mask position with numpy : 0.03298187255859375 nb_pixel_total : 19301 time to create 1 rle with old method : 0.027803421020507812 time for calcul the mask position with numpy : 0.037299156188964844 nb_pixel_total : 79750 time to create 1 rle with old method : 0.10666680335998535 time for calcul the mask position with numpy : 0.030381441116333008 nb_pixel_total : 37358 time to create 1 rle with old method : 0.04331159591674805 time for calcul the mask position with numpy : 0.027526378631591797 nb_pixel_total : 25474 time to create 1 rle with old method : 0.029607772827148438 time for calcul the mask position with numpy : 0.02619171142578125 nb_pixel_total : 63465 time to create 1 rle with old method : 0.07429122924804688 time for calcul the mask position with numpy : 0.026085853576660156 nb_pixel_total : 55759 time to create 1 rle with old method : 0.0747232437133789 create new chi : 4.622775554656982 time to delete rle : 0.0037331581115722656 batch 1 Loaded 51 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 21102 TO DO : save crop sub photo not yet done ! save time : 1.1089363098144531 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 4.787928819656372 time for calcul the mask position with numpy : 0.3125898838043213 nb_pixel_total : 6153872 time to create 1 rle with new method : 0.5528755187988281 time for calcul the mask position with numpy : 0.02404046058654785 nb_pixel_total : 46691 time to create 1 rle with old method : 0.054145097732543945 time for calcul the mask position with numpy : 0.024169921875 nb_pixel_total : 17654 time to create 1 rle with old method : 0.020688772201538086 time for calcul the mask position with numpy : 0.029198408126831055 nb_pixel_total : 605785 time to create 1 rle with new method : 0.8441565036773682 time for calcul the mask position with numpy : 0.02599501609802246 nb_pixel_total : 281851 time to create 1 rle with new method : 0.6084141731262207 time for calcul the mask position with numpy : 0.026065826416015625 nb_pixel_total : 34676 time to create 1 rle with old method : 0.04076576232910156 time for calcul the mask position with numpy : 0.026471853256225586 nb_pixel_total : 91773 time to create 1 rle with old method : 0.10571765899658203 time for calcul the mask position with numpy : 0.025078773498535156 nb_pixel_total : 151189 time to create 1 rle with new method : 0.39829421043395996 time for calcul the mask position with numpy : 0.024582862854003906 nb_pixel_total : 55135 time to create 1 rle with old method : 0.06840753555297852 time for calcul the mask position with numpy : 0.033159494400024414 nb_pixel_total : 131034 time to create 1 rle with old method : 0.17045974731445312 time for calcul the mask position with numpy : 0.025655746459960938 nb_pixel_total : 15740 time to create 1 rle with old method : 0.01845383644104004 time for calcul the mask position with numpy : 0.029972076416015625 nb_pixel_total : 709000 time to create 1 rle with new method : 0.5180079936981201 create new chi : 4.16424298286438 time to delete rle : 0.0019474029541015625 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 13755 TO DO : save crop sub photo not yet done ! save time : 0.752793550491333 nb_obj : 15 nb_hashtags : 1 time to prepare the origin masks : 5.791072607040405 time for calcul the mask position with numpy : 0.20720481872558594 nb_pixel_total : 6623058 time to create 1 rle with new method : 0.3766021728515625 time for calcul the mask position with numpy : 0.024600505828857422 nb_pixel_total : 72561 time to create 1 rle with old method : 0.09971451759338379 time for calcul the mask position with numpy : 0.025757789611816406 nb_pixel_total : 17101 time to create 1 rle with old method : 0.020274639129638672 time for calcul the mask position with numpy : 0.025868892669677734 nb_pixel_total : 14804 time to create 1 rle with old method : 0.017703771591186523 time for calcul the mask position with numpy : 0.025258541107177734 nb_pixel_total : 60415 time to create 1 rle with old method : 0.07097887992858887 time for calcul the mask position with numpy : 0.0327150821685791 nb_pixel_total : 7069 time to create 1 rle with old method : 0.009013652801513672 time for calcul the mask position with numpy : 0.03428483009338379 nb_pixel_total : 39027 time to create 1 rle with old method : 0.04836535453796387 time for calcul the mask position with numpy : 0.030504941940307617 nb_pixel_total : 48033 time to create 1 rle with old method : 0.055931806564331055 time for calcul the mask position with numpy : 0.024816036224365234 nb_pixel_total : 142437 time to create 1 rle with old method : 0.16414380073547363 time for calcul the mask position with numpy : 0.025984764099121094 nb_pixel_total : 47010 time to create 1 rle with old method : 0.05507349967956543 time for calcul the mask position with numpy : 0.0313868522644043 nb_pixel_total : 742233 time to create 1 rle with new method : 0.38759756088256836 time for calcul the mask position with numpy : 0.02779531478881836 nb_pixel_total : 134446 time to create 1 rle with old method : 0.1648099422454834 time for calcul the mask position with numpy : 0.026225566864013672 nb_pixel_total : 64214 time to create 1 rle with old method : 0.08829593658447266 time for calcul the mask position with numpy : 0.026368141174316406 nb_pixel_total : 126498 time to create 1 rle with old method : 0.17110967636108398 time for calcul the mask position with numpy : 0.024138689041137695 nb_pixel_total : 129774 time to create 1 rle with old method : 0.15757060050964355 time for calcul the mask position with numpy : 0.02391195297241211 nb_pixel_total : 25720 time to create 1 rle with old method : 0.03169679641723633 create new chi : 2.604616403579712 time to delete rle : 0.0021562576293945312 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 13165 TO DO : save crop sub photo not yet done ! save time : 0.7525930404663086 nb_obj : 20 nb_hashtags : 3 time to prepare the origin masks : 7.208343267440796 time for calcul the mask position with numpy : 0.6534357070922852 nb_pixel_total : 6398578 time to create 1 rle with new method : 0.9978382587432861 time for calcul the mask position with numpy : 0.028220653533935547 nb_pixel_total : 266072 time to create 1 rle with new method : 0.6427412033081055 time for calcul the mask position with numpy : 0.02505636215209961 nb_pixel_total : 13893 time to create 1 rle with old method : 0.02013373374938965 time for calcul the mask position with numpy : 0.04062533378601074 nb_pixel_total : 8010 time to create 1 rle with old method : 0.009560585021972656 time for calcul the mask position with numpy : 0.02694106101989746 nb_pixel_total : 113510 time to create 1 rle with old method : 0.13660693168640137 time for calcul the mask position with numpy : 0.02670907974243164 nb_pixel_total : 14592 time to create 1 rle with old method : 0.016706466674804688 time for calcul the mask position with numpy : 0.024653911590576172 nb_pixel_total : 47490 time to create 1 rle with old method : 0.0556032657623291 time for calcul the mask position with numpy : 0.026788711547851562 nb_pixel_total : 309129 time to create 1 rle with new method : 0.5855932235717773 time for calcul the mask position with numpy : 0.02692103385925293 nb_pixel_total : 86041 time to create 1 rle with old method : 0.11164069175720215 time for calcul the mask position with numpy : 0.02552175521850586 nb_pixel_total : 70008 time to create 1 rle with old method : 0.08969664573669434 time for calcul the mask position with numpy : 0.025973081588745117 nb_pixel_total : 48222 time to create 1 rle with old method : 0.05986285209655762 time for calcul the mask position with numpy : 0.025603055953979492 nb_pixel_total : 40788 time to create 1 rle with old method : 0.04857897758483887 time for calcul the mask position with numpy : 0.026140451431274414 nb_pixel_total : 18332 time to create 1 rle with old method : 0.021568775177001953 time for calcul the mask position with numpy : 0.02634739875793457 nb_pixel_total : 245531 time to create 1 rle with new method : 0.5333435535430908 time for calcul the mask position with numpy : 0.02623748779296875 nb_pixel_total : 76025 time to create 1 rle with old method : 0.11595368385314941 time for calcul the mask position with numpy : 0.02620244026184082 nb_pixel_total : 18779 time to create 1 rle with old method : 0.0221254825592041 time for calcul the mask position with numpy : 0.025906801223754883 nb_pixel_total : 124792 time to create 1 rle with old method : 0.14371299743652344 time for calcul the mask position with numpy : 0.02585768699645996 nb_pixel_total : 77341 time to create 1 rle with old method : 0.09000825881958008 time for calcul the mask position with numpy : 0.026047229766845703 nb_pixel_total : 31232 time to create 1 rle with old method : 0.036351919174194336 time for calcul the mask position with numpy : 0.026079177856445312 nb_pixel_total : 169731 time to create 1 rle with new method : 0.5027635097503662 time for calcul the mask position with numpy : 0.026041030883789062 nb_pixel_total : 116304 time to create 1 rle with old method : 0.1601243019104004 create new chi : 5.768961668014526 time to delete rle : 0.0029687881469726562 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 18620 TO DO : save crop sub photo not yet done ! save time : 1.007835865020752 nb_obj : 20 nb_hashtags : 3 time to prepare the origin masks : 7.344668388366699 time for calcul the mask position with numpy : 0.25641369819641113 nb_pixel_total : 6996462 time to create 1 rle with new method : 0.41167187690734863 time for calcul the mask position with numpy : 0.05122208595275879 nb_pixel_total : 33693 time to create 1 rle with old method : 0.04137563705444336 time for calcul the mask position with numpy : 0.04224753379821777 nb_pixel_total : 43256 time to create 1 rle with old method : 0.05067753791809082 time for calcul the mask position with numpy : 0.04230976104736328 nb_pixel_total : 26518 time to create 1 rle with old method : 0.034981727600097656 time for calcul the mask position with numpy : 0.05106854438781738 nb_pixel_total : 68125 time to create 1 rle with old method : 0.09552145004272461 time for calcul the mask position with numpy : 0.044693708419799805 nb_pixel_total : 92825 time to create 1 rle with old method : 0.12206387519836426 time for calcul the mask position with numpy : 0.03777909278869629 nb_pixel_total : 84509 time to create 1 rle with old method : 0.09943509101867676 time for calcul the mask position with numpy : 0.026322603225708008 nb_pixel_total : 37317 time to create 1 rle with old method : 0.04743027687072754 time for calcul the mask position with numpy : 0.026473283767700195 nb_pixel_total : 74523 time to create 1 rle with old method : 0.08730149269104004 time for calcul the mask position with numpy : 0.024867773056030273 nb_pixel_total : 29794 time to create 1 rle with old method : 0.03568124771118164 time for calcul the mask position with numpy : 0.029356718063354492 nb_pixel_total : 101893 time to create 1 rle with old method : 0.12416934967041016 time for calcul the mask position with numpy : 0.02569127082824707 nb_pixel_total : 51407 time to create 1 rle with old method : 0.06336760520935059 time for calcul the mask position with numpy : 0.04186725616455078 nb_pixel_total : 26839 time to create 1 rle with old method : 0.03490567207336426 time for calcul the mask position with numpy : 0.04220771789550781 nb_pixel_total : 18937 time to create 1 rle with old method : 0.024693965911865234 time for calcul the mask position with numpy : 0.04318380355834961 nb_pixel_total : 31106 time to create 1 rle with old method : 0.037421226501464844 time for calcul the mask position with numpy : 0.042128801345825195 nb_pixel_total : 119492 time to create 1 rle with old method : 0.14149951934814453 time for calcul the mask position with numpy : 0.045815229415893555 nb_pixel_total : 108932 time to create 1 rle with old method : 0.1290144920349121 time for calcul the mask position with numpy : 0.04341721534729004 nb_pixel_total : 125327 time to create 1 rle with old method : 0.16116952896118164 time for calcul the mask position with numpy : 0.03858017921447754 nb_pixel_total : 35901 time to create 1 rle with old method : 0.04172682762145996 time for calcul the mask position with numpy : 0.0266571044921875 nb_pixel_total : 88907 time to create 1 rle with old method : 0.10320854187011719 time for calcul the mask position with numpy : 0.025776386260986328 nb_pixel_total : 98637 time to create 1 rle with old method : 0.12369418144226074 create new chi : 3.0699703693389893 time to delete rle : 0.003030538558959961 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++Number RLEs to save : 19162 TO DO : save crop sub photo not yet done ! save time : 1.0438337326049805 map_output_result : {1381762898: (0.0, 'Should be the crop_list due to order', 0), 1381762896: (0.0, 'Should be the crop_list due to order', 0), 1381762893: (0.0, 'Should be the crop_list due to order', 0), 1381762875: (0.0, 'Should be the crop_list due to order', 0), 1381762869: (0.0, 'Should be the crop_list due to order', 0), 1381762724: (0.0, 'Should be the crop_list due to order', 0), 1381762721: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1381762898, 1381762896, 1381762893, 1381762875, 1381762869, 1381762724, 1381762721] Looping around the photos to save general results len do output : 7 /1381762898.Didn't retrieve data . /1381762896.Didn't retrieve data . /1381762893.Didn't retrieve data . /1381762875.Didn't retrieve data . /1381762869.Didn't retrieve data . /1381762724.Didn't retrieve data . /1381762721.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762898', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762896', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762893', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762875', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762869', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762724', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762721', None, None, None, None, None, '3670588') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.012318849563598633 save_final save missing photos in datou_result : time spend for datou_step_exec : 79.55615162849426 time spend to save output : 0.012792587280273438 total time spend for step 3 : 79.56894421577454 step4:ventilate_hashtags_in_portfolio Fri Sep 5 15:44:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26582094 get user id for portfolio 26582094 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26582094 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','mal_croppe','flou','carton','background','metal','papier','environnement','pet_fonce','pehd','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26582094 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','mal_croppe','flou','carton','background','metal','papier','environnement','pet_fonce','pehd','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26582094 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','mal_croppe','flou','carton','background','metal','papier','environnement','pet_fonce','pehd','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26582606,26582607,26582608,26582609,26582610,26582611,26582612,26582613,26582614,26582615,26582616?tags=autre,mal_croppe,flou,carton,background,metal,papier,environnement,pet_fonce,pehd,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1381762898, 1381762896, 1381762893, 1381762875, 1381762869, 1381762724, 1381762721] Looping around the photos to save general results len do output : 1 /26582094. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762898', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762896', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762893', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762875', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762869', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762724', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762721', None, None, None, None, None, '3670588') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.014782905578613281 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7192165851593018 time spend to save output : 0.015029668807983398 total time spend for step 4 : 1.7342462539672852 step5:final Fri Sep 5 15:44:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1381762898: ('0.19757426697530864',), 1381762896: ('0.19757426697530864',), 1381762893: ('0.19757426697530864',), 1381762875: ('0.19757426697530864',), 1381762869: ('0.19757426697530864',), 1381762724: ('0.19757426697530864',), 1381762721: ('0.19757426697530864',)} new output for save of step final : {1381762898: ('0.19757426697530864',), 1381762896: ('0.19757426697530864',), 1381762893: ('0.19757426697530864',), 1381762875: ('0.19757426697530864',), 1381762869: ('0.19757426697530864',), 1381762724: ('0.19757426697530864',), 1381762721: ('0.19757426697530864',)} [1381762898, 1381762896, 1381762893, 1381762875, 1381762869, 1381762724, 1381762721] Looping around the photos to save general results len do output : 7 /1381762898.Didn't retrieve data . /1381762896.Didn't retrieve data . /1381762893.Didn't retrieve data . /1381762875.Didn't retrieve data . /1381762869.Didn't retrieve data . /1381762724.Didn't retrieve data . /1381762721.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762898', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762896', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762893', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762875', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762869', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762724', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762721', None, None, None, None, None, '3670588') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.013054370880126953 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11797928810119629 time spend to save output : 0.013780355453491211 total time spend for step 5 : 0.1317596435546875 step6:blur_detection Fri Sep 5 15:44:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213.jpg resize: (2160, 3840) 1381762898 -5.864144216914449 treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb.jpg resize: (2160, 3840) 1381762896 -7.059376091025321 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be.jpg resize: (2160, 3840) 1381762893 -6.989117939856441 treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b.jpg resize: (2160, 3840) 1381762875 -6.168183554776595 treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f.jpg resize: (2160, 3840) 1381762869 -6.298543103732597 treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b.jpg resize: (2160, 3840) 1381762724 -6.7751608289295655 treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85.jpg resize: (2160, 3840) 1381762721 -7.073853283356898 treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291208_0.png resize: (352, 512) 1381773961 -4.4576452272860045 treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291209_0.png resize: (613, 584) 1381773962 -4.342574046009607 treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291210_0.png resize: (419, 640) 1381773963 -4.384225010492586 treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291211_0.png resize: (212, 208) 1381773964 -3.049889223316705 treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291213_0.png resize: (426, 611) 1381773965 -3.615352077014947 treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291214_0.png resize: (434, 480) 1381773966 -4.402133892814723 treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291215_0.png resize: (406, 302) 1381773967 -4.056178193539818 treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291216_0.png resize: (161, 209) 1381773968 -3.7289899525576473 treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291218_0.png resize: (239, 211) 1381773969 -4.401958760448325 treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291219_0.png resize: (276, 413) 1381773970 -2.7534441911501006 treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291220_0.png resize: (143, 145) 1381773971 0.26336928835133633 treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291221_0.png resize: (320, 204) 1381773973 -4.453110402669917 treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291222_0.png resize: (581, 516) 1381773974 -2.958563220528288 treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291223_0.png resize: (209, 230) 1381773975 -3.6109944546377646 treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291224_0.png resize: (112, 218) 1381773977 -3.45740807682394 treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291226_0.png resize: (485, 319) 1381773978 -4.15547591821995 treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291227_0.png resize: (383, 539) 1381773979 -3.1554178573728944 treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291228_0.png resize: (311, 376) 1381773981 -1.472880218338788 treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291229_0.png resize: (597, 428) 1381773982 -3.758934597089269 treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291230_0.png resize: (285, 169) 1381773983 -0.8681835711471815 treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291231_0.png resize: (297, 223) 1381773985 -1.2423042203927714 treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291232_0.png resize: (345, 177) 1381773986 -3.2885367078262706 treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291233_0.png resize: (448, 207) 1381773987 -2.102751814523331 treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291234_0.png resize: (361, 261) 1381773989 -3.8093118870961464 treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291235_0.png resize: (263, 474) 1381773990 -2.8534777530779856 treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291237_0.png resize: (289, 293) 1381773991 -0.37947568438371304 treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291238_0.png resize: (134, 100) 1381773993 -3.689082591701068 treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291239_0.png resize: (180, 195) 1381773994 -3.3686133058776893 treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291240_0.png resize: (504, 351) 1381773995 -4.0570135991339145 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291241_0.png resize: (293, 297) 1381773997 -2.2614458229643373 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291242_0.png resize: (263, 344) 1381773998 -2.2455973468908237 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291243_0.png resize: (205, 236) 1381773999 -3.0453159620010046 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291244_0.png resize: (303, 229) 1381774001 -3.661013624200309 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291245_0.png resize: (507, 426) 1381774002 -3.8888701353145487 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291246_0.png resize: (285, 217) 1381774003 -3.07310357061222 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291247_0.png resize: (456, 503) 1381774005 -5.144937080181601 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291248_0.png resize: (374, 255) 1381774006 -4.314702654935578 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291249_0.png resize: (507, 672) 1381774007 -4.1818798842830915 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291250_0.png resize: (403, 160) 1381774009 -4.505785592437077 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291251_0.png resize: (729, 349) 1381774010 -2.5847431954960247 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291252_0.png resize: (381, 424) 1381774011 -4.3042448421949295 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291253_0.png resize: (472, 408) 1381774013 -4.71701911514585 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291254_0.png resize: (547, 475) 1381774014 -4.714502552900941 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291255_0.png resize: (247, 238) 1381774015 -3.7541338682232306 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291256_0.png resize: (286, 160) 1381774017 -1.172412372966922 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291258_0.png resize: (403, 347) 1381774018 -3.7681237048085436 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291260_0.png resize: (431, 122) 1381774019 -3.8182870734784444 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291261_0.png resize: (371, 203) 1381774021 -4.187106649400076 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291263_0.png resize: (240, 133) 1381774022 0.030839817316144873 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291264_0.png resize: (206, 235) 1381774023 0.21548227425001676 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291265_0.png resize: (368, 309) 1381774025 -2.074037154751059 treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b_rle_crop_3946291266_0.png resize: (998, 1250) 1381774026 -2.2737792525015372 treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b_rle_crop_3946291267_0.png resize: (243, 114) 1381774027 -3.218085588316683 treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b_rle_crop_3946291268_0.png resize: (364, 665) 1381774029 -1.1018179187079062 treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b_rle_crop_3946291269_0.png resize: (424, 324) 1381774030 -2.3339040710307097 treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b_rle_crop_3946291270_0.png resize: (310, 865) 1381774031 -0.542004846172015 treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b_rle_crop_3946291272_0.png resize: (271, 215) 1381774033 -3.9084522033875584 treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b_rle_crop_3946291274_0.png resize: (1146, 1161) 1381774034 0.3730157586124801 treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b_rle_crop_3946291275_0.png resize: (219, 163) 1381774035 -3.1925099310697758 treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b_rle_crop_3946291276_0.png resize: (296, 390) 1381774037 -3.9720836209543395 treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291277_0.png resize: (209, 176) 1381774038 -0.6033674573775786 treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291278_0.png resize: (439, 508) 1381774039 -4.6186593934459665 treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291279_0.png resize: (533, 425) 1381774040 -0.07615651821676378 treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291280_0.png resize: (466, 249) 1381774042 -1.7344552174026349 treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291281_0.png resize: (401, 522) 1381774043 -0.06966779972920809 treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291282_0.png resize: (849, 1087) 1381774044 -1.6889360862706542 treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291283_0.png resize: (405, 315) 1381774046 -2.7284408248422762 treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291284_0.png resize: (528, 437) 1381774048 -4.078853034891511 treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291285_0.png resize: (326, 440) 1381774049 -3.7090952579371588 treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291286_0.png resize: (170, 281) 1381774050 -3.4474722459481546 treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291287_0.png resize: (89, 108) 1381774052 -2.747820396745226 treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291288_0.png resize: (400, 277) 1381774053 -3.4350406310667747 treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291289_0.png resize: (222, 141) 1381774055 3.5707865539799744 treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291290_0.png resize: (125, 203) 1381774056 0.7990431070270254 treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291291_0.png resize: (245, 415) 1381774057 -4.449670895744512 treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291292_0.png resize: (456, 476) 1381774059 0.016156604137997393 treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291293_0.png resize: (517, 528) 1381774060 -2.899714928147831 treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291295_0.png resize: (504, 315) 1381774061 -1.532048205025705 treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291296_0.png resize: (372, 394) 1381774062 -2.6276877211312333 treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291297_0.png resize: (280, 140) 1381774064 0.7729668261162533 treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291298_0.png resize: (311, 519) 1381774065 -1.1205905748581921 treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291299_0.png resize: (535, 643) 1381774066 -2.805853099034218 treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291300_0.png resize: (203, 124) 1381774068 -3.7343020775484166 treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291301_0.png resize: (207, 246) 1381774069 -1.987109676822371 treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291302_0.png resize: (323, 205) 1381774070 -1.0964453693828637 treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291303_0.png resize: (327, 249) 1381774071 -3.2089214619423916 treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291304_0.png resize: (423, 315) 1381774073 2.4704865481203675 treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291306_0.png resize: (390, 193) 1381774074 -5.064459531850934 treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291307_0.png resize: (129, 163) 1381774075 -5.171446598524214 treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291309_0.png resize: (105, 112) 1381774077 -2.300948577356811 treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291310_0.png resize: (172, 222) 1381774079 -3.2127822581785974 treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291311_0.png resize: (920, 567) 1381774080 -3.4038810958403225 treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291312_0.png resize: (578, 461) 1381774082 -4.287080307543437 treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291313_0.png resize: (609, 421) 1381774083 -1.6275160123105121 treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291314_0.png resize: (328, 181) 1381774084 -0.8013752199104726 treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291315_0.png resize: (515, 321) 1381774085 -4.072196510428729 treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291316_0.png resize: (644, 281) 1381774087 -0.5905554289228933 treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291317_0.png resize: (535, 359) 1381774088 -3.5634319225597806 treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291318_0.png resize: (313, 154) 1381774089 -4.4377994609675415 treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291319_0.png resize: (226, 124) 1381774091 -1.6825301611900287 treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291320_0.png resize: (268, 163) 1381774092 -2.190922687694413 treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291321_0.png resize: (413, 207) 1381774093 -4.346866090751816 treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291322_0.png resize: (437, 435) 1381774094 -3.27690915330431 treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291323_0.png resize: (223, 233) 1381774096 -3.6918185459998925 treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291324_0.png resize: (361, 351) 1381774097 -0.4829383145998155 treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291325_0.png resize: (267, 255) 1381774098 -4.1439191909138735 treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291326_0.png resize: (383, 307) 1381774100 -2.919805023516057 treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291327_0.png resize: (425, 350) 1381774101 -3.790803995749159 treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291330_0.png resize: (313, 191) 1381774102 -4.192388228757548 treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291331_0.png resize: (572, 109) 1381774104 -4.156514053153047 treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291217_0.png resize: (502, 509) 1381774147 -4.811994098730075 treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291236_0.png resize: (99, 157) 1381774148 -2.904255926519796 treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291305_0.png resize: (866, 463) 1381774150 -5.376964443602178 treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291212_0.png resize: (276, 1632) 1381774185 -2.4806699373749903 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291257_0.png resize: (312, 283) 1381774186 -3.3694852731615987 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291262_0.png resize: (118, 142) 1381774187 -3.20565828980214 treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b_rle_crop_3946291271_0.png resize: (348, 388) 1381774189 -4.299107505092482 treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291294_0.png resize: (131, 292) 1381774190 -3.867614820469544 treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291308_0.png resize: (371, 404) 1381774191 -5.066268622167554 treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291329_0.png resize: (120, 272) 1381774193 -3.9551545617310486 treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291328_0.png resize: (184, 467) 1381774208 -1.5463447748922388 treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291225_0.png resize: (225, 237) 1381774223 -0.8532858156594294 treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291259_0.png resize: (221, 101) 1381774228 -4.669234728471793 treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b_rle_crop_3946291273_0.png resize: (647, 546) 1381774229 -4.737763880982313 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 131 time used for this insertion : 0.017247438430786133 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 131 time used for this insertion : 0.034069061279296875 save missing photos in datou_result : time spend for datou_step_exec : 35.20190072059631 time spend to save output : 0.056752681732177734 total time spend for step 6 : 35.25865340232849 step7:brightness Fri Sep 5 15:45:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213.jpg treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb.jpg treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be.jpg treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b.jpg treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f.jpg treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b.jpg treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85.jpg treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291208_0.png treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291209_0.png treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291210_0.png treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291211_0.png treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291213_0.png treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291214_0.png treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291215_0.png treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291216_0.png treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291218_0.png treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291219_0.png treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291220_0.png treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291221_0.png treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291222_0.png treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291223_0.png treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291224_0.png treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291226_0.png treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291227_0.png treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291228_0.png treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291229_0.png treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291230_0.png treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291231_0.png treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291232_0.png treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291233_0.png treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291234_0.png treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291235_0.png treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291237_0.png treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291238_0.png treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291239_0.png treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291240_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291241_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291242_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291243_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291244_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291245_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291246_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291247_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291248_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291249_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291250_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291251_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291252_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291253_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291254_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291255_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291256_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291258_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291260_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291261_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291263_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291264_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291265_0.png treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b_rle_crop_3946291266_0.png treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b_rle_crop_3946291267_0.png treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b_rle_crop_3946291268_0.png treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b_rle_crop_3946291269_0.png treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b_rle_crop_3946291270_0.png treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b_rle_crop_3946291272_0.png treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b_rle_crop_3946291274_0.png treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b_rle_crop_3946291275_0.png treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b_rle_crop_3946291276_0.png treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291277_0.png treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291278_0.png treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291279_0.png treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291280_0.png treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291281_0.png treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291282_0.png treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291283_0.png treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291284_0.png treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291285_0.png treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291286_0.png treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291287_0.png treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291288_0.png treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291289_0.png treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291290_0.png treat image : temp/1757079628_604886_1381762869_70894b31872a35cb66a543eeba4cf37f_rle_crop_3946291291_0.png treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291292_0.png treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291293_0.png treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291295_0.png treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291296_0.png treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291297_0.png treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291298_0.png treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291299_0.png treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291300_0.png treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291301_0.png treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291302_0.png treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291303_0.png treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291304_0.png treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291306_0.png treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291307_0.png treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291309_0.png treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291310_0.png treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291311_0.png treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291312_0.png treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291313_0.png treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291314_0.png treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291315_0.png treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291316_0.png treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291317_0.png treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291318_0.png treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291319_0.png treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291320_0.png treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291321_0.png treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291322_0.png treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291323_0.png treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291324_0.png treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291325_0.png treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291326_0.png treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291327_0.png treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291330_0.png treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291331_0.png treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291217_0.png treat image : temp/1757079628_604886_1381762896_0f26cacf90671111aaa8907cdd0d53fb_rle_crop_3946291236_0.png treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291305_0.png treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291212_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291257_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291262_0.png treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b_rle_crop_3946291271_0.png treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291294_0.png treat image : temp/1757079628_604886_1381762724_b6f6fec716473ebf1c3d74361518be5b_rle_crop_3946291308_0.png treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291329_0.png treat image : temp/1757079628_604886_1381762721_8677a3cf96ccb400dcab784fbe138e85_rle_crop_3946291328_0.png treat image : temp/1757079628_604886_1381762898_5165326e2ad96273a27d3d9c22b68213_rle_crop_3946291225_0.png treat image : temp/1757079628_604886_1381762893_6d1926cc9696280ebf5c7a22380ea8be_rle_crop_3946291259_0.png treat image : temp/1757079628_604886_1381762875_e7723d7bdc57f2967ee8b4cb6c65368b_rle_crop_3946291273_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 131 time used for this insertion : 0.018994808197021484 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 131 time used for this insertion : 0.03359532356262207 save missing photos in datou_result : time spend for datou_step_exec : 9.14249587059021 time spend to save output : 0.058016061782836914 total time spend for step 7 : 9.200511932373047 step8:velours_tree Fri Sep 5 15:45:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.2765226364135742 time spend to save output : 5.221366882324219e-05 total time spend for step 8 : 0.27657485008239746 step9:send_mail_cod Fri Sep 5 15:45:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26582094_05-09-2025_15_45_33.pdf 26582606 change filename to text .imagette265826061757079933 26582607 imagette265826071757079933 26582608 imagette265826081757079933 26582609 change filename to text .change filename to text .change filename to text .imagette265826091757079933 26582610 imagette265826101757079934 26582611 imagette265826111757079934 26582612 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette265826121757079934 26582614 change filename to text .change filename to text .imagette265826141757079936 26582615 change filename to text .imagette265826151757079936 26582616 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette265826161757079936 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26582094 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26582606,26582607,26582608,26582609,26582610,26582611,26582612,26582613,26582614,26582615,26582616?tags=autre,mal_croppe,flou,carton,background,metal,papier,environnement,pet_fonce,pehd,pet_clair args[1381762898] : ((1381762898, -5.864144216914449, 492609224), (1381762898, 0.7902605450419874, 2107752395), '0.19757426697530864') We are sending mail with results at report@fotonower.com args[1381762896] : ((1381762896, -7.059376091025321, 492609224), (1381762896, 1.6080638723683829, 2107752395), '0.19757426697530864') We are sending mail with results at report@fotonower.com args[1381762893] : ((1381762893, -6.989117939856441, 492609224), (1381762893, 1.439958655750378, 2107752395), '0.19757426697530864') We are sending mail with results at report@fotonower.com args[1381762875] : ((1381762875, -6.168183554776595, 492609224), (1381762875, 1.3969396000896468, 2107752395), '0.19757426697530864') We are sending mail with results at report@fotonower.com args[1381762869] : ((1381762869, -6.298543103732597, 492609224), (1381762869, 1.3812649231275655, 2107752395), '0.19757426697530864') We are sending mail with results at report@fotonower.com args[1381762724] : ((1381762724, -6.7751608289295655, 492609224), (1381762724, 1.2168614407921428, 2107752395), '0.19757426697530864') We are sending mail with results at report@fotonower.com args[1381762721] : ((1381762721, -7.073853283356898, 492609224), (1381762721, 1.6545986231273546, 2107752395), '0.19757426697530864') We are sending mail with results at report@fotonower.com refus_total : 0.19757426697530864 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26582094 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26582094_05-09-2025_15_45_33.pdf results_Auto_P26582094_05-09-2025_15_45_33.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26582094_05-09-2025_15_45_33.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26582094','results_Auto_P26582094_05-09-2025_15_45_33.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26582094_05-09-2025_15_45_33.pdf','pdf','','0.64','0.19757426697530864') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26582094

https://www.fotonower.com/image?json=false&list_photos_id=1381762898
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381762896
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381762893
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381762875
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381762869
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381762724
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381762721
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 19.76%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/26582606?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26582609?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26582612?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/26582614?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/26582615?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26582616?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26582094_05-09-2025_15_45_33.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26582606,26582607,26582608,26582609,26582610,26582611,26582612,26582613,26582614,26582615,26582616?tags=autre,mal_croppe,flou,carton,background,metal,papier,environnement,pet_fonce,pehd,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 05 Sep 2025 13:45:40 GMT Content-Length: 0 Connection: close X-Message-Id: c8RnuhImTayyg_is1Rfs2g Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1381762898, 1381762896, 1381762893, 1381762875, 1381762869, 1381762724, 1381762721] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762898', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762896', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762893', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762875', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762869', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762724', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762721', None, None, None, None, None, '3670588') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.012433528900146484 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.447143793106079 time spend to save output : 0.012624263763427734 total time spend for step 9 : 6.459768056869507 step10:split_time_score Fri Sep 5 15:45:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('14', 7),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 05092025 26582094 Nombre de photos uploadées : 7 / 23040 (0%) 05092025 26582094 Nombre de photos taguées (types de déchets): 0 / 7 (0%) 05092025 26582094 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.0007004737854003906 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2268381118774414 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.039801469434054416 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26567363_05-09-2025_08_43_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26567363 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26567363 AND mptpi.`type`=3726 To do Qualite : 0.03246848149762702 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26569619_05-09-2025_09_47_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26569619 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26569619 AND mptpi.`type`=3726 To do Qualite : 0.08177850919495884 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26573164_05-09-2025_11_21_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26573164 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26573164 AND mptpi.`type`=3594 To do Qualite : 0.02766889116869236 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26573999_05-09-2025_11_38_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26573999 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26573999 AND mptpi.`type`=3726 To do Qualite : 0.020968054637391136 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26574000_05-09-2025_11_36_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26574000 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26574000 AND mptpi.`type`=3726 To do Qualite : 0.06326802484187678 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26579608_05-09-2025_14_38_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26579608 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26579608 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26579609 order by id desc limit 1 Qualite : 0.07439530100011871 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26579611_05-09-2025_15_07_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26579611 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26579611 AND mptpi.`type`=3594 To do Qualite : 0.09124505690586421 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26579614_05-09-2025_14_56_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26579614 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26579614 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26579639 order by id desc limit 1 Qualite : 0.10035333337076209 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26582090_05-09-2025_15_37_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26582090 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26582090 AND mptpi.`type`=3726 To do Qualite : 0.19757426697530864 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26582094_05-09-2025_15_45_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26582094 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26582094 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'05092025': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1381762898, 1381762896, 1381762893, 1381762875, 1381762869, 1381762724, 1381762721] Looping around the photos to save general results len do output : 1 /26582094Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762898', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762896', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762893', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762875', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762869', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762724', None, None, None, None, None, '3670588') ('3318', None, None, None, None, None, None, None, '3670588') ('3318', '26582094', '1381762721', None, None, None, None, None, '3670588') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.014127969741821289 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.9167518615722656 time spend to save output : 0.014457941055297852 total time spend for step 10 : 2.9312098026275635 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 7 set_done_treatment 158.99user 108.33system 5:18.33elapsed 83%CPU (0avgtext+0avgdata 3818876maxresident)k 1200208inputs+149392outputs (24672major+12943191minor)pagefaults 0swaps