python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 610213 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2955250'] with mtr_portfolio_ids : ['23342745'] and first list_photo_ids : [] new path : /proc/610213/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 1.529165267944336 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon May 26 17:40:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10553 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-26 17:40:36.617313: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-26 17:40:36.651163: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-26 17:40:36.653904: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fd104000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-26 17:40:36.653968: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-26 17:40:36.659847: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-26 17:40:36.983983: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x8f33f90 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-26 17:40:36.984058: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-26 17:40:36.985894: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 17:40:36.988590: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 17:40:37.017937: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 17:40:37.041206: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 17:40:37.045659: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 17:40:37.077819: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 17:40:37.083670: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 17:40:37.122007: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 17:40:37.123887: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 17:40:37.124517: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 17:40:37.125751: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-26 17:40:37.125771: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-26 17:40:37.125781: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-26 17:40:37.127905: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9777 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-26 17:40:37.524753: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 17:40:37.524844: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 17:40:37.524872: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 17:40:37.524898: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 17:40:37.524914: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 17:40:37.524931: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 17:40:37.524946: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 17:40:37.524961: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 17:40:37.526342: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 17:40:37.527633: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 17:40:37.527683: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 17:40:37.527700: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 17:40:37.527717: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 17:40:37.527731: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 17:40:37.527745: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 17:40:37.527758: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 17:40:37.527772: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 17:40:37.529142: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 17:40:37.529177: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-26 17:40:37.529189: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-26 17:40:37.529198: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-26 17:40:37.530583: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9777 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-26 17:40:50.505328: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 17:40:50.889086: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 9 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 51 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 45 Detection mask done ! Trying to reset tf kernel 611235 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 604 tf kernel not reseted sub process len(results) : 9 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 9 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5893 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.002552509307861328 nb_pixel_total : 75615 time to create 1 rle with old method : 0.08928108215332031 length of segment : 421 time for calcul the mask position with numpy : 0.0009970664978027344 nb_pixel_total : 44813 time to create 1 rle with old method : 0.062171220779418945 length of segment : 248 time for calcul the mask position with numpy : 0.0009315013885498047 nb_pixel_total : 48413 time to create 1 rle with old method : 0.05494952201843262 length of segment : 337 time for calcul the mask position with numpy : 0.0009419918060302734 nb_pixel_total : 43676 time to create 1 rle with old method : 0.05077862739562988 length of segment : 283 time for calcul the mask position with numpy : 0.00432133674621582 nb_pixel_total : 121242 time to create 1 rle with old method : 0.1581737995147705 length of segment : 665 time for calcul the mask position with numpy : 0.00044226646423339844 nb_pixel_total : 18544 time to create 1 rle with old method : 0.020935535430908203 length of segment : 268 time for calcul the mask position with numpy : 0.0003757476806640625 nb_pixel_total : 18032 time to create 1 rle with old method : 0.020748138427734375 length of segment : 181 time for calcul the mask position with numpy : 0.003180980682373047 nb_pixel_total : 110618 time to create 1 rle with old method : 0.15025877952575684 length of segment : 434 time for calcul the mask position with numpy : 0.0014460086822509766 nb_pixel_total : 47712 time to create 1 rle with old method : 0.0832672119140625 length of segment : 343 time for calcul the mask position with numpy : 0.003340005874633789 nb_pixel_total : 138599 time to create 1 rle with old method : 0.1823272705078125 length of segment : 512 time for calcul the mask position with numpy : 0.0007450580596923828 nb_pixel_total : 36667 time to create 1 rle with old method : 0.04434990882873535 length of segment : 318 time for calcul the mask position with numpy : 0.00037026405334472656 nb_pixel_total : 14816 time to create 1 rle with old method : 0.01710033416748047 length of segment : 141 time for calcul the mask position with numpy : 0.0007894039154052734 nb_pixel_total : 40323 time to create 1 rle with old method : 0.04630422592163086 length of segment : 207 time for calcul the mask position with numpy : 0.00021219253540039062 nb_pixel_total : 5532 time to create 1 rle with old method : 0.0069158077239990234 length of segment : 83 time for calcul the mask position with numpy : 0.0014979839324951172 nb_pixel_total : 85347 time to create 1 rle with old method : 0.09597158432006836 length of segment : 591 time for calcul the mask position with numpy : 0.0005755424499511719 nb_pixel_total : 30414 time to create 1 rle with old method : 0.03844738006591797 length of segment : 168 time for calcul the mask position with numpy : 0.0006442070007324219 nb_pixel_total : 26018 time to create 1 rle with old method : 0.03732705116271973 length of segment : 194 time for calcul the mask position with numpy : 0.001645803451538086 nb_pixel_total : 68638 time to create 1 rle with old method : 0.088134765625 length of segment : 246 time for calcul the mask position with numpy : 0.0003821849822998047 nb_pixel_total : 13405 time to create 1 rle with old method : 0.015728473663330078 length of segment : 149 time for calcul the mask position with numpy : 0.0006539821624755859 nb_pixel_total : 34003 time to create 1 rle with old method : 0.0393376350402832 length of segment : 227 time for calcul the mask position with numpy : 0.0024628639221191406 nb_pixel_total : 89810 time to create 1 rle with old method : 0.10726523399353027 length of segment : 404 time for calcul the mask position with numpy : 0.00016641616821289062 nb_pixel_total : 6774 time to create 1 rle with old method : 0.009686946868896484 length of segment : 78 time for calcul the mask position with numpy : 0.0014412403106689453 nb_pixel_total : 54540 time to create 1 rle with old method : 0.06188821792602539 length of segment : 581 time for calcul the mask position with numpy : 0.00039649009704589844 nb_pixel_total : 22452 time to create 1 rle with old method : 0.02584385871887207 length of segment : 121 time for calcul the mask position with numpy : 0.0008082389831542969 nb_pixel_total : 33529 time to create 1 rle with old method : 0.03863096237182617 length of segment : 311 time for calcul the mask position with numpy : 0.0005786418914794922 nb_pixel_total : 26974 time to create 1 rle with old method : 0.031003952026367188 length of segment : 126 time for calcul the mask position with numpy : 0.00038743019104003906 nb_pixel_total : 16883 time to create 1 rle with old method : 0.01963329315185547 length of segment : 131 time for calcul the mask position with numpy : 0.001537322998046875 nb_pixel_total : 65584 time to create 1 rle with old method : 0.07422590255737305 length of segment : 442 time for calcul the mask position with numpy : 0.0009870529174804688 nb_pixel_total : 51003 time to create 1 rle with old method : 0.05820655822753906 length of segment : 269 time for calcul the mask position with numpy : 0.0011906623840332031 nb_pixel_total : 47222 time to create 1 rle with old method : 0.053479909896850586 length of segment : 289 time for calcul the mask position with numpy : 0.0010306835174560547 nb_pixel_total : 36694 time to create 1 rle with old method : 0.06806278228759766 length of segment : 221 time for calcul the mask position with numpy : 0.0008358955383300781 nb_pixel_total : 24949 time to create 1 rle with old method : 0.028675079345703125 length of segment : 229 time for calcul the mask position with numpy : 0.0010063648223876953 nb_pixel_total : 47126 time to create 1 rle with old method : 0.05318021774291992 length of segment : 279 time for calcul the mask position with numpy : 0.0010592937469482422 nb_pixel_total : 51108 time to create 1 rle with old method : 0.06350064277648926 length of segment : 285 time for calcul the mask position with numpy : 0.0019378662109375 nb_pixel_total : 74621 time to create 1 rle with old method : 0.08553147315979004 length of segment : 533 time for calcul the mask position with numpy : 0.0005373954772949219 nb_pixel_total : 24496 time to create 1 rle with old method : 0.027818918228149414 length of segment : 231 time for calcul the mask position with numpy : 0.0003762245178222656 nb_pixel_total : 12507 time to create 1 rle with old method : 0.014860153198242188 length of segment : 185 time for calcul the mask position with numpy : 0.0003001689910888672 nb_pixel_total : 13225 time to create 1 rle with old method : 0.015321016311645508 length of segment : 157 time for calcul the mask position with numpy : 0.0005373954772949219 nb_pixel_total : 25420 time to create 1 rle with old method : 0.028768539428710938 length of segment : 278 time for calcul the mask position with numpy : 0.00046133995056152344 nb_pixel_total : 22118 time to create 1 rle with old method : 0.025559663772583008 length of segment : 156 time for calcul the mask position with numpy : 0.0005054473876953125 nb_pixel_total : 11063 time to create 1 rle with old method : 0.02390885353088379 length of segment : 170 time for calcul the mask position with numpy : 0.00026226043701171875 nb_pixel_total : 8913 time to create 1 rle with old method : 0.010698795318603516 length of segment : 109 time for calcul the mask position with numpy : 0.00022935867309570312 nb_pixel_total : 6823 time to create 1 rle with old method : 0.008375883102416992 length of segment : 105 time for calcul the mask position with numpy : 0.0007007122039794922 nb_pixel_total : 20522 time to create 1 rle with old method : 0.025423288345336914 length of segment : 306 time for calcul the mask position with numpy : 0.002831697463989258 nb_pixel_total : 96218 time to create 1 rle with old method : 0.11631608009338379 length of segment : 309 time for calcul the mask position with numpy : 0.0024733543395996094 nb_pixel_total : 31080 time to create 1 rle with old method : 0.03502368927001953 length of segment : 222 time for calcul the mask position with numpy : 0.004394054412841797 nb_pixel_total : 22998 time to create 1 rle with old method : 0.02822113037109375 length of segment : 316 time for calcul the mask position with numpy : 0.0005464553833007812 nb_pixel_total : 9967 time to create 1 rle with old method : 0.011818647384643555 length of segment : 165 time for calcul the mask position with numpy : 0.0015056133270263672 nb_pixel_total : 61365 time to create 1 rle with old method : 0.07256269454956055 length of segment : 364 time for calcul the mask position with numpy : 0.0005550384521484375 nb_pixel_total : 19735 time to create 1 rle with old method : 0.027014732360839844 length of segment : 197 time for calcul the mask position with numpy : 0.0007698535919189453 nb_pixel_total : 14752 time to create 1 rle with old method : 0.022687911987304688 length of segment : 244 time for calcul the mask position with numpy : 0.00058746337890625 nb_pixel_total : 25500 time to create 1 rle with old method : 0.02980518341064453 length of segment : 152 time for calcul the mask position with numpy : 0.002173900604248047 nb_pixel_total : 55904 time to create 1 rle with old method : 0.06767821311950684 length of segment : 218 time for calcul the mask position with numpy : 0.003242015838623047 nb_pixel_total : 35844 time to create 1 rle with old method : 0.059256553649902344 length of segment : 873 time for calcul the mask position with numpy : 0.0008571147918701172 nb_pixel_total : 16249 time to create 1 rle with old method : 0.01915574073791504 length of segment : 126 time for calcul the mask position with numpy : 0.0049474239349365234 nb_pixel_total : 154376 time to create 1 rle with new method : 0.021344661712646484 length of segment : 570 time for calcul the mask position with numpy : 0.0008127689361572266 nb_pixel_total : 18751 time to create 1 rle with old method : 0.023647069931030273 length of segment : 213 time for calcul the mask position with numpy : 0.0013151168823242188 nb_pixel_total : 26032 time to create 1 rle with old method : 0.030130386352539062 length of segment : 251 time for calcul the mask position with numpy : 0.0005612373352050781 nb_pixel_total : 5179 time to create 1 rle with old method : 0.00825047492980957 length of segment : 116 time for calcul the mask position with numpy : 0.001718759536743164 nb_pixel_total : 26245 time to create 1 rle with old method : 0.04350900650024414 length of segment : 251 time for calcul the mask position with numpy : 0.0010952949523925781 nb_pixel_total : 20352 time to create 1 rle with old method : 0.02373671531677246 length of segment : 180 time for calcul the mask position with numpy : 0.00058746337890625 nb_pixel_total : 13821 time to create 1 rle with old method : 0.01646113395690918 length of segment : 148 time for calcul the mask position with numpy : 0.0018510818481445312 nb_pixel_total : 23861 time to create 1 rle with old method : 0.036180973052978516 length of segment : 168 time for calcul the mask position with numpy : 0.004275798797607422 nb_pixel_total : 141190 time to create 1 rle with old method : 0.16150116920471191 length of segment : 739 time for calcul the mask position with numpy : 0.0003879070281982422 nb_pixel_total : 7740 time to create 1 rle with old method : 0.00947880744934082 length of segment : 98 time for calcul the mask position with numpy : 0.002676725387573242 nb_pixel_total : 83646 time to create 1 rle with old method : 0.12766742706298828 length of segment : 435 time for calcul the mask position with numpy : 0.0009748935699462891 nb_pixel_total : 34110 time to create 1 rle with old method : 0.040041446685791016 length of segment : 277 time for calcul the mask position with numpy : 0.0002422332763671875 nb_pixel_total : 8454 time to create 1 rle with old method : 0.009987354278564453 length of segment : 192 time for calcul the mask position with numpy : 0.0003407001495361328 nb_pixel_total : 18400 time to create 1 rle with old method : 0.021593809127807617 length of segment : 193 time for calcul the mask position with numpy : 0.0016446113586425781 nb_pixel_total : 84057 time to create 1 rle with old method : 0.0983283519744873 length of segment : 352 time for calcul the mask position with numpy : 0.0006880760192871094 nb_pixel_total : 25408 time to create 1 rle with old method : 0.028879165649414062 length of segment : 205 time for calcul the mask position with numpy : 0.0010023117065429688 nb_pixel_total : 45583 time to create 1 rle with old method : 0.05857062339782715 length of segment : 419 time for calcul the mask position with numpy : 0.00031495094299316406 nb_pixel_total : 11427 time to create 1 rle with old method : 0.016737699508666992 length of segment : 120 time for calcul the mask position with numpy : 0.00042176246643066406 nb_pixel_total : 9484 time to create 1 rle with old method : 0.011282920837402344 length of segment : 152 time for calcul the mask position with numpy : 0.006265878677368164 nb_pixel_total : 225340 time to create 1 rle with new method : 0.04764676094055176 length of segment : 1163 time for calcul the mask position with numpy : 0.0014901161193847656 nb_pixel_total : 79188 time to create 1 rle with old method : 0.08843469619750977 length of segment : 373 time for calcul the mask position with numpy : 0.0005676746368408203 nb_pixel_total : 17253 time to create 1 rle with old method : 0.019738435745239258 length of segment : 224 time for calcul the mask position with numpy : 0.0008275508880615234 nb_pixel_total : 4072 time to create 1 rle with old method : 0.00511479377746582 length of segment : 139 time for calcul the mask position with numpy : 0.0007874965667724609 nb_pixel_total : 37473 time to create 1 rle with old method : 0.0438079833984375 length of segment : 221 time for calcul the mask position with numpy : 0.0004146099090576172 nb_pixel_total : 15055 time to create 1 rle with old method : 0.01787567138671875 length of segment : 154 time for calcul the mask position with numpy : 0.004224538803100586 nb_pixel_total : 141122 time to create 1 rle with old method : 0.1664443016052246 length of segment : 524 time for calcul the mask position with numpy : 0.002386808395385742 nb_pixel_total : 40469 time to create 1 rle with old method : 0.04621624946594238 length of segment : 765 time for calcul the mask position with numpy : 0.0015439987182617188 nb_pixel_total : 38656 time to create 1 rle with old method : 0.04761528968811035 length of segment : 343 time for calcul the mask position with numpy : 0.0010471343994140625 nb_pixel_total : 38009 time to create 1 rle with old method : 0.043314456939697266 length of segment : 250 time for calcul the mask position with numpy : 0.001024007797241211 nb_pixel_total : 15940 time to create 1 rle with old method : 0.0261688232421875 length of segment : 181 time for calcul the mask position with numpy : 0.0025148391723632812 nb_pixel_total : 60554 time to create 1 rle with old method : 0.07365250587463379 length of segment : 311 time for calcul the mask position with numpy : 0.0021224021911621094 nb_pixel_total : 56681 time to create 1 rle with old method : 0.06511902809143066 length of segment : 276 time for calcul the mask position with numpy : 0.00243377685546875 nb_pixel_total : 80200 time to create 1 rle with old method : 0.09069252014160156 length of segment : 506 time for calcul the mask position with numpy : 0.0005640983581542969 nb_pixel_total : 12281 time to create 1 rle with old method : 0.014203548431396484 length of segment : 129 time for calcul the mask position with numpy : 0.0051004886627197266 nb_pixel_total : 99508 time to create 1 rle with old method : 0.11168289184570312 length of segment : 716 time for calcul the mask position with numpy : 0.0026941299438476562 nb_pixel_total : 161848 time to create 1 rle with new method : 0.007271528244018555 length of segment : 353 time for calcul the mask position with numpy : 0.006510019302368164 nb_pixel_total : 178478 time to create 1 rle with new method : 0.012936592102050781 length of segment : 464 time for calcul the mask position with numpy : 0.0019686222076416016 nb_pixel_total : 43254 time to create 1 rle with old method : 0.05603623390197754 length of segment : 408 time for calcul the mask position with numpy : 0.0016520023345947266 nb_pixel_total : 33548 time to create 1 rle with old method : 0.044036149978637695 length of segment : 267 time for calcul the mask position with numpy : 0.0012993812561035156 nb_pixel_total : 22929 time to create 1 rle with old method : 0.026849746704101562 length of segment : 273 time for calcul the mask position with numpy : 0.002017498016357422 nb_pixel_total : 36110 time to create 1 rle with old method : 0.04208707809448242 length of segment : 382 time for calcul the mask position with numpy : 0.0009362697601318359 nb_pixel_total : 16904 time to create 1 rle with old method : 0.022608041763305664 length of segment : 114 time for calcul the mask position with numpy : 0.0010881423950195312 nb_pixel_total : 22384 time to create 1 rle with old method : 0.025922536849975586 length of segment : 262 time for calcul the mask position with numpy : 0.0029821395874023438 nb_pixel_total : 72953 time to create 1 rle with old method : 0.08326220512390137 length of segment : 259 time for calcul the mask position with numpy : 0.0028603076934814453 nb_pixel_total : 40829 time to create 1 rle with old method : 0.04846835136413574 length of segment : 272 time for calcul the mask position with numpy : 0.007981300354003906 nb_pixel_total : 154475 time to create 1 rle with new method : 0.016790390014648438 length of segment : 433 time for calcul the mask position with numpy : 0.004797935485839844 nb_pixel_total : 100585 time to create 1 rle with old method : 0.11215734481811523 length of segment : 490 time for calcul the mask position with numpy : 0.0018813610076904297 nb_pixel_total : 31125 time to create 1 rle with old method : 0.05302238464355469 length of segment : 158 time for calcul the mask position with numpy : 0.005666255950927734 nb_pixel_total : 88176 time to create 1 rle with old method : 0.12316346168518066 length of segment : 750 time for calcul the mask position with numpy : 0.0013740062713623047 nb_pixel_total : 18635 time to create 1 rle with old method : 0.021488666534423828 length of segment : 145 time for calcul the mask position with numpy : 0.0017952919006347656 nb_pixel_total : 37008 time to create 1 rle with old method : 0.04622364044189453 length of segment : 238 time for calcul the mask position with numpy : 0.004215717315673828 nb_pixel_total : 65666 time to create 1 rle with old method : 0.07893967628479004 length of segment : 443 time for calcul the mask position with numpy : 0.001420736312866211 nb_pixel_total : 15902 time to create 1 rle with old method : 0.01874399185180664 length of segment : 157 time for calcul the mask position with numpy : 0.0038933753967285156 nb_pixel_total : 107463 time to create 1 rle with old method : 0.12797045707702637 length of segment : 513 time for calcul the mask position with numpy : 0.0023636817932128906 nb_pixel_total : 53697 time to create 1 rle with old method : 0.06469607353210449 length of segment : 380 time for calcul the mask position with numpy : 0.0015094280242919922 nb_pixel_total : 32101 time to create 1 rle with old method : 0.03706192970275879 length of segment : 162 time for calcul the mask position with numpy : 0.0008676052093505859 nb_pixel_total : 16292 time to create 1 rle with old method : 0.01914525032043457 length of segment : 198 time for calcul the mask position with numpy : 0.0034399032592773438 nb_pixel_total : 69695 time to create 1 rle with old method : 0.0938270092010498 length of segment : 452 time for calcul the mask position with numpy : 0.0015931129455566406 nb_pixel_total : 34811 time to create 1 rle with old method : 0.0393829345703125 length of segment : 302 time for calcul the mask position with numpy : 0.0037834644317626953 nb_pixel_total : 58015 time to create 1 rle with old method : 0.06554174423217773 length of segment : 381 time for calcul the mask position with numpy : 0.0008687973022460938 nb_pixel_total : 16927 time to create 1 rle with old method : 0.01951885223388672 length of segment : 138 time for calcul the mask position with numpy : 0.005158424377441406 nb_pixel_total : 152259 time to create 1 rle with new method : 0.013080596923828125 length of segment : 473 time for calcul the mask position with numpy : 0.001817464828491211 nb_pixel_total : 33672 time to create 1 rle with old method : 0.03992962837219238 length of segment : 386 time for calcul the mask position with numpy : 0.0013575553894042969 nb_pixel_total : 21458 time to create 1 rle with old method : 0.024742603302001953 length of segment : 279 time for calcul the mask position with numpy : 0.006167888641357422 nb_pixel_total : 142105 time to create 1 rle with old method : 0.1672658920288086 length of segment : 474 time for calcul the mask position with numpy : 0.005341053009033203 nb_pixel_total : 125612 time to create 1 rle with old method : 0.14449095726013184 length of segment : 432 time for calcul the mask position with numpy : 0.001714944839477539 nb_pixel_total : 17169 time to create 1 rle with old method : 0.020508289337158203 length of segment : 159 time for calcul the mask position with numpy : 0.0012860298156738281 nb_pixel_total : 30830 time to create 1 rle with old method : 0.039562225341796875 length of segment : 149 time for calcul the mask position with numpy : 0.0011641979217529297 nb_pixel_total : 17043 time to create 1 rle with old method : 0.02110767364501953 length of segment : 164 time for calcul the mask position with numpy : 0.008561849594116211 nb_pixel_total : 159717 time to create 1 rle with new method : 0.014282464981079102 length of segment : 462 time for calcul the mask position with numpy : 0.0014255046844482422 nb_pixel_total : 16334 time to create 1 rle with old method : 0.01930379867553711 length of segment : 235 time for calcul the mask position with numpy : 0.003040790557861328 nb_pixel_total : 78507 time to create 1 rle with old method : 0.09002494812011719 length of segment : 266 time for calcul the mask position with numpy : 0.002028226852416992 nb_pixel_total : 45476 time to create 1 rle with old method : 0.05193305015563965 length of segment : 347 time for calcul the mask position with numpy : 0.0008220672607421875 nb_pixel_total : 15204 time to create 1 rle with old method : 0.01778268814086914 length of segment : 187 time for calcul the mask position with numpy : 0.005281209945678711 nb_pixel_total : 107743 time to create 1 rle with old method : 0.1243743896484375 length of segment : 694 time for calcul the mask position with numpy : 0.0045816898345947266 nb_pixel_total : 24441 time to create 1 rle with old method : 0.02811741828918457 length of segment : 513 time for calcul the mask position with numpy : 0.0015053749084472656 nb_pixel_total : 25537 time to create 1 rle with old method : 0.033182621002197266 length of segment : 387 time for calcul the mask position with numpy : 0.008624792098999023 nb_pixel_total : 111041 time to create 1 rle with old method : 0.1310579776763916 length of segment : 637 time for calcul the mask position with numpy : 0.000293731689453125 nb_pixel_total : 4396 time to create 1 rle with old method : 0.005412578582763672 length of segment : 86 time for calcul the mask position with numpy : 0.0008649826049804688 nb_pixel_total : 9488 time to create 1 rle with old method : 0.011452913284301758 length of segment : 175 time for calcul the mask position with numpy : 0.0009238719940185547 nb_pixel_total : 17095 time to create 1 rle with old method : 0.02117633819580078 length of segment : 153 time for calcul the mask position with numpy : 0.0075571537017822266 nb_pixel_total : 80216 time to create 1 rle with old method : 0.11557269096374512 length of segment : 557 time for calcul the mask position with numpy : 0.0006177425384521484 nb_pixel_total : 7638 time to create 1 rle with old method : 0.008906126022338867 length of segment : 108 time for calcul the mask position with numpy : 0.0043528079986572266 nb_pixel_total : 75820 time to create 1 rle with old method : 0.09246253967285156 length of segment : 431 time for calcul the mask position with numpy : 0.005731344223022461 nb_pixel_total : 72979 time to create 1 rle with old method : 0.08357977867126465 length of segment : 471 time for calcul the mask position with numpy : 0.0010864734649658203 nb_pixel_total : 10192 time to create 1 rle with old method : 0.016411781311035156 length of segment : 165 time spent for convertir_results : 15.41003680229187 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 141 chid ids of type : 3594 Number RLEs to save : 43336 save missing photos in datou_result : time spend for datou_step_exec : 112.67257452011108 time spend to save output : 2.8649208545684814 total time spend for step 1 : 115.53749537467957 step2:crop_condition Mon May 26 17:42:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 141 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 110 About to insert : list_path_to_insert length 110 new photo from crops ! About to upload 110 photos upload in portfolio : 3736932 init cache_photo without model_param we have 110 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748274178_610213 we have uploaded 110 photos in the portfolio 3736932 time of upload the photos Elapsed time : 29.00586771965027 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3736932 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748274212_610213 we have uploaded 16 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.5547235012054443 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748274220_610213 we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.80779767036438 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748274226_610213 we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.7841181755065918 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748274230_610213 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5654580593109131 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1361085169, 1361085165, 1361085162, 1361085157, 1361085154, 1361085131, 1361085128, 1361085124, 1361085111] Looping around the photos to save general results len do output : 141 /1361123111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361123280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085169', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085165', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085162', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085157', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085154', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085131', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085128', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085124', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085111', None, None, None, None, None, '2955250') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 432 time used for this insertion : 0.03388047218322754 save_final save missing photos in datou_result : time spend for datou_step_exec : 82.38287591934204 time spend to save output : 0.5047705173492432 total time spend for step 2 : 82.88764643669128 step3:rle_unique_nms_with_priority Mon May 26 17:43:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 141 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 11 nb_hashtags : 2 time to prepare the origin masks : 6.668976306915283 time for calcul the mask position with numpy : 0.8773829936981201 nb_pixel_total : 7590493 time to create 1 rle with new method : 0.8360996246337891 time for calcul the mask position with numpy : 0.04285740852355957 nb_pixel_total : 36667 time to create 1 rle with old method : 0.04326224327087402 time for calcul the mask position with numpy : 0.04112052917480469 nb_pixel_total : 138575 time to create 1 rle with old method : 0.1840968132019043 time for calcul the mask position with numpy : 0.028249025344848633 nb_pixel_total : 47712 time to create 1 rle with old method : 0.05322432518005371 time for calcul the mask position with numpy : 0.027776241302490234 nb_pixel_total : 110618 time to create 1 rle with old method : 0.12330889701843262 time for calcul the mask position with numpy : 0.02679586410522461 nb_pixel_total : 18032 time to create 1 rle with old method : 0.02010202407836914 time for calcul the mask position with numpy : 0.0317530632019043 nb_pixel_total : 18544 time to create 1 rle with old method : 0.020909547805786133 time for calcul the mask position with numpy : 0.03100752830505371 nb_pixel_total : 121242 time to create 1 rle with old method : 0.13495397567749023 time for calcul the mask position with numpy : 0.02626776695251465 nb_pixel_total : 43676 time to create 1 rle with old method : 0.04872274398803711 time for calcul the mask position with numpy : 0.039408206939697266 nb_pixel_total : 48413 time to create 1 rle with old method : 0.060254812240600586 time for calcul the mask position with numpy : 0.04492783546447754 nb_pixel_total : 44813 time to create 1 rle with old method : 0.05224728584289551 time for calcul the mask position with numpy : 0.04832792282104492 nb_pixel_total : 75615 time to create 1 rle with old method : 0.08750796318054199 create new chi : 2.976400375366211 time to delete rle : 0.028216123580932617 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 10153 TO DO : save crop sub photo not yet done ! save time : 0.6921596527099609 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 5.649180889129639 time for calcul the mask position with numpy : 1.2974216938018799 nb_pixel_total : 7975904 time to create 1 rle with new method : 1.2625164985656738 time for calcul the mask position with numpy : 0.05704236030578613 nb_pixel_total : 34003 time to create 1 rle with old method : 0.038718461990356445 time for calcul the mask position with numpy : 0.04943442344665527 nb_pixel_total : 13405 time to create 1 rle with old method : 0.01733088493347168 time for calcul the mask position with numpy : 0.039048194885253906 nb_pixel_total : 68638 time to create 1 rle with old method : 0.0865180492401123 time for calcul the mask position with numpy : 0.038294076919555664 nb_pixel_total : 26018 time to create 1 rle with old method : 0.032996177673339844 time for calcul the mask position with numpy : 0.04436779022216797 nb_pixel_total : 30414 time to create 1 rle with old method : 0.0373682975769043 time for calcul the mask position with numpy : 0.03041386604309082 nb_pixel_total : 85347 time to create 1 rle with old method : 0.1004188060760498 time for calcul the mask position with numpy : 0.03027653694152832 nb_pixel_total : 5532 time to create 1 rle with old method : 0.006451129913330078 time for calcul the mask position with numpy : 0.032726287841796875 nb_pixel_total : 40323 time to create 1 rle with old method : 0.04679369926452637 time for calcul the mask position with numpy : 0.03079533576965332 nb_pixel_total : 14816 time to create 1 rle with old method : 0.01697063446044922 create new chi : 3.3652873039245605 time to delete rle : 0.0018928050994873047 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 6172 TO DO : save crop sub photo not yet done ! save time : 0.44669437408447266 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 5.24107027053833 time for calcul the mask position with numpy : 1.2741119861602783 nb_pixel_total : 7926851 time to create 1 rle with new method : 1.1194400787353516 time for calcul the mask position with numpy : 0.040833234786987305 nb_pixel_total : 51003 time to create 1 rle with old method : 0.0591120719909668 time for calcul the mask position with numpy : 0.028746843338012695 nb_pixel_total : 65584 time to create 1 rle with old method : 0.07527780532836914 time for calcul the mask position with numpy : 0.03271603584289551 nb_pixel_total : 16883 time to create 1 rle with old method : 0.021049976348876953 time for calcul the mask position with numpy : 0.02810525894165039 nb_pixel_total : 26974 time to create 1 rle with old method : 0.03103923797607422 time for calcul the mask position with numpy : 0.027974843978881836 nb_pixel_total : 33529 time to create 1 rle with old method : 0.042435646057128906 time for calcul the mask position with numpy : 0.03347420692443848 nb_pixel_total : 22452 time to create 1 rle with old method : 0.025769472122192383 time for calcul the mask position with numpy : 0.03260040283203125 nb_pixel_total : 54540 time to create 1 rle with old method : 0.06105995178222656 time for calcul the mask position with numpy : 0.026919841766357422 nb_pixel_total : 6774 time to create 1 rle with old method : 0.007857322692871094 time for calcul the mask position with numpy : 0.03156900405883789 nb_pixel_total : 89810 time to create 1 rle with old method : 0.1160285472869873 create new chi : 3.173907995223999 time to delete rle : 0.0011124610900878906 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 7086 TO DO : save crop sub photo not yet done ! save time : 0.49225664138793945 nb_obj : 34 nb_hashtags : 4 time to prepare the origin masks : 4.62600302696228 time for calcul the mask position with numpy : 1.467327356338501 nb_pixel_total : 7231104 time to create 1 rle with new method : 1.027207851409912 time for calcul the mask position with numpy : 0.04463768005371094 nb_pixel_total : 24496 time to create 1 rle with old method : 0.04038095474243164 time for calcul the mask position with numpy : 0.04423952102661133 nb_pixel_total : 31080 time to create 1 rle with old method : 0.04967617988586426 time for calcul the mask position with numpy : 0.04227304458618164 nb_pixel_total : 23861 time to create 1 rle with old method : 0.03954792022705078 time for calcul the mask position with numpy : 0.04350781440734863 nb_pixel_total : 51108 time to create 1 rle with old method : 0.07959127426147461 time for calcul the mask position with numpy : 0.04156661033630371 nb_pixel_total : 24949 time to create 1 rle with old method : 0.03962063789367676 time for calcul the mask position with numpy : 0.04173874855041504 nb_pixel_total : 16249 time to create 1 rle with old method : 0.0258028507232666 time for calcul the mask position with numpy : 0.04263496398925781 nb_pixel_total : 25420 time to create 1 rle with old method : 0.03972005844116211 time for calcul the mask position with numpy : 0.04160904884338379 nb_pixel_total : 14752 time to create 1 rle with old method : 0.023376941680908203 time for calcul the mask position with numpy : 0.042207956314086914 nb_pixel_total : 9967 time to create 1 rle with old method : 0.015515327453613281 time for calcul the mask position with numpy : 0.042623043060302734 nb_pixel_total : 47126 time to create 1 rle with old method : 0.0773780345916748 time for calcul the mask position with numpy : 0.04273509979248047 nb_pixel_total : 13225 time to create 1 rle with old method : 0.021569252014160156 time for calcul the mask position with numpy : 0.0453791618347168 nb_pixel_total : 22118 time to create 1 rle with old method : 0.024985313415527344 time for calcul the mask position with numpy : 0.03757071495056152 nb_pixel_total : 13821 time to create 1 rle with old method : 0.016515493392944336 time for calcul the mask position with numpy : 0.034871816635131836 nb_pixel_total : 1275 time to create 1 rle with old method : 0.0018630027770996094 time for calcul the mask position with numpy : 0.03507661819458008 nb_pixel_total : 25588 time to create 1 rle with old method : 0.029064178466796875 time for calcul the mask position with numpy : 0.03490614891052246 nb_pixel_total : 12507 time to create 1 rle with old method : 0.014704704284667969 time for calcul the mask position with numpy : 0.03761625289916992 nb_pixel_total : 8913 time to create 1 rle with old method : 0.010217666625976562 time for calcul the mask position with numpy : 0.03550410270690918 nb_pixel_total : 20352 time to create 1 rle with old method : 0.022913694381713867 time for calcul the mask position with numpy : 0.035561561584472656 nb_pixel_total : 74621 time to create 1 rle with old method : 0.08371400833129883 time for calcul the mask position with numpy : 0.03489041328430176 nb_pixel_total : 19735 time to create 1 rle with old method : 0.024000883102416992 time for calcul the mask position with numpy : 0.035283803939819336 nb_pixel_total : 22239 time to create 1 rle with old method : 0.02713608741760254 time for calcul the mask position with numpy : 0.03917717933654785 nb_pixel_total : 35844 time to create 1 rle with old method : 0.054030656814575195 time for calcul the mask position with numpy : 0.035558462142944336 nb_pixel_total : 18751 time to create 1 rle with old method : 0.021352529525756836 time for calcul the mask position with numpy : 0.0379793643951416 nb_pixel_total : 153489 time to create 1 rle with new method : 1.2082045078277588 time for calcul the mask position with numpy : 0.042043209075927734 nb_pixel_total : 50195 time to create 1 rle with old method : 0.06195378303527832 time for calcul the mask position with numpy : 0.03934764862060547 nb_pixel_total : 607 time to create 1 rle with old method : 0.0007979869842529297 time for calcul the mask position with numpy : 0.03757071495056152 nb_pixel_total : 36694 time to create 1 rle with old method : 0.04630255699157715 time for calcul the mask position with numpy : 0.03878974914550781 nb_pixel_total : 96218 time to create 1 rle with old method : 0.11965012550354004 time for calcul the mask position with numpy : 0.04171562194824219 nb_pixel_total : 47222 time to create 1 rle with old method : 0.05620718002319336 time for calcul the mask position with numpy : 0.040271759033203125 nb_pixel_total : 6823 time to create 1 rle with old method : 0.009329795837402344 time for calcul the mask position with numpy : 0.03731107711791992 nb_pixel_total : 20522 time to create 1 rle with old method : 0.024408817291259766 time for calcul the mask position with numpy : 0.03921008110046387 nb_pixel_total : 56966 time to create 1 rle with old method : 0.0651397705078125 time for calcul the mask position with numpy : 0.040390968322753906 nb_pixel_total : 11063 time to create 1 rle with old method : 0.01255655288696289 time for calcul the mask position with numpy : 0.03685450553894043 nb_pixel_total : 25500 time to create 1 rle with old method : 0.02869558334350586 create new chi : 6.360404014587402 time to delete rle : 0.004693269729614258 batch 1 Loaded 69 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 18552 TO DO : save crop sub photo not yet done ! save time : 1.2156705856323242 nb_obj : 17 nb_hashtags : 1 time to prepare the origin masks : 9.488380670547485 time for calcul the mask position with numpy : 0.6465010643005371 nb_pixel_total : 7474650 time to create 1 rle with new method : 1.0728247165679932 time for calcul the mask position with numpy : 0.06087136268615723 nb_pixel_total : 15055 time to create 1 rle with old method : 0.01956915855407715 time for calcul the mask position with numpy : 0.06511449813842773 nb_pixel_total : 37473 time to create 1 rle with old method : 0.04277539253234863 time for calcul the mask position with numpy : 0.0636749267578125 nb_pixel_total : 4072 time to create 1 rle with old method : 0.004895687103271484 time for calcul the mask position with numpy : 0.05898547172546387 nb_pixel_total : 17253 time to create 1 rle with old method : 0.02545642852783203 time for calcul the mask position with numpy : 0.05275392532348633 nb_pixel_total : 79188 time to create 1 rle with old method : 0.10550451278686523 time for calcul the mask position with numpy : 0.06460404396057129 nb_pixel_total : 208066 time to create 1 rle with new method : 1.2069311141967773 time for calcul the mask position with numpy : 0.0472869873046875 nb_pixel_total : 9484 time to create 1 rle with old method : 0.012266397476196289 time for calcul the mask position with numpy : 0.05164384841918945 nb_pixel_total : 11427 time to create 1 rle with old method : 0.01858687400817871 time for calcul the mask position with numpy : 0.05245780944824219 nb_pixel_total : 45583 time to create 1 rle with old method : 0.05158853530883789 time for calcul the mask position with numpy : 0.049810171127319336 nb_pixel_total : 25408 time to create 1 rle with old method : 0.042903900146484375 time for calcul the mask position with numpy : 0.052664756774902344 nb_pixel_total : 84057 time to create 1 rle with old method : 0.10290336608886719 time for calcul the mask position with numpy : 0.04613161087036133 nb_pixel_total : 7544 time to create 1 rle with old method : 0.008603334426879883 time for calcul the mask position with numpy : 0.04055285453796387 nb_pixel_total : 8454 time to create 1 rle with old method : 0.009645462036132812 time for calcul the mask position with numpy : 0.04426121711730957 nb_pixel_total : 34110 time to create 1 rle with old method : 0.03795051574707031 time for calcul the mask position with numpy : 0.04425692558288574 nb_pixel_total : 83646 time to create 1 rle with old method : 0.09368348121643066 time for calcul the mask position with numpy : 0.045084238052368164 nb_pixel_total : 7740 time to create 1 rle with old method : 0.008890390396118164 time for calcul the mask position with numpy : 0.048705101013183594 nb_pixel_total : 141190 time to create 1 rle with old method : 0.16112542152404785 create new chi : 4.666155576705933 time to delete rle : 0.0036721229553222656 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++++++++Number RLEs to save : 12468 TO DO : save crop sub photo not yet done ! save time : 0.981891393661499 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 7.1706531047821045 time for calcul the mask position with numpy : 0.8432223796844482 nb_pixel_total : 7712044 time to create 1 rle with new method : 0.5939195156097412 time for calcul the mask position with numpy : 0.05324554443359375 nb_pixel_total : 99397 time to create 1 rle with old method : 0.11394262313842773 time for calcul the mask position with numpy : 0.05198836326599121 nb_pixel_total : 12281 time to create 1 rle with old method : 0.014061927795410156 time for calcul the mask position with numpy : 0.05754375457763672 nb_pixel_total : 79247 time to create 1 rle with old method : 0.08798503875732422 time for calcul the mask position with numpy : 0.05643796920776367 nb_pixel_total : 56681 time to create 1 rle with old method : 0.06384015083312988 time for calcul the mask position with numpy : 0.04879355430603027 nb_pixel_total : 60554 time to create 1 rle with old method : 0.06758832931518555 time for calcul the mask position with numpy : 0.04585742950439453 nb_pixel_total : 15940 time to create 1 rle with old method : 0.018068313598632812 time for calcul the mask position with numpy : 0.03090047836303711 nb_pixel_total : 38009 time to create 1 rle with old method : 0.04257917404174805 time for calcul the mask position with numpy : 0.031623125076293945 nb_pixel_total : 38656 time to create 1 rle with old method : 0.043404579162597656 time for calcul the mask position with numpy : 0.051773786544799805 nb_pixel_total : 40469 time to create 1 rle with old method : 0.05857443809509277 time for calcul the mask position with numpy : 0.05422234535217285 nb_pixel_total : 141122 time to create 1 rle with old method : 0.19750666618347168 create new chi : 2.6865642070770264 time to delete rle : 0.0030159950256347656 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 9998 TO DO : save crop sub photo not yet done ! save time : 0.6688427925109863 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 6.392484188079834 time for calcul the mask position with numpy : 0.9490013122558594 nb_pixel_total : 7665388 time to create 1 rle with new method : 1.6738622188568115 time for calcul the mask position with numpy : 0.042105674743652344 nb_pixel_total : 40829 time to create 1 rle with old method : 0.05690169334411621 time for calcul the mask position with numpy : 0.047620534896850586 nb_pixel_total : 72953 time to create 1 rle with old method : 0.09085869789123535 time for calcul the mask position with numpy : 0.04085874557495117 nb_pixel_total : 22384 time to create 1 rle with old method : 0.026615142822265625 time for calcul the mask position with numpy : 0.0391087532043457 nb_pixel_total : 16904 time to create 1 rle with old method : 0.018915653228759766 time for calcul the mask position with numpy : 0.03295445442199707 nb_pixel_total : 36110 time to create 1 rle with old method : 0.042067527770996094 time for calcul the mask position with numpy : 0.03232622146606445 nb_pixel_total : 22929 time to create 1 rle with old method : 0.032807111740112305 time for calcul the mask position with numpy : 0.03165268898010254 nb_pixel_total : 33548 time to create 1 rle with old method : 0.03749418258666992 time for calcul the mask position with numpy : 0.028984785079956055 nb_pixel_total : 43254 time to create 1 rle with old method : 0.05072498321533203 time for calcul the mask position with numpy : 0.03331875801086426 nb_pixel_total : 178253 time to create 1 rle with new method : 1.102623462677002 time for calcul the mask position with numpy : 0.03139090538024902 nb_pixel_total : 161848 time to create 1 rle with new method : 1.0083024501800537 create new chi : 5.580196380615234 time to delete rle : 0.0018184185028076172 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++Number RLEs to save : 8235 TO DO : save crop sub photo not yet done ! save time : 0.5693471431732178 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 10.074962377548218 time for calcul the mask position with numpy : 1.1616013050079346 nb_pixel_total : 7186438 time to create 1 rle with new method : 1.2072486877441406 time for calcul the mask position with numpy : 0.04554128646850586 nb_pixel_total : 21458 time to create 1 rle with old method : 0.02587747573852539 time for calcul the mask position with numpy : 0.04775691032409668 nb_pixel_total : 33672 time to create 1 rle with old method : 0.03760647773742676 time for calcul the mask position with numpy : 0.04309415817260742 nb_pixel_total : 152259 time to create 1 rle with new method : 0.9208688735961914 time for calcul the mask position with numpy : 0.04651355743408203 nb_pixel_total : 16927 time to create 1 rle with old method : 0.024761199951171875 time for calcul the mask position with numpy : 0.042130231857299805 nb_pixel_total : 58015 time to create 1 rle with old method : 0.06802940368652344 time for calcul the mask position with numpy : 0.04810333251953125 nb_pixel_total : 34811 time to create 1 rle with old method : 0.05915951728820801 time for calcul the mask position with numpy : 0.04328012466430664 nb_pixel_total : 69695 time to create 1 rle with old method : 0.08444571495056152 time for calcul the mask position with numpy : 0.04706311225891113 nb_pixel_total : 16292 time to create 1 rle with old method : 0.01834273338317871 time for calcul the mask position with numpy : 0.04344987869262695 nb_pixel_total : 32101 time to create 1 rle with old method : 0.035730838775634766 time for calcul the mask position with numpy : 0.04417991638183594 nb_pixel_total : 53697 time to create 1 rle with old method : 0.06004214286804199 time for calcul the mask position with numpy : 0.04284095764160156 nb_pixel_total : 107463 time to create 1 rle with old method : 0.12680983543395996 time for calcul the mask position with numpy : 0.044579505920410156 nb_pixel_total : 15902 time to create 1 rle with old method : 0.02063155174255371 time for calcul the mask position with numpy : 0.05605936050415039 nb_pixel_total : 65666 time to create 1 rle with old method : 0.1216280460357666 time for calcul the mask position with numpy : 0.0599064826965332 nb_pixel_total : 37008 time to create 1 rle with old method : 0.06737446784973145 time for calcul the mask position with numpy : 0.06871509552001953 nb_pixel_total : 18635 time to create 1 rle with old method : 0.030555009841918945 time for calcul the mask position with numpy : 0.06122159957885742 nb_pixel_total : 88176 time to create 1 rle with old method : 0.143310546875 time for calcul the mask position with numpy : 0.06835412979125977 nb_pixel_total : 31125 time to create 1 rle with old method : 0.04874873161315918 time for calcul the mask position with numpy : 0.0729832649230957 nb_pixel_total : 100585 time to create 1 rle with old method : 0.14584875106811523 time for calcul the mask position with numpy : 0.05666685104370117 nb_pixel_total : 154475 time to create 1 rle with new method : 1.1541564464569092 create new chi : 6.6746885776519775 time to delete rle : 0.006759166717529297 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++++++++Number RLEs to save : 15116 TO DO : save crop sub photo not yet done ! save time : 1.0657682418823242 nb_obj : 22 nb_hashtags : 4 time to prepare the origin masks : 11.433939456939697 time for calcul the mask position with numpy : 1.3845796585083008 nb_pixel_total : 7111469 time to create 1 rle with new method : 1.197486400604248 time for calcul the mask position with numpy : 0.04612898826599121 nb_pixel_total : 10192 time to create 1 rle with old method : 0.01716923713684082 time for calcul the mask position with numpy : 0.049848318099975586 nb_pixel_total : 72979 time to create 1 rle with old method : 0.08600687980651855 time for calcul the mask position with numpy : 0.044995784759521484 nb_pixel_total : 75820 time to create 1 rle with old method : 0.08627533912658691 time for calcul the mask position with numpy : 0.07588672637939453 nb_pixel_total : 7638 time to create 1 rle with old method : 0.010322809219360352 time for calcul the mask position with numpy : 0.040053606033325195 nb_pixel_total : 80175 time to create 1 rle with old method : 0.10168647766113281 time for calcul the mask position with numpy : 0.0419769287109375 nb_pixel_total : 17095 time to create 1 rle with old method : 0.020350933074951172 time for calcul the mask position with numpy : 0.0415952205657959 nb_pixel_total : 9470 time to create 1 rle with old method : 0.011197328567504883 time for calcul the mask position with numpy : 0.03704524040222168 nb_pixel_total : 4396 time to create 1 rle with old method : 0.006056308746337891 time for calcul the mask position with numpy : 0.044493675231933594 nb_pixel_total : 99448 time to create 1 rle with old method : 0.11373615264892578 time for calcul the mask position with numpy : 0.03776288032531738 nb_pixel_total : 25537 time to create 1 rle with old method : 0.02876901626586914 time for calcul the mask position with numpy : 0.04644012451171875 nb_pixel_total : 24441 time to create 1 rle with old method : 0.036834716796875 time for calcul the mask position with numpy : 0.04298853874206543 nb_pixel_total : 107743 time to create 1 rle with old method : 0.12359070777893066 time for calcul the mask position with numpy : 0.041970014572143555 nb_pixel_total : 15204 time to create 1 rle with old method : 0.01729130744934082 time for calcul the mask position with numpy : 0.042104482650756836 nb_pixel_total : 45476 time to create 1 rle with old method : 0.0641777515411377 time for calcul the mask position with numpy : 0.05054044723510742 nb_pixel_total : 78507 time to create 1 rle with old method : 0.11195516586303711 time for calcul the mask position with numpy : 0.04789543151855469 nb_pixel_total : 16334 time to create 1 rle with old method : 0.01836419105529785 time for calcul the mask position with numpy : 0.04703807830810547 nb_pixel_total : 159717 time to create 1 rle with new method : 1.0688679218292236 time for calcul the mask position with numpy : 0.04501152038574219 nb_pixel_total : 17043 time to create 1 rle with old method : 0.018854618072509766 time for calcul the mask position with numpy : 0.04300284385681152 nb_pixel_total : 30830 time to create 1 rle with old method : 0.034731388092041016 time for calcul the mask position with numpy : 0.04519033432006836 nb_pixel_total : 17169 time to create 1 rle with old method : 0.01906728744506836 time for calcul the mask position with numpy : 0.044831037521362305 nb_pixel_total : 125612 time to create 1 rle with old method : 0.14037322998046875 time for calcul the mask position with numpy : 0.04302525520324707 nb_pixel_total : 142105 time to create 1 rle with old method : 0.15718722343444824 create new chi : 6.0101118087768555 time to delete rle : 0.0026903152465820312 batch 1 Loaded 45 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 16588 TO DO : save crop sub photo not yet done ! save time : 1.0819125175476074 map_output_result : {1361085169: (0.0, 'Should be the crop_list due to order', 0), 1361085165: (0.0, 'Should be the crop_list due to order', 0), 1361085162: (0.0, 'Should be the crop_list due to order', 0), 1361085157: (0.0, 'Should be the crop_list due to order', 0), 1361085154: (0.0, 'Should be the crop_list due to order', 0), 1361085131: (0.0, 'Should be the crop_list due to order', 0), 1361085128: (0.0, 'Should be the crop_list due to order', 0), 1361085124: (0.0, 'Should be the crop_list due to order', 0), 1361085111: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1361085169, 1361085165, 1361085162, 1361085157, 1361085154, 1361085131, 1361085128, 1361085124, 1361085111] Looping around the photos to save general results len do output : 9 /1361085169.Didn't retrieve data . /1361085165.Didn't retrieve data . /1361085162.Didn't retrieve data . /1361085157.Didn't retrieve data . /1361085154.Didn't retrieve data . /1361085131.Didn't retrieve data . /1361085128.Didn't retrieve data . /1361085124.Didn't retrieve data . /1361085111.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085169', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085165', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085162', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085157', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085154', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085131', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085128', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085124', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085111', None, None, None, None, None, '2955250') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.013898134231567383 save_final save missing photos in datou_result : time spend for datou_step_exec : 117.40288758277893 time spend to save output : 0.02294135093688965 total time spend for step 3 : 117.42582893371582 step4:ventilate_hashtags_in_portfolio Mon May 26 17:45:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23342745 get user id for portfolio 23342745 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23342745 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','pet_clair','background','environnement','carton','papier','mal_croppe','flou','autre','pet_fonce','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23342745 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','pet_clair','background','environnement','carton','papier','mal_croppe','flou','autre','pet_fonce','metal')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23342745 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','pet_clair','background','environnement','carton','papier','mal_croppe','flou','autre','pet_fonce','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23349685,23349686,23349687,23349688,23349689,23349690,23349691,23349692,23349693,23349694,23349695?tags=pehd,pet_clair,background,environnement,carton,papier,mal_croppe,flou,autre,pet_fonce,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1361085169, 1361085165, 1361085162, 1361085157, 1361085154, 1361085131, 1361085128, 1361085124, 1361085111] Looping around the photos to save general results len do output : 1 /23342745. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085169', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085165', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085162', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085157', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085154', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085131', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085128', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085124', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085111', None, None, None, None, None, '2955250') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.013923168182373047 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7093408107757568 time spend to save output : 0.014270544052124023 total time spend for step 4 : 1.7236113548278809 step5:final Mon May 26 17:45:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1361085169: ('0.0907608212234225',), 1361085165: ('0.0907608212234225',), 1361085162: ('0.0907608212234225',), 1361085157: ('0.0907608212234225',), 1361085154: ('0.0907608212234225',), 1361085131: ('0.0907608212234225',), 1361085128: ('0.0907608212234225',), 1361085124: ('0.0907608212234225',), 1361085111: ('0.0907608212234225',)} new output for save of step final : {1361085169: ('0.0907608212234225',), 1361085165: ('0.0907608212234225',), 1361085162: ('0.0907608212234225',), 1361085157: ('0.0907608212234225',), 1361085154: ('0.0907608212234225',), 1361085131: ('0.0907608212234225',), 1361085128: ('0.0907608212234225',), 1361085124: ('0.0907608212234225',), 1361085111: ('0.0907608212234225',)} [1361085169, 1361085165, 1361085162, 1361085157, 1361085154, 1361085131, 1361085128, 1361085124, 1361085111] Looping around the photos to save general results len do output : 9 /1361085169.Didn't retrieve data . /1361085165.Didn't retrieve data . /1361085162.Didn't retrieve data . /1361085157.Didn't retrieve data . /1361085154.Didn't retrieve data . /1361085131.Didn't retrieve data . /1361085128.Didn't retrieve data . /1361085124.Didn't retrieve data . /1361085111.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085169', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085165', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085162', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085157', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085154', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085131', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085128', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085124', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085111', None, None, None, None, None, '2955250') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.016180038452148438 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12917423248291016 time spend to save output : 0.017135143280029297 total time spend for step 5 : 0.14630937576293945 step6:blur_detection Mon May 26 17:45:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9.jpg resize: (2160, 3840) 1361085169 -5.362116443311725 treat image : temp/1748274030_610213_1361085165_d2dbac5d2d357b2a3cf45b594b8c8ccc.jpg resize: (2160, 3840) 1361085165 -5.63500464430163 treat image : temp/1748274030_610213_1361085162_f268ce995b942a0d524f79f11a5679c4.jpg resize: (2160, 3840) 1361085162 -6.413577460628393 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0.jpg resize: (2160, 3840) 1361085157 -6.592945320227999 treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e.jpg resize: (2160, 3840) 1361085154 -6.111129768635298 treat image : temp/1748274030_610213_1361085131_909fa8de387a60a82b6195b721858acc.jpg resize: (2160, 3840) 1361085131 -6.33984579770554 treat image : temp/1748274030_610213_1361085128_2b6a6bf484100e3a626cfeb244dce107.jpg resize: (2160, 3840) 1361085128 -6.385422900491384 treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f.jpg resize: (2160, 3840) 1361085124 -6.643945412766225 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1.jpg resize: (2160, 3840) 1361085111 -6.640341944307399 treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9_rle_crop_3813309738_0.png resize: (420, 301) 1361123111 -3.005150690467763 treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9_rle_crop_3813309740_0.png resize: (337, 216) 1361123112 -3.3580118644624943 treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9_rle_crop_3813309741_0.png resize: (283, 263) 1361123113 -4.866186640287139 treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9_rle_crop_3813309742_0.png resize: (442, 577) 1361123114 -4.433747270603187 treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9_rle_crop_3813309745_0.png resize: (434, 516) 1361123115 -3.906241487609323 treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9_rle_crop_3813309746_0.png resize: (251, 273) 1361123116 -1.7822723429028677 treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9_rle_crop_3813309747_0.png resize: (509, 445) 1361123117 -4.726709091851854 treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9_rle_crop_3813309748_0.png resize: (318, 168) 1361123118 -4.127602776060809 treat image : temp/1748274030_610213_1361085165_d2dbac5d2d357b2a3cf45b594b8c8ccc_rle_crop_3813309749_0.png resize: (141, 131) 1361123119 -4.301191773785779 treat image : temp/1748274030_610213_1361085165_d2dbac5d2d357b2a3cf45b594b8c8ccc_rle_crop_3813309751_0.png resize: (83, 111) 1361123120 -4.3636333099904485 treat image : temp/1748274030_610213_1361085165_d2dbac5d2d357b2a3cf45b594b8c8ccc_rle_crop_3813309752_0.png resize: (571, 220) 1361123121 -3.6170260882728735 treat image : temp/1748274030_610213_1361085165_d2dbac5d2d357b2a3cf45b594b8c8ccc_rle_crop_3813309753_0.png resize: (163, 214) 1361123122 -3.110990255850841 treat image : temp/1748274030_610213_1361085165_d2dbac5d2d357b2a3cf45b594b8c8ccc_rle_crop_3813309754_0.png resize: (192, 182) 1361123123 -3.594574345262744 treat image : temp/1748274030_610213_1361085165_d2dbac5d2d357b2a3cf45b594b8c8ccc_rle_crop_3813309756_0.png resize: (142, 176) 1361123124 -3.8647322371214865 treat image : temp/1748274030_610213_1361085165_d2dbac5d2d357b2a3cf45b594b8c8ccc_rle_crop_3813309757_0.png resize: (227, 233) 1361123125 -0.38643730224870626 treat image : temp/1748274030_610213_1361085162_f268ce995b942a0d524f79f11a5679c4_rle_crop_3813309758_0.png resize: (395, 378) 1361123126 -2.0183657355831497 treat image : temp/1748274030_610213_1361085162_f268ce995b942a0d524f79f11a5679c4_rle_crop_3813309760_0.png resize: (391, 307) 1361123127 -2.9711322469247525 treat image : temp/1748274030_610213_1361085162_f268ce995b942a0d524f79f11a5679c4_rle_crop_3813309761_0.png resize: (118, 211) 1361123128 -1.1826565789684313 treat image : temp/1748274030_610213_1361085162_f268ce995b942a0d524f79f11a5679c4_rle_crop_3813309762_0.png resize: (258, 285) 1361123129 -3.819508661919169 treat image : temp/1748274030_610213_1361085162_f268ce995b942a0d524f79f11a5679c4_rle_crop_3813309765_0.png resize: (358, 377) 1361123130 -4.230410992531876 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309767_0.png resize: (289, 244) 1361123131 -3.1466885295193214 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309768_0.png resize: (217, 242) 1361123132 -2.106403567933339 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309769_0.png resize: (227, 197) 1361123133 -2.0326721790380127 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309770_0.png resize: (279, 267) 1361123134 -0.11201738330288956 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309771_0.png resize: (272, 240) 1361123135 -4.113312340016083 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309772_0.png resize: (563, 247) 1361123136 -2.991779622396431 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309773_0.png resize: (231, 126) 1361123137 -2.3435113660467377 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309774_0.png resize: (117, 154) 1361123138 -2.3750344150080465 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309775_0.png resize: (155, 114) 1361123139 -1.2187785560077624 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309776_0.png resize: (273, 121) 1361123140 -2.0854396358143097 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309778_0.png resize: (169, 104) 1361123141 -3.503158284068981 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309779_0.png resize: (106, 102) 1361123142 -0.3211562589332057 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309780_0.png resize: (105, 94) 1361123143 -1.3062226627415798 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309781_0.png resize: (230, 186) 1361123144 -3.8724944922563838 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309782_0.png resize: (303, 532) 1361123145 -3.7768602697447764 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309784_0.png resize: (125, 665) 1361123146 -3.20321673251992 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309785_0.png resize: (163, 92) 1361123147 -2.343641950219855 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309786_0.png resize: (298, 315) 1361123148 -4.727694177397573 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309787_0.png resize: (197, 134) 1361123149 -1.987388491697904 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309788_0.png resize: (241, 179) 1361123150 -3.3401610311999224 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309789_0.png resize: (148, 249) 1361123151 -5.268015018279991 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309790_0.png resize: (178, 484) 1361123152 -5.15104075092858 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309791_0.png resize: (539, 181) 1361123153 -3.246098679567562 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309792_0.png resize: (108, 268) 1361123154 -2.7367702330229853 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309794_0.png resize: (186, 133) 1361123155 -4.426190107215275 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309795_0.png resize: (250, 171) 1361123156 -3.9708084917509385 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309796_0.png resize: (120, 106) 1361123157 -3.654793189767498 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309798_0.png resize: (179, 209) 1361123158 -3.4261042937989097 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309799_0.png resize: (146, 135) 1361123159 -3.404570897151132 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309800_0.png resize: (168, 187) 1361123160 -3.6841490447770853 treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309801_0.png resize: (739, 296) 1361123161 -1.4138353440768894 treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309802_0.png resize: (97, 133) 1361123163 -2.932100691376757 treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309803_0.png resize: (265, 600) 1361123164 -3.4183386545285037 treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309804_0.png resize: (268, 272) 1361123165 -3.658258504117415 treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309805_0.png resize: (147, 112) 1361123167 -3.03935376261498 treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309806_0.png resize: (185, 134) 1361123169 -3.6405932634019025 treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309807_0.png resize: (228, 576) 1361123171 0.04795422934447888 treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309808_0.png resize: (204, 201) 1361123172 -3.021274553095802 treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309809_0.png resize: (387, 168) 1361123173 -2.632143175843898 treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309810_0.png resize: (120, 147) 1361123175 0.9883170287842404 treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309811_0.png resize: (152, 92) 1361123176 -2.395834653753034 treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309812_0.png resize: (725, 646) 1361123177 -4.001300142201795 treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309813_0.png resize: (367, 280) 1361123179 -4.266998038749138 treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309814_0.png resize: (218, 104) 1361123181 -1.3939665639360972 treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309815_0.png resize: (136, 83) 1361123182 -1.8163149891506551 treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309816_0.png resize: (185, 252) 1361123184 -1.5268635074126107 treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309817_0.png resize: (154, 147) 1361123185 -0.7090705163500609 treat image : temp/1748274030_610213_1361085131_909fa8de387a60a82b6195b721858acc_rle_crop_3813309818_0.png resize: (372, 527) 1361123186 -1.2488617524207544 treat image : temp/1748274030_610213_1361085131_909fa8de387a60a82b6195b721858acc_rle_crop_3813309819_0.png resize: (364, 302) 1361123189 -1.7687483350281674 treat image : temp/1748274030_610213_1361085131_909fa8de387a60a82b6195b721858acc_rle_crop_3813309821_0.png resize: (249, 213) 1361123190 -3.3409219471477276 treat image : temp/1748274030_610213_1361085131_909fa8de387a60a82b6195b721858acc_rle_crop_3813309822_0.png resize: (181, 145) 1361123191 -2.7381347058875387 treat image : temp/1748274030_610213_1361085131_909fa8de387a60a82b6195b721858acc_rle_crop_3813309827_0.png resize: (547, 360) 1361123193 -2.9259028594073766 treat image : temp/1748274030_610213_1361085128_2b6a6bf484100e3a626cfeb244dce107_rle_crop_3813309828_0.png resize: (345, 648) 1361123194 -0.7083820859188067 treat image : temp/1748274030_610213_1361085128_2b6a6bf484100e3a626cfeb244dce107_rle_crop_3813309829_0.png resize: (571, 699) 1361123195 -1.7221360881095482 treat image : temp/1748274030_610213_1361085128_2b6a6bf484100e3a626cfeb244dce107_rle_crop_3813309830_0.png resize: (393, 165) 1361123197 -3.2325046462026092 treat image : temp/1748274030_610213_1361085128_2b6a6bf484100e3a626cfeb244dce107_rle_crop_3813309831_0.png resize: (267, 207) 1361123198 -3.5740676498089945 treat image : temp/1748274030_610213_1361085128_2b6a6bf484100e3a626cfeb244dce107_rle_crop_3813309832_0.png resize: (260, 222) 1361123199 -4.02451481157041 treat image : temp/1748274030_610213_1361085128_2b6a6bf484100e3a626cfeb244dce107_rle_crop_3813309833_0.png resize: (300, 265) 1361123201 -3.2752182867216915 treat image : temp/1748274030_610213_1361085128_2b6a6bf484100e3a626cfeb244dce107_rle_crop_3813309834_0.png resize: (113, 183) 1361123202 0.7806913862960071 treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309838_0.png resize: (432, 508) 1361123203 -2.9975391597182535 treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309839_0.png resize: (394, 329) 1361123204 -3.7949638178243323 treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309840_0.png resize: (155, 295) 1361123205 -3.4535154205875163 treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309841_0.png resize: (460, 342) 1361123206 -3.841476278490049 treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309843_0.png resize: (228, 274) 1361123207 -4.542490812179234 treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309844_0.png resize: (490, 249) 1361123208 -3.6660035046002726 treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309845_0.png resize: (157, 194) 1361123209 -3.9197297418181627 treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309846_0.png resize: (470, 357) 1361123210 -3.254717861645635 treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309848_0.png resize: (162, 236) 1361123211 2.444755828488108 treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309849_0.png resize: (198, 132) 1361123212 -2.673990906672604 treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309851_0.png resize: (234, 236) 1361123213 -3.6351653262031993 treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309854_0.png resize: (452, 477) 1361123214 -3.1658535714357168 treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309855_0.png resize: (325, 171) 1361123216 -4.435370598575256 treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309856_0.png resize: (196, 205) 1361123217 -3.9544776673204147 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309857_0.png resize: (474, 457) 1361123218 1.136647886403632 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309858_0.png resize: (418, 369) 1361123219 -3.917187385518368 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309859_0.png resize: (159, 190) 1361123220 -3.822264325050088 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309860_0.png resize: (149, 309) 1361123221 -2.626634463145766 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309862_0.png resize: (458, 499) 1361123222 -2.8325359363693408 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309863_0.png resize: (156, 197) 1361123223 -4.343804339850105 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309867_0.png resize: (484, 370) 1361123224 -2.830409446472105 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309868_0.png resize: (551, 213) 1361123225 -2.268095940177103 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309870_0.png resize: (447, 489) 1361123226 -2.017765726231304 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309871_0.png resize: (85, 93) 1361123227 -2.666733040211447 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309872_0.png resize: (146, 112) 1361123228 -4.280855703571117 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309873_0.png resize: (149, 187) 1361123229 -3.4312104190942794 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309874_0.png resize: (548, 268) 1361123230 -3.4496037142440716 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309875_0.png resize: (108, 96) 1361123231 -3.7350267626177676 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309876_0.png resize: (326, 360) 1361123232 -3.314804902204694 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309877_0.png resize: (419, 350) 1361123233 -2.890302735960629 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309878_0.png resize: (154, 129) 1361123234 -2.503127451974529 treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9_rle_crop_3813309739_0.png resize: (246, 295) 1361123244 -3.735747980229079 treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9_rle_crop_3813309743_0.png resize: (268, 98) 1361123245 -2.6866404319741104 treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9_rle_crop_3813309744_0.png resize: (181, 126) 1361123246 -2.8334396908788655 treat image : temp/1748274030_610213_1361085162_f268ce995b942a0d524f79f11a5679c4_rle_crop_3813309764_0.png resize: (125, 170) 1361123247 -1.5441540127892692 treat image : temp/1748274030_610213_1361085162_f268ce995b942a0d524f79f11a5679c4_rle_crop_3813309766_0.png resize: (259, 243) 1361123248 -4.013790195156169 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309797_0.png resize: (247, 256) 1361123249 -3.4508627167889063 treat image : temp/1748274030_610213_1361085131_909fa8de387a60a82b6195b721858acc_rle_crop_3813309820_0.png resize: (341, 165) 1361123250 -4.547398566260407 treat image : temp/1748274030_610213_1361085128_2b6a6bf484100e3a626cfeb244dce107_rle_crop_3813309835_0.png resize: (242, 108) 1361123251 -2.080259352984708 treat image : temp/1748274030_610213_1361085128_2b6a6bf484100e3a626cfeb244dce107_rle_crop_3813309836_0.png resize: (259, 390) 1361123252 -2.698843105351962 treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309842_0.png resize: (143, 223) 1361123253 -2.4509289570785304 treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309850_0.png resize: (382, 338) 1361123254 -3.9929221162032404 treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309852_0.png resize: (440, 344) 1361123255 -3.2795808623937512 treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309853_0.png resize: (136, 179) 1361123256 -3.140134491938438 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309861_0.png resize: (154, 211) 1361123257 -2.977022845790295 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309866_0.png resize: (182, 194) 1361123258 -0.7570989873375895 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309869_0.png resize: (302, 127) 1361123259 -4.472481237003572 treat image : temp/1748274030_610213_1361085165_d2dbac5d2d357b2a3cf45b594b8c8ccc_rle_crop_3813309750_0.png resize: (205, 289) 1361123262 -4.42114776988369 treat image : temp/1748274030_610213_1361085162_f268ce995b942a0d524f79f11a5679c4_rle_crop_3813309763_0.png resize: (126, 273) 1361123263 -4.483680617250484 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309783_0.png resize: (222, 168) 1361123264 -3.471417821597904 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309793_0.png resize: (506, 468) 1361123265 -4.648463515784191 treat image : temp/1748274030_610213_1361085131_909fa8de387a60a82b6195b721858acc_rle_crop_3813309823_0.png resize: (304, 281) 1361123266 -4.05261175881201 treat image : temp/1748274030_610213_1361085131_909fa8de387a60a82b6195b721858acc_rle_crop_3813309824_0.png resize: (264, 287) 1361123267 -3.8933854402962536 treat image : temp/1748274030_610213_1361085131_909fa8de387a60a82b6195b721858acc_rle_crop_3813309825_0.png resize: (412, 347) 1361123268 -3.885379050886295 treat image : temp/1748274030_610213_1361085128_2b6a6bf484100e3a626cfeb244dce107_rle_crop_3813309837_0.png resize: (270, 253) 1361123269 -3.342295843041175 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309864_0.png resize: (262, 369) 1361123270 -2.4462323785316715 treat image : temp/1748274030_610213_1361085162_f268ce995b942a0d524f79f11a5679c4_rle_crop_3813309759_0.png resize: (78, 99) 1361123273 -3.0867597466191037 treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309777_0.png resize: (156, 186) 1361123274 -3.331851363998738 treat image : temp/1748274030_610213_1361085131_909fa8de387a60a82b6195b721858acc_rle_crop_3813309826_0.png resize: (129, 140) 1361123275 -1.6132520287420864 treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309847_0.png resize: (364, 172) 1361123276 -1.385992695934029 treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309865_0.png resize: (345, 160) 1361123277 -1.412658997500363 treat image : temp/1748274030_610213_1361085165_d2dbac5d2d357b2a3cf45b594b8c8ccc_rle_crop_3813309755_0.png resize: (220, 446) 1361123280 -3.6318434067341054 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 150 time used for this insertion : 0.026107311248779297 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 150 time used for this insertion : 0.03744363784790039 save missing photos in datou_result : time spend for datou_step_exec : 46.600040912628174 time spend to save output : 0.08035159111022949 total time spend for step 6 : 46.6803925037384 step7:brightness Mon May 26 17:46:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9.jpg treat image : temp/1748274030_610213_1361085165_d2dbac5d2d357b2a3cf45b594b8c8ccc.jpg treat image : temp/1748274030_610213_1361085162_f268ce995b942a0d524f79f11a5679c4.jpg treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0.jpg treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e.jpg treat image : temp/1748274030_610213_1361085131_909fa8de387a60a82b6195b721858acc.jpg treat image : temp/1748274030_610213_1361085128_2b6a6bf484100e3a626cfeb244dce107.jpg treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f.jpg treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1.jpg treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9_rle_crop_3813309738_0.png treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9_rle_crop_3813309740_0.png treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9_rle_crop_3813309741_0.png treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9_rle_crop_3813309742_0.png treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9_rle_crop_3813309745_0.png treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9_rle_crop_3813309746_0.png treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9_rle_crop_3813309747_0.png treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9_rle_crop_3813309748_0.png treat image : temp/1748274030_610213_1361085165_d2dbac5d2d357b2a3cf45b594b8c8ccc_rle_crop_3813309749_0.png treat image : temp/1748274030_610213_1361085165_d2dbac5d2d357b2a3cf45b594b8c8ccc_rle_crop_3813309751_0.png treat image : temp/1748274030_610213_1361085165_d2dbac5d2d357b2a3cf45b594b8c8ccc_rle_crop_3813309752_0.png treat image : temp/1748274030_610213_1361085165_d2dbac5d2d357b2a3cf45b594b8c8ccc_rle_crop_3813309753_0.png treat image : temp/1748274030_610213_1361085165_d2dbac5d2d357b2a3cf45b594b8c8ccc_rle_crop_3813309754_0.png treat image : temp/1748274030_610213_1361085165_d2dbac5d2d357b2a3cf45b594b8c8ccc_rle_crop_3813309756_0.png treat image : temp/1748274030_610213_1361085165_d2dbac5d2d357b2a3cf45b594b8c8ccc_rle_crop_3813309757_0.png treat image : temp/1748274030_610213_1361085162_f268ce995b942a0d524f79f11a5679c4_rle_crop_3813309758_0.png treat image : temp/1748274030_610213_1361085162_f268ce995b942a0d524f79f11a5679c4_rle_crop_3813309760_0.png treat image : temp/1748274030_610213_1361085162_f268ce995b942a0d524f79f11a5679c4_rle_crop_3813309761_0.png treat image : temp/1748274030_610213_1361085162_f268ce995b942a0d524f79f11a5679c4_rle_crop_3813309762_0.png treat image : temp/1748274030_610213_1361085162_f268ce995b942a0d524f79f11a5679c4_rle_crop_3813309765_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309767_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309768_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309769_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309770_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309771_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309772_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309773_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309774_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309775_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309776_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309778_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309779_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309780_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309781_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309782_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309784_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309785_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309786_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309787_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309788_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309789_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309790_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309791_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309792_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309794_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309795_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309796_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309798_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309799_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309800_0.png treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309801_0.png treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309802_0.png treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309803_0.png treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309804_0.png treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309805_0.png treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309806_0.png treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309807_0.png treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309808_0.png treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309809_0.png treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309810_0.png treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309811_0.png treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309812_0.png treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309813_0.png treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309814_0.png treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309815_0.png treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309816_0.png treat image : temp/1748274030_610213_1361085154_808731d749f27c2f273245cf161d3c7e_rle_crop_3813309817_0.png treat image : temp/1748274030_610213_1361085131_909fa8de387a60a82b6195b721858acc_rle_crop_3813309818_0.png treat image : temp/1748274030_610213_1361085131_909fa8de387a60a82b6195b721858acc_rle_crop_3813309819_0.png treat image : temp/1748274030_610213_1361085131_909fa8de387a60a82b6195b721858acc_rle_crop_3813309821_0.png treat image : temp/1748274030_610213_1361085131_909fa8de387a60a82b6195b721858acc_rle_crop_3813309822_0.png treat image : temp/1748274030_610213_1361085131_909fa8de387a60a82b6195b721858acc_rle_crop_3813309827_0.png treat image : temp/1748274030_610213_1361085128_2b6a6bf484100e3a626cfeb244dce107_rle_crop_3813309828_0.png treat image : temp/1748274030_610213_1361085128_2b6a6bf484100e3a626cfeb244dce107_rle_crop_3813309829_0.png treat image : temp/1748274030_610213_1361085128_2b6a6bf484100e3a626cfeb244dce107_rle_crop_3813309830_0.png treat image : temp/1748274030_610213_1361085128_2b6a6bf484100e3a626cfeb244dce107_rle_crop_3813309831_0.png treat image : temp/1748274030_610213_1361085128_2b6a6bf484100e3a626cfeb244dce107_rle_crop_3813309832_0.png treat image : temp/1748274030_610213_1361085128_2b6a6bf484100e3a626cfeb244dce107_rle_crop_3813309833_0.png treat image : temp/1748274030_610213_1361085128_2b6a6bf484100e3a626cfeb244dce107_rle_crop_3813309834_0.png treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309838_0.png treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309839_0.png treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309840_0.png treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309841_0.png treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309843_0.png treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309844_0.png treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309845_0.png treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309846_0.png treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309848_0.png treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309849_0.png treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309851_0.png treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309854_0.png treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309855_0.png treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309856_0.png treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309857_0.png treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309858_0.png treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309859_0.png treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309860_0.png treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309862_0.png treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309863_0.png treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309867_0.png treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309868_0.png treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309870_0.png treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309871_0.png treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309872_0.png treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309873_0.png treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309874_0.png treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309875_0.png treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309876_0.png treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309877_0.png treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309878_0.png treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9_rle_crop_3813309739_0.png treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9_rle_crop_3813309743_0.png treat image : temp/1748274030_610213_1361085169_3ef5be744113e201ffcbc7f1a1cc0ad9_rle_crop_3813309744_0.png treat image : temp/1748274030_610213_1361085162_f268ce995b942a0d524f79f11a5679c4_rle_crop_3813309764_0.png treat image : temp/1748274030_610213_1361085162_f268ce995b942a0d524f79f11a5679c4_rle_crop_3813309766_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309797_0.png treat image : temp/1748274030_610213_1361085131_909fa8de387a60a82b6195b721858acc_rle_crop_3813309820_0.png treat image : temp/1748274030_610213_1361085128_2b6a6bf484100e3a626cfeb244dce107_rle_crop_3813309835_0.png treat image : temp/1748274030_610213_1361085128_2b6a6bf484100e3a626cfeb244dce107_rle_crop_3813309836_0.png treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309842_0.png treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309850_0.png treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309852_0.png treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309853_0.png treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309861_0.png treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309866_0.png treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309869_0.png treat image : temp/1748274030_610213_1361085165_d2dbac5d2d357b2a3cf45b594b8c8ccc_rle_crop_3813309750_0.png treat image : temp/1748274030_610213_1361085162_f268ce995b942a0d524f79f11a5679c4_rle_crop_3813309763_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309783_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309793_0.png treat image : temp/1748274030_610213_1361085131_909fa8de387a60a82b6195b721858acc_rle_crop_3813309823_0.png treat image : temp/1748274030_610213_1361085131_909fa8de387a60a82b6195b721858acc_rle_crop_3813309824_0.png treat image : temp/1748274030_610213_1361085131_909fa8de387a60a82b6195b721858acc_rle_crop_3813309825_0.png treat image : temp/1748274030_610213_1361085128_2b6a6bf484100e3a626cfeb244dce107_rle_crop_3813309837_0.png treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309864_0.png treat image : temp/1748274030_610213_1361085162_f268ce995b942a0d524f79f11a5679c4_rle_crop_3813309759_0.png treat image : temp/1748274030_610213_1361085157_9c1ee7d43b7cafb08693baeeff9b4db0_rle_crop_3813309777_0.png treat image : temp/1748274030_610213_1361085131_909fa8de387a60a82b6195b721858acc_rle_crop_3813309826_0.png treat image : temp/1748274030_610213_1361085124_29a809dfb66c9ea5ecfe9ab8ecc5e17f_rle_crop_3813309847_0.png treat image : temp/1748274030_610213_1361085111_688007cc844a2701f908dad608edc7d1_rle_crop_3813309865_0.png treat image : temp/1748274030_610213_1361085165_d2dbac5d2d357b2a3cf45b594b8c8ccc_rle_crop_3813309755_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 150 time used for this insertion : 0.027952909469604492 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 150 time used for this insertion : 0.034975528717041016 save missing photos in datou_result : time spend for datou_step_exec : 11.790306568145752 time spend to save output : 0.06916427612304688 total time spend for step 7 : 11.859470844268799 step8:velours_tree Mon May 26 17:46:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 2.6024234294891357 time spend to save output : 0.015332698822021484 total time spend for step 8 : 2.6177561283111572 step9:send_mail_cod Mon May 26 17:46:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23342745_26-05-2025_17_46_51.pdf 23349685 imagette233496851748274411 23349686 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233496861748274411 23349687 imagette233496871748274412 23349689 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233496891748274412 23349690 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233496901748274413 23349691 imagette233496911748274416 23349692 imagette233496921748274416 23349693 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233496931748274416 23349694 change filename to text .imagette233496941748274417 23349695 imagette233496951748274417 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23342745 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23349685,23349686,23349687,23349688,23349689,23349690,23349691,23349692,23349693,23349694,23349695?tags=pehd,pet_clair,background,environnement,carton,papier,mal_croppe,flou,autre,pet_fonce,metal args[1361085169] : ((1361085169, -5.362116443311725, 492609224), (1361085169, 0.1747464878017057, 2107752395), '0.0907608212234225') We are sending mail with results at report@fotonower.com args[1361085165] : ((1361085165, -5.63500464430163, 492609224), (1361085165, 0.4735139818108663, 2107752395), '0.0907608212234225') We are sending mail with results at report@fotonower.com args[1361085162] : ((1361085162, -6.413577460628393, 492609224), (1361085162, 0.9599164586749129, 2107752395), '0.0907608212234225') We are sending mail with results at report@fotonower.com args[1361085157] : ((1361085157, -6.592945320227999, 492609224), (1361085157, 0.8711311404627441, 2107752395), '0.0907608212234225') We are sending mail with results at report@fotonower.com args[1361085154] : ((1361085154, -6.111129768635298, 492609224), (1361085154, 1.0570908087639328, 2107752395), '0.0907608212234225') We are sending mail with results at report@fotonower.com args[1361085131] : ((1361085131, -6.33984579770554, 492609224), (1361085131, 1.0980194843471487, 2107752395), '0.0907608212234225') We are sending mail with results at report@fotonower.com args[1361085128] : ((1361085128, -6.385422900491384, 492609224), (1361085128, 1.8013816381898962, 2107752395), '0.0907608212234225') We are sending mail with results at report@fotonower.com args[1361085124] : ((1361085124, -6.643945412766225, 492609224), (1361085124, 1.1841955676338167, 2107752395), '0.0907608212234225') We are sending mail with results at report@fotonower.com args[1361085111] : ((1361085111, -6.640341944307399, 492609224), (1361085111, 1.1732179944953254, 2107752395), '0.0907608212234225') We are sending mail with results at report@fotonower.com refus_total : 0.0907608212234225 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23342745 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23342745_26-05-2025_17_46_51.pdf results_Auto_P23342745_26-05-2025_17_46_51.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23342745_26-05-2025_17_46_51.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23342745','results_Auto_P23342745_26-05-2025_17_46_51.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23342745_26-05-2025_17_46_51.pdf','pdf','','0.62','0.0907608212234225') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23342745

https://www.fotonower.com/image?json=false&list_photos_id=1361085169
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361085165
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361085162
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361085157
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361085154
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361085131
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361085128
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361085124
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361085111
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 9.08%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/23349686?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23349689?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23349690?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23349693?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23349694?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23342745_26-05-2025_17_46_51.pdf.

Lien vers velours :https://www.fotonower.com/velours/23349685,23349686,23349687,23349688,23349689,23349690,23349691,23349692,23349693,23349694,23349695?tags=pehd,pet_clair,background,environnement,carton,papier,mal_croppe,flou,autre,pet_fonce,metal.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 26 May 2025 15:46:59 GMT Content-Length: 0 Connection: close X-Message-Id: fC-NMpS4Q9Ca7hnpeofM6Q Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1361085169, 1361085165, 1361085162, 1361085157, 1361085154, 1361085131, 1361085128, 1361085124, 1361085111] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085169', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085165', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085162', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085157', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085154', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085131', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085128', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085124', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085111', None, None, None, None, None, '2955250') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014573812484741211 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.720430374145508 time spend to save output : 0.4406440258026123 total time spend for step 9 : 9.16107439994812 step10:split_time_score Mon May 26 17:47:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('15', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 26052025 23342745 Nombre de photos uploadées : 9 / 23040 (0%) 26052025 23342745 Nombre de photos taguées (types de déchets): 0 / 9 (0%) 26052025 23342745 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.0003948211669921875 elapsed_time : insert_dashboard_record_day_entry 0.02900242805480957 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.10042625385802464 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23344668 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23344668 AND mptpi.`type`=3594 To do Qualite : 0.10631123107156629 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23331064_26-05-2025_13_10_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23331064 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23331064 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23331066 order by id desc limit 1 Qualite : 0.09622099389524323 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23331105_26-05-2025_15_13_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23331105 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23331105 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23328666 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23328671 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339058 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339060 order by id desc limit 1 Qualite : 0.10856602044753087 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23339062_26-05-2025_15_34_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339062 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23339062 AND mptpi.`type`=3594 To do Qualite : 0.12075810185185182 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23339075_26-05-2025_15_29_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339075 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23339075 AND mptpi.`type`=3594 To do Qualite : 0.11833079346707819 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23339078_26-05-2025_15_20_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339078 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23339078 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339082 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339099 order by id desc limit 1 Qualite : 0.1057252148705418 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23342743_26-05-2025_16_36_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23342743 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23342743 AND mptpi.`type`=3594 To do Qualite : 0.0907608212234225 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23342745_26-05-2025_17_46_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23342745 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23342745 AND mptpi.`type`=3594 To do Qualite : 0.11492990451388885 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23342759_26-05-2025_16_32_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23342759 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23342759 AND mptpi.`type`=3594 To do Qualite : 0.19915349847822353 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23344670_26-05-2025_17_19_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23344670 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23344670 AND mptpi.`type`=3594 To do Qualite : 0.11846868333560273 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23344672_26-05-2025_17_11_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23344672 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23344672 AND mptpi.`type`=3594 To do Qualite : 0.1291854573137125 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23344698_26-05-2025_16_54_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23344698 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23344698 AND mptpi.`type`=3594 To do Qualite : 0.10039044013631691 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23344701_26-05-2025_16_50_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23344701 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23344701 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'26052025': {'nb_upload': 9, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1361085169, 1361085165, 1361085162, 1361085157, 1361085154, 1361085131, 1361085128, 1361085124, 1361085111] Looping around the photos to save general results len do output : 1 /23342745Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085169', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085165', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085162', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085157', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085154', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085131', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085128', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085124', None, None, None, None, None, '2955250') ('3318', None, None, None, None, None, None, None, '2955250') ('3318', '23342745', '1361085111', None, None, None, None, None, '2955250') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.013055801391601562 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.045303583145142 time spend to save output : 0.013383150100708008 total time spend for step 10 : 8.05868673324585 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 159.68user 173.18system 6:42.49elapsed 82%CPU (0avgtext+0avgdata 3951248maxresident)k 3207632inputs+117112outputs (47690major+15444145minor)pagefaults 0swaps