python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2179815 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2969279'] with mtr_portfolio_ids : ['23391455'] and first list_photo_ids : [] new path : /proc/2179815/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 0.9449582099914551 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue May 27 21:10:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-27 21:10:32.891613: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-27 21:10:32.919249: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-27 21:10:32.921370: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f227c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-27 21:10:32.921433: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-27 21:10:32.925608: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-27 21:10:33.254992: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x21b76110 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-27 21:10:33.255094: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-27 21:10:33.257017: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 21:10:33.257627: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 21:10:33.264306: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 21:10:33.266807: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 21:10:33.267380: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 21:10:33.270991: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 21:10:33.272586: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 21:10:33.279173: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 21:10:33.281188: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 21:10:33.281301: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 21:10:33.282323: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-27 21:10:33.282346: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-27 21:10:33.282360: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-27 21:10:33.284374: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-27 21:10:33.591871: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 21:10:33.591958: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 21:10:33.591979: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 21:10:33.591998: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 21:10:33.592016: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 21:10:33.592034: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 21:10:33.592051: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 21:10:33.592069: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 21:10:33.593657: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 21:10:33.594977: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 21:10:33.595020: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 21:10:33.595039: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 21:10:33.595056: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 21:10:33.595073: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 21:10:33.595090: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 21:10:33.595107: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 21:10:33.595124: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 21:10:33.596716: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 21:10:33.596748: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-27 21:10:33.596759: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-27 21:10:33.596768: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-27 21:10:33.598570: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-27 21:10:46.450712: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 21:10:46.654340: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 51 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 58 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 60 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 Detection mask done ! Trying to reset tf kernel 2180496 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1929 tf kernel not reseted sub process len(results) : 5 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 5 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10998 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.002596616744995117 nb_pixel_total : 80234 time to create 1 rle with old method : 0.11469817161560059 length of segment : 433 time for calcul the mask position with numpy : 0.0007951259613037109 nb_pixel_total : 30878 time to create 1 rle with old method : 0.0366973876953125 length of segment : 409 time for calcul the mask position with numpy : 0.0004010200500488281 nb_pixel_total : 23341 time to create 1 rle with old method : 0.028130054473876953 length of segment : 221 time for calcul the mask position with numpy : 0.0033512115478515625 nb_pixel_total : 100607 time to create 1 rle with old method : 0.12968921661376953 length of segment : 566 time for calcul the mask position with numpy : 0.0009427070617675781 nb_pixel_total : 44045 time to create 1 rle with old method : 0.05516695976257324 length of segment : 517 time for calcul the mask position with numpy : 0.00030422210693359375 nb_pixel_total : 15999 time to create 1 rle with old method : 0.019359350204467773 length of segment : 170 time for calcul the mask position with numpy : 0.00037360191345214844 nb_pixel_total : 18458 time to create 1 rle with old method : 0.021980762481689453 length of segment : 123 time for calcul the mask position with numpy : 0.00043129920959472656 nb_pixel_total : 24936 time to create 1 rle with old method : 0.029812097549438477 length of segment : 196 time for calcul the mask position with numpy : 0.0015294551849365234 nb_pixel_total : 87037 time to create 1 rle with old method : 0.10485172271728516 length of segment : 538 time for calcul the mask position with numpy : 0.0005824565887451172 nb_pixel_total : 19438 time to create 1 rle with old method : 0.025845050811767578 length of segment : 443 time for calcul the mask position with numpy : 0.0007576942443847656 nb_pixel_total : 36183 time to create 1 rle with old method : 0.0731804370880127 length of segment : 258 time for calcul the mask position with numpy : 0.00030493736267089844 nb_pixel_total : 6699 time to create 1 rle with old method : 0.011267900466918945 length of segment : 107 time for calcul the mask position with numpy : 0.00031828880310058594 nb_pixel_total : 13308 time to create 1 rle with old method : 0.022701501846313477 length of segment : 78 time for calcul the mask position with numpy : 0.0010592937469482422 nb_pixel_total : 61668 time to create 1 rle with old method : 0.08910012245178223 length of segment : 276 time for calcul the mask position with numpy : 0.0015633106231689453 nb_pixel_total : 68832 time to create 1 rle with old method : 0.08101844787597656 length of segment : 455 time for calcul the mask position with numpy : 0.0014126300811767578 nb_pixel_total : 29838 time to create 1 rle with old method : 0.03541398048400879 length of segment : 338 time for calcul the mask position with numpy : 0.0003006458282470703 nb_pixel_total : 12542 time to create 1 rle with old method : 0.01522374153137207 length of segment : 135 time for calcul the mask position with numpy : 0.0012052059173583984 nb_pixel_total : 50071 time to create 1 rle with old method : 0.05980515480041504 length of segment : 250 time for calcul the mask position with numpy : 0.0004875659942626953 nb_pixel_total : 15008 time to create 1 rle with old method : 0.04007244110107422 length of segment : 142 time for calcul the mask position with numpy : 0.0007884502410888672 nb_pixel_total : 44066 time to create 1 rle with old method : 0.05370831489562988 length of segment : 227 time for calcul the mask position with numpy : 0.005889892578125 nb_pixel_total : 220717 time to create 1 rle with new method : 0.0181884765625 length of segment : 643 time for calcul the mask position with numpy : 0.0004787445068359375 nb_pixel_total : 22037 time to create 1 rle with old method : 0.02600240707397461 length of segment : 210 time for calcul the mask position with numpy : 0.0001785755157470703 nb_pixel_total : 8361 time to create 1 rle with old method : 0.009816646575927734 length of segment : 106 time for calcul the mask position with numpy : 0.025536298751831055 nb_pixel_total : 463071 time to create 1 rle with new method : 0.45145106315612793 length of segment : 1876 time for calcul the mask position with numpy : 0.0021157264709472656 nb_pixel_total : 97841 time to create 1 rle with old method : 0.11296916007995605 length of segment : 478 time for calcul the mask position with numpy : 0.000255584716796875 nb_pixel_total : 10146 time to create 1 rle with old method : 0.011788606643676758 length of segment : 92 time for calcul the mask position with numpy : 0.0006968975067138672 nb_pixel_total : 38066 time to create 1 rle with old method : 0.044277191162109375 length of segment : 306 time for calcul the mask position with numpy : 0.00084686279296875 nb_pixel_total : 47563 time to create 1 rle with old method : 0.055924177169799805 length of segment : 168 time for calcul the mask position with numpy : 0.001947164535522461 nb_pixel_total : 99008 time to create 1 rle with old method : 0.11576485633850098 length of segment : 341 time for calcul the mask position with numpy : 0.0005087852478027344 nb_pixel_total : 11252 time to create 1 rle with old method : 0.019124269485473633 length of segment : 170 time for calcul the mask position with numpy : 0.0006031990051269531 nb_pixel_total : 14850 time to create 1 rle with old method : 0.02524566650390625 length of segment : 160 time for calcul the mask position with numpy : 0.0007236003875732422 nb_pixel_total : 13943 time to create 1 rle with old method : 0.017140865325927734 length of segment : 382 time for calcul the mask position with numpy : 0.000415802001953125 nb_pixel_total : 15507 time to create 1 rle with old method : 0.020068883895874023 length of segment : 198 time for calcul the mask position with numpy : 0.0011208057403564453 nb_pixel_total : 46723 time to create 1 rle with old method : 0.06373929977416992 length of segment : 168 time for calcul the mask position with numpy : 0.0024814605712890625 nb_pixel_total : 68376 time to create 1 rle with old method : 0.11314654350280762 length of segment : 770 time for calcul the mask position with numpy : 0.0007474422454833984 nb_pixel_total : 29386 time to create 1 rle with old method : 0.03486323356628418 length of segment : 327 time for calcul the mask position with numpy : 0.0043795108795166016 nb_pixel_total : 280100 time to create 1 rle with new method : 0.01583123207092285 length of segment : 926 time for calcul the mask position with numpy : 0.006242513656616211 nb_pixel_total : 49727 time to create 1 rle with old method : 0.08040070533752441 length of segment : 613 time for calcul the mask position with numpy : 0.0014357566833496094 nb_pixel_total : 39556 time to create 1 rle with old method : 0.04799509048461914 length of segment : 292 time for calcul the mask position with numpy : 0.001322031021118164 nb_pixel_total : 65807 time to create 1 rle with old method : 0.07845425605773926 length of segment : 337 time for calcul the mask position with numpy : 0.00033926963806152344 nb_pixel_total : 12950 time to create 1 rle with old method : 0.015789508819580078 length of segment : 211 time for calcul the mask position with numpy : 0.0019404888153076172 nb_pixel_total : 68925 time to create 1 rle with old method : 0.08196067810058594 length of segment : 398 time for calcul the mask position with numpy : 0.00021266937255859375 nb_pixel_total : 7850 time to create 1 rle with old method : 0.009597063064575195 length of segment : 102 time for calcul the mask position with numpy : 0.0006103515625 nb_pixel_total : 27512 time to create 1 rle with old method : 0.033345937728881836 length of segment : 271 time for calcul the mask position with numpy : 0.0017170906066894531 nb_pixel_total : 74824 time to create 1 rle with old method : 0.08965706825256348 length of segment : 442 time for calcul the mask position with numpy : 0.0002155303955078125 nb_pixel_total : 5379 time to create 1 rle with old method : 0.006755828857421875 length of segment : 101 time for calcul the mask position with numpy : 0.0007002353668212891 nb_pixel_total : 31335 time to create 1 rle with old method : 0.03792595863342285 length of segment : 202 time for calcul the mask position with numpy : 0.0018422603607177734 nb_pixel_total : 63233 time to create 1 rle with old method : 0.07564067840576172 length of segment : 357 time for calcul the mask position with numpy : 0.0012743473052978516 nb_pixel_total : 51447 time to create 1 rle with old method : 0.06176877021789551 length of segment : 269 time for calcul the mask position with numpy : 0.0013620853424072266 nb_pixel_total : 75158 time to create 1 rle with old method : 0.08834528923034668 length of segment : 325 time for calcul the mask position with numpy : 0.0004410743713378906 nb_pixel_total : 15545 time to create 1 rle with old method : 0.0190274715423584 length of segment : 188 time for calcul the mask position with numpy : 0.0004131793975830078 nb_pixel_total : 16217 time to create 1 rle with old method : 0.020102500915527344 length of segment : 161 time for calcul the mask position with numpy : 0.000904083251953125 nb_pixel_total : 37647 time to create 1 rle with old method : 0.06611847877502441 length of segment : 257 time for calcul the mask position with numpy : 0.0012607574462890625 nb_pixel_total : 50527 time to create 1 rle with old method : 0.0628209114074707 length of segment : 263 time for calcul the mask position with numpy : 0.0002923011779785156 nb_pixel_total : 13460 time to create 1 rle with old method : 0.0165860652923584 length of segment : 134 time for calcul the mask position with numpy : 0.00022482872009277344 nb_pixel_total : 8876 time to create 1 rle with old method : 0.010981082916259766 length of segment : 122 time for calcul the mask position with numpy : 0.0003459453582763672 nb_pixel_total : 11189 time to create 1 rle with old method : 0.013832569122314453 length of segment : 173 time for calcul the mask position with numpy : 0.000989675521850586 nb_pixel_total : 40902 time to create 1 rle with old method : 0.048566341400146484 length of segment : 250 time for calcul the mask position with numpy : 0.0005693435668945312 nb_pixel_total : 14663 time to create 1 rle with old method : 0.017960786819458008 length of segment : 241 time for calcul the mask position with numpy : 0.0014467239379882812 nb_pixel_total : 46419 time to create 1 rle with old method : 0.05829048156738281 length of segment : 405 time for calcul the mask position with numpy : 0.002437591552734375 nb_pixel_total : 103157 time to create 1 rle with old method : 0.12201762199401855 length of segment : 395 time for calcul the mask position with numpy : 0.0040514469146728516 nb_pixel_total : 221382 time to create 1 rle with new method : 0.012488126754760742 length of segment : 582 time for calcul the mask position with numpy : 0.0006959438323974609 nb_pixel_total : 30257 time to create 1 rle with old method : 0.03846549987792969 length of segment : 245 time for calcul the mask position with numpy : 0.0004372596740722656 nb_pixel_total : 16596 time to create 1 rle with old method : 0.021414518356323242 length of segment : 174 time for calcul the mask position with numpy : 0.014983892440795898 nb_pixel_total : 624184 time to create 1 rle with new method : 0.08495473861694336 length of segment : 1553 time for calcul the mask position with numpy : 0.0003635883331298828 nb_pixel_total : 16379 time to create 1 rle with old method : 0.020320892333984375 length of segment : 121 time for calcul the mask position with numpy : 0.0005078315734863281 nb_pixel_total : 24811 time to create 1 rle with old method : 0.04388022422790527 length of segment : 193 time for calcul the mask position with numpy : 0.0012421607971191406 nb_pixel_total : 42128 time to create 1 rle with old method : 0.051100969314575195 length of segment : 228 time for calcul the mask position with numpy : 0.0010929107666015625 nb_pixel_total : 57474 time to create 1 rle with old method : 0.06932234764099121 length of segment : 260 time for calcul the mask position with numpy : 0.002265453338623047 nb_pixel_total : 124354 time to create 1 rle with old method : 0.16810011863708496 length of segment : 426 time for calcul the mask position with numpy : 0.0004458427429199219 nb_pixel_total : 17380 time to create 1 rle with old method : 0.020473003387451172 length of segment : 227 time for calcul the mask position with numpy : 0.001840829849243164 nb_pixel_total : 103899 time to create 1 rle with old method : 0.11837339401245117 length of segment : 545 time for calcul the mask position with numpy : 0.0011143684387207031 nb_pixel_total : 65432 time to create 1 rle with old method : 0.07508182525634766 length of segment : 170 time for calcul the mask position with numpy : 0.00035452842712402344 nb_pixel_total : 21914 time to create 1 rle with old method : 0.0253450870513916 length of segment : 200 time for calcul the mask position with numpy : 0.003390789031982422 nb_pixel_total : 154157 time to create 1 rle with new method : 0.010587215423583984 length of segment : 464 time for calcul the mask position with numpy : 0.0006875991821289062 nb_pixel_total : 22413 time to create 1 rle with old method : 0.025550127029418945 length of segment : 220 time for calcul the mask position with numpy : 0.0008716583251953125 nb_pixel_total : 44953 time to create 1 rle with old method : 0.05280733108520508 length of segment : 274 time for calcul the mask position with numpy : 0.0008368492126464844 nb_pixel_total : 37728 time to create 1 rle with old method : 0.045418739318847656 length of segment : 364 time for calcul the mask position with numpy : 0.0010831356048583984 nb_pixel_total : 34491 time to create 1 rle with old method : 0.042523860931396484 length of segment : 276 time for calcul the mask position with numpy : 0.0012586116790771484 nb_pixel_total : 23348 time to create 1 rle with old method : 0.0280153751373291 length of segment : 173 time for calcul the mask position with numpy : 0.004574298858642578 nb_pixel_total : 178466 time to create 1 rle with new method : 0.013521432876586914 length of segment : 667 time for calcul the mask position with numpy : 0.0005922317504882812 nb_pixel_total : 23308 time to create 1 rle with old method : 0.027884721755981445 length of segment : 153 time for calcul the mask position with numpy : 0.002054929733276367 nb_pixel_total : 88725 time to create 1 rle with old method : 0.10581040382385254 length of segment : 659 time for calcul the mask position with numpy : 0.004776716232299805 nb_pixel_total : 64846 time to create 1 rle with old method : 0.07542276382446289 length of segment : 551 time for calcul the mask position with numpy : 0.0017843246459960938 nb_pixel_total : 11703 time to create 1 rle with old method : 0.013896465301513672 length of segment : 259 time for calcul the mask position with numpy : 0.0017261505126953125 nb_pixel_total : 40821 time to create 1 rle with old method : 0.04704594612121582 length of segment : 175 time for calcul the mask position with numpy : 0.0007910728454589844 nb_pixel_total : 29838 time to create 1 rle with old method : 0.035552978515625 length of segment : 217 time for calcul the mask position with numpy : 0.0014290809631347656 nb_pixel_total : 23250 time to create 1 rle with old method : 0.02756357192993164 length of segment : 272 time for calcul the mask position with numpy : 0.0005578994750976562 nb_pixel_total : 11129 time to create 1 rle with old method : 0.013390779495239258 length of segment : 124 time for calcul the mask position with numpy : 0.0006725788116455078 nb_pixel_total : 28857 time to create 1 rle with old method : 0.03360581398010254 length of segment : 192 time for calcul the mask position with numpy : 0.0005779266357421875 nb_pixel_total : 26917 time to create 1 rle with old method : 0.0306246280670166 length of segment : 273 time for calcul the mask position with numpy : 0.002048492431640625 nb_pixel_total : 30050 time to create 1 rle with old method : 0.03350949287414551 length of segment : 278 time for calcul the mask position with numpy : 0.0011289119720458984 nb_pixel_total : 37796 time to create 1 rle with old method : 0.0483088493347168 length of segment : 474 time for calcul the mask position with numpy : 0.002579212188720703 nb_pixel_total : 51339 time to create 1 rle with old method : 0.0596160888671875 length of segment : 330 time for calcul the mask position with numpy : 0.003041982650756836 nb_pixel_total : 49374 time to create 1 rle with old method : 0.059008121490478516 length of segment : 380 time for calcul the mask position with numpy : 0.0010578632354736328 nb_pixel_total : 23331 time to create 1 rle with old method : 0.02704000473022461 length of segment : 238 time for calcul the mask position with numpy : 0.0009434223175048828 nb_pixel_total : 17441 time to create 1 rle with old method : 0.020684480667114258 length of segment : 138 time for calcul the mask position with numpy : 0.0010552406311035156 nb_pixel_total : 40544 time to create 1 rle with old method : 0.04664468765258789 length of segment : 276 time for calcul the mask position with numpy : 0.0010421276092529297 nb_pixel_total : 23095 time to create 1 rle with old method : 0.027019500732421875 length of segment : 206 time for calcul the mask position with numpy : 0.0021533966064453125 nb_pixel_total : 31683 time to create 1 rle with old method : 0.03747081756591797 length of segment : 263 time for calcul the mask position with numpy : 0.0005712509155273438 nb_pixel_total : 8354 time to create 1 rle with old method : 0.009768486022949219 length of segment : 107 time for calcul the mask position with numpy : 0.001435995101928711 nb_pixel_total : 23609 time to create 1 rle with old method : 0.02711963653564453 length of segment : 266 time for calcul the mask position with numpy : 0.0004124641418457031 nb_pixel_total : 13109 time to create 1 rle with old method : 0.015186548233032227 length of segment : 173 time for calcul the mask position with numpy : 0.002376556396484375 nb_pixel_total : 28101 time to create 1 rle with old method : 0.031893014907836914 length of segment : 265 time for calcul the mask position with numpy : 0.0004899501800537109 nb_pixel_total : 8038 time to create 1 rle with old method : 0.009158849716186523 length of segment : 278 time for calcul the mask position with numpy : 0.0006039142608642578 nb_pixel_total : 17066 time to create 1 rle with old method : 0.02034926414489746 length of segment : 159 time for calcul the mask position with numpy : 0.0001804828643798828 nb_pixel_total : 4253 time to create 1 rle with old method : 0.005095958709716797 length of segment : 54 time for calcul the mask position with numpy : 0.001010894775390625 nb_pixel_total : 12671 time to create 1 rle with old method : 0.01483917236328125 length of segment : 139 time for calcul the mask position with numpy : 0.002972126007080078 nb_pixel_total : 57259 time to create 1 rle with old method : 0.0644683837890625 length of segment : 429 time for calcul the mask position with numpy : 0.0017442703247070312 nb_pixel_total : 36641 time to create 1 rle with old method : 0.0410463809967041 length of segment : 320 time for calcul the mask position with numpy : 0.0010058879852294922 nb_pixel_total : 24026 time to create 1 rle with old method : 0.02765798568725586 length of segment : 221 time for calcul the mask position with numpy : 0.0032634735107421875 nb_pixel_total : 38298 time to create 1 rle with old method : 0.04465770721435547 length of segment : 357 time for calcul the mask position with numpy : 0.0018799304962158203 nb_pixel_total : 37188 time to create 1 rle with old method : 0.040992021560668945 length of segment : 301 time for calcul the mask position with numpy : 0.0019919872283935547 nb_pixel_total : 42167 time to create 1 rle with old method : 0.0480189323425293 length of segment : 280 time for calcul the mask position with numpy : 0.0005834102630615234 nb_pixel_total : 13253 time to create 1 rle with old method : 0.015644073486328125 length of segment : 175 time for calcul the mask position with numpy : 0.002577543258666992 nb_pixel_total : 54098 time to create 1 rle with old method : 0.06103253364562988 length of segment : 309 time for calcul the mask position with numpy : 0.0033609867095947266 nb_pixel_total : 80282 time to create 1 rle with old method : 0.08844661712646484 length of segment : 228 time for calcul the mask position with numpy : 0.004319667816162109 nb_pixel_total : 95977 time to create 1 rle with old method : 0.1070711612701416 length of segment : 771 time for calcul the mask position with numpy : 0.00167083740234375 nb_pixel_total : 26614 time to create 1 rle with old method : 0.03621673583984375 length of segment : 333 time for calcul the mask position with numpy : 0.0002720355987548828 nb_pixel_total : 12338 time to create 1 rle with old method : 0.01642441749572754 length of segment : 106 time for calcul the mask position with numpy : 0.0004317760467529297 nb_pixel_total : 27882 time to create 1 rle with old method : 0.034226179122924805 length of segment : 195 time for calcul the mask position with numpy : 0.003351926803588867 nb_pixel_total : 188429 time to create 1 rle with new method : 0.010293960571289062 length of segment : 575 time for calcul the mask position with numpy : 0.0006501674652099609 nb_pixel_total : 49283 time to create 1 rle with old method : 0.05684781074523926 length of segment : 193 time for calcul the mask position with numpy : 0.0006558895111083984 nb_pixel_total : 41874 time to create 1 rle with old method : 0.04705548286437988 length of segment : 389 time for calcul the mask position with numpy : 0.00018858909606933594 nb_pixel_total : 9320 time to create 1 rle with old method : 0.010996103286743164 length of segment : 153 time for calcul the mask position with numpy : 0.00015878677368164062 nb_pixel_total : 7901 time to create 1 rle with old method : 0.009330272674560547 length of segment : 154 time for calcul the mask position with numpy : 0.0011067390441894531 nb_pixel_total : 62247 time to create 1 rle with old method : 0.07129287719726562 length of segment : 422 time for calcul the mask position with numpy : 0.0008945465087890625 nb_pixel_total : 21617 time to create 1 rle with old method : 0.024385929107666016 length of segment : 344 time for calcul the mask position with numpy : 0.00044798851013183594 nb_pixel_total : 23595 time to create 1 rle with old method : 0.027103900909423828 length of segment : 219 time for calcul the mask position with numpy : 0.0005326271057128906 nb_pixel_total : 30104 time to create 1 rle with old method : 0.034217119216918945 length of segment : 198 time for calcul the mask position with numpy : 0.0014400482177734375 nb_pixel_total : 78190 time to create 1 rle with old method : 0.1062612533569336 length of segment : 483 time for calcul the mask position with numpy : 0.00153350830078125 nb_pixel_total : 104104 time to create 1 rle with old method : 0.11755728721618652 length of segment : 405 time for calcul the mask position with numpy : 0.0007915496826171875 nb_pixel_total : 38318 time to create 1 rle with old method : 0.04344797134399414 length of segment : 341 time spent for convertir_results : 13.160436153411865 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 133 chid ids of type : 3594 Number RLEs to save : 41874 save missing photos in datou_result : time spend for datou_step_exec : 68.7481746673584 time spend to save output : 2.726203680038452 total time spend for step 1 : 71.47437834739685 step2:crop_condition Tue May 27 21:11:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 133 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 104 About to insert : list_path_to_insert length 104 new photo from crops ! About to upload 104 photos upload in portfolio : 3736932 init cache_photo without model_param we have 104 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748373127_2179815 we have uploaded 104 photos in the portfolio 3736932 time of upload the photos Elapsed time : 26.30221176147461 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 18 About to insert : list_path_to_insert length 18 new photo from crops ! About to upload 18 photos upload in portfolio : 3736932 init cache_photo without model_param we have 18 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748373158_2179815 we have uploaded 18 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.654391527175903 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748373165_2179815 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8022410869598389 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748373171_2179815 we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.0890913009643555 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748373174_2179815 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7694826126098633 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1361377575, 1361377572, 1361377567, 1361377563, 1361377558] Looping around the photos to save general results len do output : 133 /1361384267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361384425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377575', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377572', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377567', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377563', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377558', None, None, None, None, None, '2969279') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 404 time used for this insertion : 0.03247261047363281 save_final save missing photos in datou_result : time spend for datou_step_exec : 73.77590560913086 time spend to save output : 0.03709554672241211 total time spend for step 2 : 73.81300115585327 step3:rle_unique_nms_with_priority Tue May 27 21:12:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 133 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 6.184385061264038 time for calcul the mask position with numpy : 0.8182098865509033 nb_pixel_total : 7823604 time to create 1 rle with new method : 0.8503141403198242 time for calcul the mask position with numpy : 0.0393061637878418 nb_pixel_total : 8107 time to create 1 rle with old method : 0.009521245956420898 time for calcul the mask position with numpy : 0.024463891983032227 nb_pixel_total : 13308 time to create 1 rle with old method : 0.01536250114440918 time for calcul the mask position with numpy : 0.023493051528930664 nb_pixel_total : 6699 time to create 1 rle with old method : 0.007874011993408203 time for calcul the mask position with numpy : 0.02397918701171875 nb_pixel_total : 7205 time to create 1 rle with old method : 0.008445024490356445 time for calcul the mask position with numpy : 0.02463245391845703 nb_pixel_total : 19438 time to create 1 rle with old method : 0.02212691307067871 time for calcul the mask position with numpy : 0.024904966354370117 nb_pixel_total : 87037 time to create 1 rle with old method : 0.10068535804748535 time for calcul the mask position with numpy : 0.024614810943603516 nb_pixel_total : 24936 time to create 1 rle with old method : 0.02920699119567871 time for calcul the mask position with numpy : 0.024166107177734375 nb_pixel_total : 18458 time to create 1 rle with old method : 0.021483898162841797 time for calcul the mask position with numpy : 0.025699615478515625 nb_pixel_total : 6503 time to create 1 rle with old method : 0.007443904876708984 time for calcul the mask position with numpy : 0.025737762451171875 nb_pixel_total : 44045 time to create 1 rle with old method : 0.0500795841217041 time for calcul the mask position with numpy : 0.02654862403869629 nb_pixel_total : 100607 time to create 1 rle with old method : 0.11469483375549316 time for calcul the mask position with numpy : 0.02646017074584961 nb_pixel_total : 23341 time to create 1 rle with old method : 0.027054786682128906 time for calcul the mask position with numpy : 0.02692389488220215 nb_pixel_total : 30878 time to create 1 rle with old method : 0.03593754768371582 time for calcul the mask position with numpy : 0.02641916275024414 nb_pixel_total : 80234 time to create 1 rle with old method : 0.09255576133728027 create new chi : 2.616224527359009 time to delete rle : 0.02185535430908203 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 10222 TO DO : save crop sub photo not yet done ! save time : 0.6482441425323486 nb_obj : 26 nb_hashtags : 3 time to prepare the origin masks : 5.087759494781494 time for calcul the mask position with numpy : 0.3646411895751953 nb_pixel_total : 6499098 time to create 1 rle with new method : 0.9339914321899414 time for calcul the mask position with numpy : 0.03349757194519043 nb_pixel_total : 14850 time to create 1 rle with old method : 0.017170190811157227 time for calcul the mask position with numpy : 0.03337359428405762 nb_pixel_total : 15507 time to create 1 rle with old method : 0.017369508743286133 time for calcul the mask position with numpy : 0.033078908920288086 nb_pixel_total : 29838 time to create 1 rle with old method : 0.03392291069030762 time for calcul the mask position with numpy : 0.03495359420776367 nb_pixel_total : 68832 time to create 1 rle with old method : 0.07961082458496094 time for calcul the mask position with numpy : 0.03302645683288574 nb_pixel_total : 50071 time to create 1 rle with old method : 0.05642509460449219 time for calcul the mask position with numpy : 0.032671451568603516 nb_pixel_total : 46723 time to create 1 rle with old method : 0.0680699348449707 time for calcul the mask position with numpy : 0.038018226623535156 nb_pixel_total : 8994 time to create 1 rle with old method : 0.010137319564819336 time for calcul the mask position with numpy : 0.03385615348815918 nb_pixel_total : 47563 time to create 1 rle with old method : 0.07579398155212402 time for calcul the mask position with numpy : 0.034087419509887695 nb_pixel_total : 10146 time to create 1 rle with old method : 0.011619091033935547 time for calcul the mask position with numpy : 0.032089948654174805 nb_pixel_total : 29386 time to create 1 rle with old method : 0.03250741958618164 time for calcul the mask position with numpy : 0.03178143501281738 nb_pixel_total : 21587 time to create 1 rle with old method : 0.02378249168395996 time for calcul the mask position with numpy : 0.03586244583129883 nb_pixel_total : 463071 time to create 1 rle with new method : 0.7073307037353516 time for calcul the mask position with numpy : 0.033219337463378906 nb_pixel_total : 11252 time to create 1 rle with old method : 0.012505769729614258 time for calcul the mask position with numpy : 0.03325176239013672 nb_pixel_total : 39556 time to create 1 rle with old method : 0.048789262771606445 time for calcul the mask position with numpy : 0.0358738899230957 nb_pixel_total : 220717 time to create 1 rle with new method : 0.7755749225616455 time for calcul the mask position with numpy : 0.0327763557434082 nb_pixel_total : 27290 time to create 1 rle with old method : 0.031063318252563477 time for calcul the mask position with numpy : 0.033623695373535156 nb_pixel_total : 97841 time to create 1 rle with old method : 0.10976362228393555 time for calcul the mask position with numpy : 0.03291440010070801 nb_pixel_total : 42731 time to create 1 rle with old method : 0.04865264892578125 time for calcul the mask position with numpy : 0.032251596450805664 nb_pixel_total : 68376 time to create 1 rle with old method : 0.07753682136535645 time for calcul the mask position with numpy : 0.034353017807006836 nb_pixel_total : 280100 time to create 1 rle with new method : 0.7363958358764648 time for calcul the mask position with numpy : 0.03381705284118652 nb_pixel_total : 8322 time to create 1 rle with old method : 0.0096893310546875 time for calcul the mask position with numpy : 0.034543752670288086 nb_pixel_total : 99008 time to create 1 rle with old method : 0.11451172828674316 time for calcul the mask position with numpy : 0.03295612335205078 nb_pixel_total : 22037 time to create 1 rle with old method : 0.024408578872680664 time for calcul the mask position with numpy : 0.03278946876525879 nb_pixel_total : 44066 time to create 1 rle with old method : 0.052275657653808594 time for calcul the mask position with numpy : 0.0341494083404541 nb_pixel_total : 14896 time to create 1 rle with old method : 0.016905784606933594 time for calcul the mask position with numpy : 0.03307747840881348 nb_pixel_total : 12542 time to create 1 rle with old method : 0.014456987380981445 create new chi : 5.503026247024536 time to delete rle : 0.0025463104248046875 batch 1 Loaded 53 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 21201 TO DO : save crop sub photo not yet done ! save time : 1.30759596824646 nb_obj : 37 nb_hashtags : 4 time to prepare the origin masks : 5.220463514328003 time for calcul the mask position with numpy : 0.5722873210906982 nb_pixel_total : 6024183 time to create 1 rle with new method : 0.8434319496154785 time for calcul the mask position with numpy : 0.03391385078430176 nb_pixel_total : 154157 time to create 1 rle with new method : 0.819941520690918 time for calcul the mask position with numpy : 0.0340268611907959 nb_pixel_total : 37647 time to create 1 rle with old method : 0.043005943298339844 time for calcul the mask position with numpy : 0.03714275360107422 nb_pixel_total : 11189 time to create 1 rle with old method : 0.012951135635375977 time for calcul the mask position with numpy : 0.03418874740600586 nb_pixel_total : 68925 time to create 1 rle with old method : 0.08805060386657715 time for calcul the mask position with numpy : 0.03737139701843262 nb_pixel_total : 63233 time to create 1 rle with old method : 0.08874344825744629 time for calcul the mask position with numpy : 0.03425455093383789 nb_pixel_total : 1941 time to create 1 rle with old method : 0.0023679733276367188 time for calcul the mask position with numpy : 0.03435564041137695 nb_pixel_total : 27512 time to create 1 rle with old method : 0.03213977813720703 time for calcul the mask position with numpy : 0.03427004814147949 nb_pixel_total : 31335 time to create 1 rle with old method : 0.0363461971282959 time for calcul the mask position with numpy : 0.03451037406921387 nb_pixel_total : 124354 time to create 1 rle with old method : 0.14493680000305176 time for calcul the mask position with numpy : 0.03438687324523926 nb_pixel_total : 22413 time to create 1 rle with old method : 0.026313304901123047 time for calcul the mask position with numpy : 0.035041093826293945 nb_pixel_total : 51447 time to create 1 rle with old method : 0.07306671142578125 time for calcul the mask position with numpy : 0.034659624099731445 nb_pixel_total : 17380 time to create 1 rle with old method : 0.0204160213470459 time for calcul the mask position with numpy : 0.034525156021118164 nb_pixel_total : 16596 time to create 1 rle with old method : 0.01927018165588379 time for calcul the mask position with numpy : 0.03436756134033203 nb_pixel_total : 40902 time to create 1 rle with old method : 0.047582387924194336 time for calcul the mask position with numpy : 0.03419780731201172 nb_pixel_total : 12950 time to create 1 rle with old method : 0.015113115310668945 time for calcul the mask position with numpy : 0.0345001220703125 nb_pixel_total : 75158 time to create 1 rle with old method : 0.08624649047851562 time for calcul the mask position with numpy : 0.034543514251708984 nb_pixel_total : 103899 time to create 1 rle with old method : 0.11577200889587402 time for calcul the mask position with numpy : 0.03284907341003418 nb_pixel_total : 14663 time to create 1 rle with old method : 0.016022920608520508 time for calcul the mask position with numpy : 0.03218221664428711 nb_pixel_total : 24811 time to create 1 rle with old method : 0.02802252769470215 time for calcul the mask position with numpy : 0.03764486312866211 nb_pixel_total : 560905 time to create 1 rle with new method : 0.7815968990325928 time for calcul the mask position with numpy : 0.03342556953430176 nb_pixel_total : 16379 time to create 1 rle with old method : 0.018564701080322266 time for calcul the mask position with numpy : 0.03421521186828613 nb_pixel_total : 221382 time to create 1 rle with new method : 0.8461775779724121 time for calcul the mask position with numpy : 0.03480100631713867 nb_pixel_total : 43800 time to create 1 rle with old method : 0.05353975296020508 time for calcul the mask position with numpy : 0.034575700759887695 nb_pixel_total : 30257 time to create 1 rle with old method : 0.03461956977844238 time for calcul the mask position with numpy : 0.03361988067626953 nb_pixel_total : 46419 time to create 1 rle with old method : 0.05349993705749512 time for calcul the mask position with numpy : 0.03374218940734863 nb_pixel_total : 103157 time to create 1 rle with old method : 0.14024734497070312 time for calcul the mask position with numpy : 0.03585076332092285 nb_pixel_total : 50527 time to create 1 rle with old method : 0.05832481384277344 time for calcul the mask position with numpy : 0.03333020210266113 nb_pixel_total : 5966 time to create 1 rle with old method : 0.006854057312011719 time for calcul the mask position with numpy : 0.03370332717895508 nb_pixel_total : 42128 time to create 1 rle with old method : 0.04781031608581543 time for calcul the mask position with numpy : 0.03337287902832031 nb_pixel_total : 57474 time to create 1 rle with old method : 0.06777262687683105 time for calcul the mask position with numpy : 0.034192800521850586 nb_pixel_total : 74824 time to create 1 rle with old method : 0.08729791641235352 time for calcul the mask position with numpy : 0.03405952453613281 nb_pixel_total : 5379 time to create 1 rle with old method : 0.006329774856567383 time for calcul the mask position with numpy : 0.03464245796203613 nb_pixel_total : 13460 time to create 1 rle with old method : 0.02177286148071289 time for calcul the mask position with numpy : 0.03959035873413086 nb_pixel_total : 15545 time to create 1 rle with old method : 0.022053003311157227 time for calcul the mask position with numpy : 0.033800363540649414 nb_pixel_total : 65432 time to create 1 rle with old method : 0.07526969909667969 time for calcul the mask position with numpy : 0.03345894813537598 nb_pixel_total : 8821 time to create 1 rle with old method : 0.010147809982299805 time for calcul the mask position with numpy : 0.033799171447753906 nb_pixel_total : 7850 time to create 1 rle with old method : 0.009290218353271484 create new chi : 6.871622323989868 time to delete rle : 0.0028192996978759766 batch 1 Loaded 76 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 23399 TO DO : save crop sub photo not yet done ! save time : 1.4891841411590576 nb_obj : 41 nb_hashtags : 5 time to prepare the origin masks : 4.750763654708862 time for calcul the mask position with numpy : 0.8376364707946777 nb_pixel_total : 6805172 time to create 1 rle with new method : 1.0407681465148926 time for calcul the mask position with numpy : 0.03340959548950195 nb_pixel_total : 36641 time to create 1 rle with old method : 0.04150557518005371 time for calcul the mask position with numpy : 0.032924652099609375 nb_pixel_total : 40821 time to create 1 rle with old method : 0.046330928802490234 time for calcul the mask position with numpy : 0.03396725654602051 nb_pixel_total : 23348 time to create 1 rle with old method : 0.026723623275756836 time for calcul the mask position with numpy : 0.033667564392089844 nb_pixel_total : 26614 time to create 1 rle with old method : 0.029645204544067383 time for calcul the mask position with numpy : 0.03266716003417969 nb_pixel_total : 37188 time to create 1 rle with old method : 0.04172158241271973 time for calcul the mask position with numpy : 0.0331575870513916 nb_pixel_total : 11703 time to create 1 rle with old method : 0.01816248893737793 time for calcul the mask position with numpy : 0.033826351165771484 nb_pixel_total : 64846 time to create 1 rle with old method : 0.07514286041259766 time for calcul the mask position with numpy : 0.03558492660522461 nb_pixel_total : 17441 time to create 1 rle with old method : 0.020519018173217773 time for calcul the mask position with numpy : 0.03428840637207031 nb_pixel_total : 11129 time to create 1 rle with old method : 0.013027667999267578 time for calcul the mask position with numpy : 0.03453183174133301 nb_pixel_total : 39890 time to create 1 rle with old method : 0.04630684852600098 time for calcul the mask position with numpy : 0.033629655838012695 nb_pixel_total : 23250 time to create 1 rle with old method : 0.02689075469970703 time for calcul the mask position with numpy : 0.03456997871398926 nb_pixel_total : 30050 time to create 1 rle with old method : 0.03500247001647949 time for calcul the mask position with numpy : 0.03424692153930664 nb_pixel_total : 51339 time to create 1 rle with old method : 0.06018471717834473 time for calcul the mask position with numpy : 0.03363990783691406 nb_pixel_total : 8354 time to create 1 rle with old method : 0.009773492813110352 time for calcul the mask position with numpy : 0.03322291374206543 nb_pixel_total : 31683 time to create 1 rle with old method : 0.03627347946166992 time for calcul the mask position with numpy : 0.03376340866088867 nb_pixel_total : 28101 time to create 1 rle with old method : 0.032747507095336914 time for calcul the mask position with numpy : 0.03411531448364258 nb_pixel_total : 42167 time to create 1 rle with old method : 0.04932355880737305 time for calcul the mask position with numpy : 0.034023284912109375 nb_pixel_total : 13109 time to create 1 rle with old method : 0.015468358993530273 time for calcul the mask position with numpy : 0.03392195701599121 nb_pixel_total : 37796 time to create 1 rle with old method : 0.04403424263000488 time for calcul the mask position with numpy : 0.03549671173095703 nb_pixel_total : 178466 time to create 1 rle with new method : 0.7751147747039795 time for calcul the mask position with numpy : 0.03333306312561035 nb_pixel_total : 29838 time to create 1 rle with old method : 0.03436636924743652 time for calcul the mask position with numpy : 0.03374123573303223 nb_pixel_total : 57259 time to create 1 rle with old method : 0.06545615196228027 time for calcul the mask position with numpy : 0.033136844635009766 nb_pixel_total : 88725 time to create 1 rle with old method : 0.09985136985778809 time for calcul the mask position with numpy : 0.03299999237060547 nb_pixel_total : 10113 time to create 1 rle with old method : 0.011394977569580078 time for calcul the mask position with numpy : 0.03251338005065918 nb_pixel_total : 23095 time to create 1 rle with old method : 0.02655816078186035 time for calcul the mask position with numpy : 0.033597707748413086 nb_pixel_total : 23308 time to create 1 rle with old method : 0.030063629150390625 time for calcul the mask position with numpy : 0.034415483474731445 nb_pixel_total : 95977 time to create 1 rle with old method : 0.11083984375 time for calcul the mask position with numpy : 0.03342080116271973 nb_pixel_total : 10809 time to create 1 rle with old method : 0.012359857559204102 time for calcul the mask position with numpy : 0.033098459243774414 nb_pixel_total : 38298 time to create 1 rle with old method : 0.0439906120300293 time for calcul the mask position with numpy : 0.03320479393005371 nb_pixel_total : 24026 time to create 1 rle with old method : 0.027651309967041016 time for calcul the mask position with numpy : 0.03259778022766113 nb_pixel_total : 49374 time to create 1 rle with old method : 0.05569028854370117 time for calcul the mask position with numpy : 0.0328068733215332 nb_pixel_total : 26917 time to create 1 rle with old method : 0.030860424041748047 time for calcul the mask position with numpy : 0.03358864784240723 nb_pixel_total : 2886 time to create 1 rle with old method : 0.0034279823303222656 time for calcul the mask position with numpy : 0.03364133834838867 nb_pixel_total : 34491 time to create 1 rle with old method : 0.04001140594482422 time for calcul the mask position with numpy : 0.034261226654052734 nb_pixel_total : 22949 time to create 1 rle with old method : 0.02662825584411621 time for calcul the mask position with numpy : 0.03467130661010742 nb_pixel_total : 54098 time to create 1 rle with old method : 0.06329631805419922 time for calcul the mask position with numpy : 0.03440093994140625 nb_pixel_total : 12671 time to create 1 rle with old method : 0.016385316848754883 time for calcul the mask position with numpy : 0.03425717353820801 nb_pixel_total : 80282 time to create 1 rle with old method : 0.09232044219970703 time for calcul the mask position with numpy : 0.03453779220581055 nb_pixel_total : 28857 time to create 1 rle with old method : 0.03383278846740723 time for calcul the mask position with numpy : 0.03535175323486328 nb_pixel_total : 17066 time to create 1 rle with old method : 0.02006220817565918 time for calcul the mask position with numpy : 0.03629732131958008 nb_pixel_total : 4253 time to create 1 rle with old method : 0.006116390228271484 create new chi : 5.6296656131744385 time to delete rle : 0.003310680389404297 batch 1 Loaded 83 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 24864 TO DO : save crop sub photo not yet done ! save time : 1.5593793392181396 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 9.93943476676941 time for calcul the mask position with numpy : 0.6293549537658691 nb_pixel_total : 7599198 time to create 1 rle with new method : 0.9413554668426514 time for calcul the mask position with numpy : 0.0235443115234375 nb_pixel_total : 38318 time to create 1 rle with old method : 0.04216575622558594 time for calcul the mask position with numpy : 0.02453923225402832 nb_pixel_total : 104104 time to create 1 rle with old method : 0.11971426010131836 time for calcul the mask position with numpy : 0.02505326271057129 nb_pixel_total : 78190 time to create 1 rle with old method : 0.09234619140625 time for calcul the mask position with numpy : 0.024932146072387695 nb_pixel_total : 30104 time to create 1 rle with old method : 0.034659385681152344 time for calcul the mask position with numpy : 0.02753138542175293 nb_pixel_total : 23595 time to create 1 rle with old method : 0.027427196502685547 time for calcul the mask position with numpy : 0.02593851089477539 nb_pixel_total : 21617 time to create 1 rle with old method : 0.025274991989135742 time for calcul the mask position with numpy : 0.03418278694152832 nb_pixel_total : 62247 time to create 1 rle with old method : 0.07158255577087402 time for calcul the mask position with numpy : 0.04012560844421387 nb_pixel_total : 7901 time to create 1 rle with old method : 0.009264707565307617 time for calcul the mask position with numpy : 0.040052175521850586 nb_pixel_total : 9320 time to create 1 rle with old method : 0.010734081268310547 time for calcul the mask position with numpy : 0.04327273368835449 nb_pixel_total : 41874 time to create 1 rle with old method : 0.04673933982849121 time for calcul the mask position with numpy : 0.031760215759277344 nb_pixel_total : 49283 time to create 1 rle with old method : 0.05631589889526367 time for calcul the mask position with numpy : 0.026851177215576172 nb_pixel_total : 188429 time to create 1 rle with new method : 0.8588991165161133 time for calcul the mask position with numpy : 0.02525615692138672 nb_pixel_total : 27882 time to create 1 rle with old method : 0.03187155723571777 time for calcul the mask position with numpy : 0.02499699592590332 nb_pixel_total : 12338 time to create 1 rle with old method : 0.014454126358032227 create new chi : 3.4932191371917725 time to delete rle : 0.0016281604766845703 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 10514 TO DO : save crop sub photo not yet done ! save time : 0.7159698009490967 map_output_result : {1361377575: (0.0, 'Should be the crop_list due to order', 0), 1361377572: (0.0, 'Should be the crop_list due to order', 0), 1361377567: (0.0, 'Should be the crop_list due to order', 0), 1361377563: (0.0, 'Should be the crop_list due to order', 0), 1361377558: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1361377575, 1361377572, 1361377567, 1361377563, 1361377558] Looping around the photos to save general results len do output : 5 /1361377575.Didn't retrieve data . /1361377572.Didn't retrieve data . /1361377567.Didn't retrieve data . /1361377563.Didn't retrieve data . /1361377558.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377575', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377572', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377567', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377563', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377558', None, None, None, None, None, '2969279') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.015808582305908203 save_final save missing photos in datou_result : time spend for datou_step_exec : 61.98765182495117 time spend to save output : 0.016180753707885742 total time spend for step 3 : 62.00383257865906 step4:ventilate_hashtags_in_portfolio Tue May 27 21:13:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23391455 get user id for portfolio 23391455 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23391455 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','pet_clair','environnement','background','autre','pehd','mal_croppe','pet_fonce','papier','metal','flou')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23391455 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','pet_clair','environnement','background','autre','pehd','mal_croppe','pet_fonce','papier','metal','flou')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23391455 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','pet_clair','environnement','background','autre','pehd','mal_croppe','pet_fonce','papier','metal','flou')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23391606,23391607,23391608,23391609,23391610,23391611,23391612,23391613,23391614,23391615,23391616?tags=carton,pet_clair,environnement,background,autre,pehd,mal_croppe,pet_fonce,papier,metal,flou Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1361377575, 1361377572, 1361377567, 1361377563, 1361377558] Looping around the photos to save general results len do output : 1 /23391455. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377575', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377572', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377567', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377563', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377558', None, None, None, None, None, '2969279') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.013359308242797852 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.621375322341919 time spend to save output : 0.013603687286376953 total time spend for step 4 : 1.634979009628296 step5:final Tue May 27 21:13:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1361377575: ('0.16205500096450615',), 1361377572: ('0.16205500096450615',), 1361377567: ('0.16205500096450615',), 1361377563: ('0.16205500096450615',), 1361377558: ('0.16205500096450615',)} new output for save of step final : {1361377575: ('0.16205500096450615',), 1361377572: ('0.16205500096450615',), 1361377567: ('0.16205500096450615',), 1361377563: ('0.16205500096450615',), 1361377558: ('0.16205500096450615',)} [1361377575, 1361377572, 1361377567, 1361377563, 1361377558] Looping around the photos to save general results len do output : 5 /1361377575.Didn't retrieve data . /1361377572.Didn't retrieve data . /1361377567.Didn't retrieve data . /1361377563.Didn't retrieve data . /1361377558.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377575', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377572', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377567', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377563', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377558', None, None, None, None, None, '2969279') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.015311956405639648 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11377930641174316 time spend to save output : 0.015632152557373047 total time spend for step 5 : 0.1294114589691162 step6:blur_detection Tue May 27 21:13:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d.jpg resize: (2160, 3840) 1361377575 -4.906314658702161 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5.jpg resize: (2160, 3840) 1361377572 -6.437379874254097 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46.jpg resize: (2160, 3840) 1361377567 -6.594417339516779 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc.jpg resize: (2160, 3840) 1361377563 -6.578898248662897 treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea.jpg resize: (2160, 3840) 1361377558 -6.358124902941973 treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445581_0.png resize: (78, 225) 1361384267 -3.825899202905082 treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445579_0.png resize: (258, 225) 1361384269 -4.137914400616856 treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445569_0.png resize: (433, 316) 1361384270 -4.4243109812909545 treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445573_0.png resize: (330, 283) 1361384271 -3.2899741682474546 treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445580_0.png resize: (107, 88) 1361384272 -1.60003504820008 treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445572_0.png resize: (443, 394) 1361384273 -4.226597303916157 treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445576_0.png resize: (196, 174) 1361384274 -3.351729481323594 treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445574_0.png resize: (170, 124) 1361384275 -3.056856017048946 treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445570_0.png resize: (311, 187) 1361384277 -4.550840371462232 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445584_0.png resize: (336, 193) 1361384279 -3.582166310507076 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445586_0.png resize: (243, 319) 1361384280 -2.463809701286976 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445600_0.png resize: (267, 181) 1361384281 -2.878029783736983 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445583_0.png resize: (372, 312) 1361384282 -4.1696705802968115 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445608_0.png resize: (330, 354) 1361384283 -3.3157431531845485 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445597_0.png resize: (305, 482) 1361384284 -4.848020799768413 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445589_0.png resize: (625, 515) 1361384285 -4.211689089502304 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445587_0.png resize: (141, 168) 1361384286 -4.395164332137125 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445604_0.png resize: (292, 187) 1361384287 -3.5434479377060635 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445585_0.png resize: (133, 122) 1361384288 -1.7898937594856432 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445591_0.png resize: (104, 103) 1361384289 -1.9633574791469175 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445599_0.png resize: (137, 224) 1361384290 -0.1112276077872548 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445590_0.png resize: (207, 152) 1361384291 -4.359256446607138 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445605_0.png resize: (650, 570) 1361384292 -5.372194556644021 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445607_0.png resize: (284, 193) 1361384293 -3.006618599496751 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445588_0.png resize: (227, 251) 1361384294 -2.696124369625304 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445603_0.png resize: (422, 374) 1361384295 -4.333437444931415 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445601_0.png resize: (198, 111) 1361384296 -4.050211410778647 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445598_0.png resize: (170, 121) 1361384297 -4.312408489025326 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445621_0.png resize: (246, 192) 1361384298 -2.5661015287143774 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445612_0.png resize: (249, 173) 1361384299 -3.9938848969273035 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445639_0.png resize: (226, 108) 1361384300 -4.107140570078808 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445625_0.png resize: (158, 140) 1361384301 -2.962284030031515 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445616_0.png resize: (324, 345) 1361384302 -3.6307864485478425 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445640_0.png resize: (438, 355) 1361384303 -3.8005178967634747 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445622_0.png resize: (259, 310) 1361384304 -4.078363699016734 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445620_0.png resize: (159, 150) 1361384305 -2.514853394487331 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445641_0.png resize: (157, 497) 1361384306 -3.695699563844006 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445631_0.png resize: (245, 156) 1361384307 -3.9026060615384672 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445610_0.png resize: (385, 334) 1361384309 -2.661499317375487 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445628_0.png resize: (394, 206) 1361384310 -3.218799637776604 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445636_0.png resize: (225, 346) 1361384311 -2.833033963142841 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445643_0.png resize: (461, 680) 1361384312 -3.0249026081530035 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445623_0.png resize: (134, 119) 1361384313 -3.526066214513076 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445642_0.png resize: (162, 185) 1361384314 -2.2103432328056707 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445630_0.png resize: (580, 534) 1361384315 -3.378453808365376 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445614_0.png resize: (94, 105) 1361384316 -2.264594110922173 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445615_0.png resize: (202, 244) 1361384317 -2.715437647891415 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445617_0.png resize: (264, 377) 1361384318 -2.4069875804580403 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445611_0.png resize: (94, 137) 1361384319 -2.619633214731525 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445624_0.png resize: (120, 115) 1361384320 -3.0247687164139254 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445619_0.png resize: (186, 172) 1361384321 -4.135925008866041 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445613_0.png resize: (382, 337) 1361384322 -2.682998500335771 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445632_0.png resize: (154, 157) 1361384323 -2.598370313927102 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445644_0.png resize: (220, 236) 1361384324 -1.372628597848896 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445635_0.png resize: (193, 220) 1361384325 -2.578811546615022 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445645_0.png resize: (268, 234) 1361384326 -3.723143332430552 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445629_0.png resize: (391, 314) 1361384327 -4.107795852973731 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445633_0.png resize: (945, 888) 1361384328 -5.499097710855686 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445646_0.png resize: (295, 207) 1361384329 -4.568935110527376 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445648_0.png resize: (173, 197) 1361384330 -2.3503815701790267 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445651_0.png resize: (498, 320) 1361384331 -2.5545412336186883 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445682_0.png resize: (271, 232) 1361384332 -3.4327431883348702 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445662_0.png resize: (298, 305) 1361384333 -3.830242542525726 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445670_0.png resize: (263, 133) 1361384334 -3.7008382960580666 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445673_0.png resize: (195, 96) 1361384336 -3.528086753629737 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445674_0.png resize: (123, 192) 1361384337 -4.547515557864737 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445667_0.png resize: (203, 154) 1361384338 -3.8834905280267313 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445652_0.png resize: (433, 281) 1361384339 1.3538782274986514 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445659_0.png resize: (262, 149) 1361384340 -3.1320005542244846 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445655_0.png resize: (192, 258) 1361384341 -3.247623115937584 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445658_0.png resize: (191, 234) 1361384342 -3.476576621748592 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445650_0.png resize: (153, 209) 1361384343 -3.265334576494959 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445666_0.png resize: (250, 244) 1361384344 0.5623784695153797 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445663_0.png resize: (364, 263) 1361384345 -2.205780051596451 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445661_0.png resize: (306, 194) 1361384346 -2.6213686371473863 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445665_0.png resize: (136, 215) 1361384347 -2.028321119103553 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445679_0.png resize: (200, 192) 1361384348 -4.065704768847885 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445677_0.png resize: (238, 365) 1361384349 -4.286507771245889 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445668_0.png resize: (263, 222) 1361384350 -3.014253604094918 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445671_0.png resize: (172, 94) 1361384351 -3.3907515312725724 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445681_0.png resize: (297, 188) 1361384352 -1.6192944849240443 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445675_0.png resize: (53, 111) 1361384353 -2.5676044192212886 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445647_0.png resize: (269, 167) 1361384354 -3.7964619623498193 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445660_0.png resize: (277, 266) 1361384355 -3.7172671785470146 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445684_0.png resize: (307, 301) 1361384356 -3.787905407535193 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445672_0.png resize: (265, 268) 1361384357 -3.660835747888066 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445664_0.png resize: (238, 123) 1361384358 -1.1594010799118009 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445649_0.png resize: (505, 589) 1361384362 -2.037541164805538 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445683_0.png resize: (173, 109) 1361384363 -3.815592692523484 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445656_0.png resize: (270, 158) 1361384364 -2.1430574228091004 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445685_0.png resize: (218, 459) 1361384365 -4.18481454012606 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445680_0.png resize: (249, 310) 1361384366 -4.188218911027141 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445678_0.png resize: (312, 169) 1361384367 -3.766213927252712 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445653_0.png resize: (286, 159) 1361384368 -3.444933792008668 treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445692_0.png resize: (269, 225) 1361384369 -2.9603956873980026 treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445697_0.png resize: (213, 166) 1361384370 -2.452453259069269 treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445696_0.png resize: (344, 173) 1361384371 -3.5666435191826626 treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445690_0.png resize: (512, 768) 1361384372 -3.1421711102022343 treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445698_0.png resize: (187, 271) 1361384373 -2.3723872765108407 treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445689_0.png resize: (193, 195) 1361384374 -3.099062358913772 treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445695_0.png resize: (421, 244) 1361384375 -3.489698483843416 treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445694_0.png resize: (149, 74) 1361384376 -2.9898644632018123 treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445701_0.png resize: (287, 276) 1361384377 -2.079749332750965 treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445693_0.png resize: (153, 79) 1361384378 -3.6248180465179525 treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445571_0.png resize: (165, 180) 1361384385 -3.9505280933646136 treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445582_0.png resize: (276, 309) 1361384387 -4.421066635846627 treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445575_0.png resize: (123, 175) 1361384388 -2.3384153162488115 treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445578_0.png resize: (293, 133) 1361384389 -3.7259146762862083 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445595_0.png resize: (254, 180) 1361384390 -4.147151684124569 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445594_0.png resize: (92, 131) 1361384391 -0.799618798253357 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445606_0.png resize: (868, 724) 1361384392 -0.998868508467844 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445638_0.png resize: (425, 393) 1361384393 -3.588344525278985 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445626_0.png resize: (241, 208) 1361384394 -3.107226415843021 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445627_0.png resize: (241, 178) 1361384395 -3.3023774118110536 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445618_0.png resize: (297, 366) 1361384396 -4.237526513126029 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445609_0.png resize: (198, 94) 1361384397 -3.3423001547425852 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445654_0.png resize: (162, 324) 1361384398 -2.8629528424795203 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445687_0.png resize: (214, 224) 1361384399 -3.308122284900864 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445669_0.png resize: (107, 105) 1361384400 -2.7420038020880706 treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445688_0.png resize: (94, 168) 1361384401 -2.8692903115904618 treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445700_0.png resize: (316, 505) 1361384402 -3.1106046448823577 treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445691_0.png resize: (188, 308) 1361384403 -2.4984233119368744 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445637_0.png resize: (229, 354) 1361384405 -4.28138442636237 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445657_0.png resize: (124, 114) 1361384406 -4.423273252429452 treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445577_0.png resize: (271, 465) 1361384416 -4.702038462146494 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445592_0.png resize: (1159, 938) 1361384417 -3.911131324524105 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445602_0.png resize: (164, 408) 1361384419 -3.6400885703979475 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445596_0.png resize: (160, 422) 1361384420 -2.140186684359555 treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445593_0.png resize: (390, 383) 1361384421 -4.096269316637294 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445686_0.png resize: (587, 223) 1361384422 -3.0040727243146095 treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445699_0.png resize: (475, 228) 1361384423 -3.2322246716050604 treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445634_0.png resize: (118, 188) 1361384424 -3.546213977011597 treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445676_0.png resize: (139, 127) 1361384425 -4.128091503816679 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 138 time used for this insertion : 0.021811723709106445 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 138 time used for this insertion : 0.034697771072387695 save missing photos in datou_result : time spend for datou_step_exec : 25.23452353477478 time spend to save output : 0.062287092208862305 total time spend for step 6 : 25.296810626983643 step7:brightness Tue May 27 21:14:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d.jpg treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5.jpg treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46.jpg treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc.jpg treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea.jpg treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445581_0.png treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445579_0.png treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445569_0.png treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445573_0.png treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445580_0.png treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445572_0.png treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445576_0.png treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445574_0.png treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445570_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445584_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445586_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445600_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445583_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445608_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445597_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445589_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445587_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445604_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445585_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445591_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445599_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445590_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445605_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445607_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445588_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445603_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445601_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445598_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445621_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445612_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445639_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445625_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445616_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445640_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445622_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445620_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445641_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445631_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445610_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445628_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445636_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445643_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445623_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445642_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445630_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445614_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445615_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445617_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445611_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445624_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445619_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445613_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445632_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445644_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445635_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445645_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445629_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445633_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445646_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445648_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445651_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445682_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445662_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445670_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445673_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445674_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445667_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445652_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445659_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445655_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445658_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445650_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445666_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445663_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445661_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445665_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445679_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445677_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445668_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445671_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445681_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445675_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445647_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445660_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445684_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445672_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445664_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445649_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445683_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445656_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445685_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445680_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445678_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445653_0.png treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445692_0.png treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445697_0.png treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445696_0.png treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445690_0.png treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445698_0.png treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445689_0.png treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445695_0.png treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445694_0.png treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445701_0.png treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445693_0.png treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445571_0.png treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445582_0.png treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445575_0.png treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445578_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445595_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445594_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445606_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445638_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445626_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445627_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445618_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445609_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445654_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445687_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445669_0.png treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445688_0.png treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445700_0.png treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445691_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445637_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445657_0.png treat image : temp/1748373029_2179815_1361377575_28a865bf17e73f38bee5922094cee18d_rle_crop_3814445577_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445592_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445602_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445596_0.png treat image : temp/1748373029_2179815_1361377572_7c0503b3f8800a32df80daa11399a9f5_rle_crop_3814445593_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445686_0.png treat image : temp/1748373029_2179815_1361377558_b1a26903e40148a4f036e050b57a2dea_rle_crop_3814445699_0.png treat image : temp/1748373029_2179815_1361377567_9ae8e0fc21bc07e1261ba103d1368b46_rle_crop_3814445634_0.png treat image : temp/1748373029_2179815_1361377563_f554d61d63d72b16d909d12a3f9f3afc_rle_crop_3814445676_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 138 time used for this insertion : 0.017741680145263672 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 138 time used for this insertion : 0.03014516830444336 save missing photos in datou_result : time spend for datou_step_exec : 6.223470449447632 time spend to save output : 0.05339479446411133 total time spend for step 7 : 6.276865243911743 step8:velours_tree Tue May 27 21:14:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.1546461582183838 time spend to save output : 3.933906555175781e-05 total time spend for step 8 : 0.15468549728393555 step9:send_mail_cod Tue May 27 21:14:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23391455_27-05-2025_21_14_30.pdf 23391606 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233916061748373270 23391607 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233916071748373272 23391609 imagette233916091748373272 23391610 change filename to text .change filename to text .imagette233916101748373272 23391611 imagette233916111748373272 23391612 imagette233916121748373272 23391613 imagette233916131748373272 23391614 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233916141748373272 23391615 change filename to text .change filename to text .imagette233916151748373274 23391616 imagette233916161748373274 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23391455 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23391606,23391607,23391608,23391609,23391610,23391611,23391612,23391613,23391614,23391615,23391616?tags=carton,pet_clair,environnement,background,autre,pehd,mal_croppe,pet_fonce,papier,metal,flou args[1361377575] : ((1361377575, -4.906314658702161, 492609224), (1361377575, -0.7252954999389313, 501862349), '0.16205500096450615') We are sending mail with results at report@fotonower.com args[1361377572] : ((1361377572, -6.437379874254097, 492609224), (1361377572, 0.3074134922177944, 2107752395), '0.16205500096450615') We are sending mail with results at report@fotonower.com args[1361377567] : ((1361377567, -6.594417339516779, 492609224), (1361377567, 0.6417776941149737, 2107752395), '0.16205500096450615') We are sending mail with results at report@fotonower.com args[1361377563] : ((1361377563, -6.578898248662897, 492609224), (1361377563, 0.6104393226489927, 2107752395), '0.16205500096450615') We are sending mail with results at report@fotonower.com args[1361377558] : ((1361377558, -6.358124902941973, 492609224), (1361377558, 0.707454464729889, 2107752395), '0.16205500096450615') We are sending mail with results at report@fotonower.com refus_total : 0.16205500096450615 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23391455 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23391455_27-05-2025_21_14_30.pdf results_Auto_P23391455_27-05-2025_21_14_30.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23391455_27-05-2025_21_14_30.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23391455','results_Auto_P23391455_27-05-2025_21_14_30.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23391455_27-05-2025_21_14_30.pdf','pdf','','0.57','0.16205500096450615') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23391455

https://www.fotonower.com/image?json=false&list_photos_id=1361377575
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361377572
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361377567
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361377563
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361377558
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 16.21%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/23391606?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23391607?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23391610?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23391614?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/23391615?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23391455_27-05-2025_21_14_30.pdf.

Lien vers velours :https://www.fotonower.com/velours/23391606,23391607,23391608,23391609,23391610,23391611,23391612,23391613,23391614,23391615,23391616?tags=carton,pet_clair,environnement,background,autre,pehd,mal_croppe,pet_fonce,papier,metal,flou.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 27 May 2025 19:14:36 GMT Content-Length: 0 Connection: close X-Message-Id: nmaM-7vyQYums7Tg88ArTQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1361377575, 1361377572, 1361377567, 1361377563, 1361377558] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377575', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377572', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377567', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377563', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377558', None, None, None, None, None, '2969279') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.017655611038208008 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.106966495513916 time spend to save output : 0.017800092697143555 total time spend for step 9 : 6.12476658821106 step10:split_time_score Tue May 27 21:14:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 5),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 27052025 23391455 Nombre de photos uploadées : 5 / 23040 (0%) 27052025 23391455 Nombre de photos taguées (types de déchets): 0 / 5 (0%) 27052025 23391455 Nombre de photos taguées (volume) : 0 / 5 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 4.291534423828125e-06 ????? elapsed_time : fill_and_build_computed_from_old_data 0.0002760887145996094 elapsed_time : insert_dashboard_record_day_entry 0.0311279296875 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.057306423611111115 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23366972_27-05-2025_07_22_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23366972 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23366972 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23388509 order by id desc limit 1 Qualite : 0.10074890136718752 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23367726_27-05-2025_08_02_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23367726 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23367726 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23367730 order by id desc limit 1 Qualite : 0.10462909570656968 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23371486_27-05-2025_10_29_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23371486 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23371486 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23375418 order by id desc limit 1 Qualite : 0.11389492801276657 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23375421_27-05-2025_14_06_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23375421 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23375421 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23375429 order by id desc limit 1 Qualite : 0.11678552013187433 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23375431_27-05-2025_13_28_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23375431 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23375431 AND mptpi.`type`=3594 To do Qualite : 0.11899609977816361 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23375432_27-05-2025_12_39_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23375432 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23375432 AND mptpi.`type`=3594 To do Qualite : 0.13145722415123456 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23383818_27-05-2025_19_04_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23383818 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23383818 AND mptpi.`type`=3594 To do Qualite : 0.10586171091338739 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23383820_27-05-2025_17_41_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23383820 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23383820 AND mptpi.`type`=3594 To do Qualite : 0.1128192314493313 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23383821_27-05-2025_18_30_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23383821 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23383821 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23383823 order by id desc limit 1 Qualite : 0.1333812438378772 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23384869_27-05-2025_17_55_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23384869 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23384869 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23391441 order by id desc limit 1 Qualite : 0.16205500096450615 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23391455_27-05-2025_21_14_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23391455 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23391455 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'27052025': {'nb_upload': 5, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1361377575, 1361377572, 1361377567, 1361377563, 1361377558] Looping around the photos to save general results len do output : 1 /23391455Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377575', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377572', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377567', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377563', None, None, None, None, None, '2969279') ('3318', None, None, None, None, None, None, None, '2969279') ('3318', '23391455', '1361377558', None, None, None, None, None, '2969279') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.014320135116577148 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.402724981307983 time spend to save output : 0.014532804489135742 total time spend for step 10 : 6.417257785797119 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 5 set_done_treatment 129.02user 76.72system 4:17.28elapsed 79%CPU (0avgtext+0avgdata 4965412maxresident)k 579624inputs+115088outputs (8604major+11487402minor)pagefaults 0swaps