python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 752540 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2854873'] with mtr_portfolio_ids : ['22982646'] and first list_photo_ids : [] new path : /proc/752540/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 0.864976167678833 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed May 14 23:20:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 9621 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-14 23:20:31.324136: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-14 23:20:31.351042: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-14 23:20:31.353216: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fd6f8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-14 23:20:31.353275: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-14 23:20:31.357170: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-14 23:20:31.581967: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x42c0530 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-14 23:20:31.582013: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-14 23:20:31.583416: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-14 23:20:31.583828: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-14 23:20:31.587174: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-14 23:20:31.590216: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-14 23:20:31.590739: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-14 23:20:31.593451: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-14 23:20:31.594456: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-14 23:20:31.598844: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-14 23:20:31.600235: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-14 23:20:31.600308: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-14 23:20:31.601022: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-14 23:20:31.601037: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-14 23:20:31.601045: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-14 23:20:31.602282: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8901 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-14 23:20:31.860068: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-14 23:20:31.860171: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-14 23:20:31.860194: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-14 23:20:31.860213: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-14 23:20:31.860230: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-14 23:20:31.860248: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-14 23:20:31.860265: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-14 23:20:31.860282: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-14 23:20:31.861835: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-14 23:20:31.863104: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-14 23:20:31.863164: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-14 23:20:31.863184: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-14 23:20:31.863202: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-14 23:20:31.863218: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-14 23:20:31.863235: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-14 23:20:31.863252: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-14 23:20:31.863268: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-14 23:20:31.864576: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-14 23:20:31.864603: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-14 23:20:31.864612: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-14 23:20:31.864620: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-14 23:20:31.865879: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8901 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-14 23:20:41.204528: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-14 23:20:41.382635: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 60 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 48 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 Detection mask done ! Trying to reset tf kernel 753105 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 105 tf kernel not reseted sub process len(results) : 5 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 5 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9621 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0005581378936767578 nb_pixel_total : 19324 time to create 1 rle with old method : 0.022396087646484375 length of segment : 207 time for calcul the mask position with numpy : 0.0010821819305419922 nb_pixel_total : 44829 time to create 1 rle with old method : 0.05224013328552246 length of segment : 410 time for calcul the mask position with numpy : 0.0021584033966064453 nb_pixel_total : 84244 time to create 1 rle with old method : 0.09547758102416992 length of segment : 391 time for calcul the mask position with numpy : 0.0005881786346435547 nb_pixel_total : 29161 time to create 1 rle with old method : 0.03449821472167969 length of segment : 211 time for calcul the mask position with numpy : 0.0006916522979736328 nb_pixel_total : 33654 time to create 1 rle with old method : 0.038680076599121094 length of segment : 280 time for calcul the mask position with numpy : 0.0014941692352294922 nb_pixel_total : 79301 time to create 1 rle with old method : 0.09176325798034668 length of segment : 403 time for calcul the mask position with numpy : 0.0009338855743408203 nb_pixel_total : 25565 time to create 1 rle with old method : 0.03013920783996582 length of segment : 1091 time for calcul the mask position with numpy : 0.00048065185546875 nb_pixel_total : 17995 time to create 1 rle with old method : 0.021230459213256836 length of segment : 191 time for calcul the mask position with numpy : 0.0008878707885742188 nb_pixel_total : 50651 time to create 1 rle with old method : 0.05812191963195801 length of segment : 277 time for calcul the mask position with numpy : 0.0005397796630859375 nb_pixel_total : 19972 time to create 1 rle with old method : 0.023945331573486328 length of segment : 355 time for calcul the mask position with numpy : 0.0009386539459228516 nb_pixel_total : 48893 time to create 1 rle with old method : 0.06079745292663574 length of segment : 246 time for calcul the mask position with numpy : 0.0036051273345947266 nb_pixel_total : 122065 time to create 1 rle with old method : 0.14464545249938965 length of segment : 786 time for calcul the mask position with numpy : 0.00037407875061035156 nb_pixel_total : 13045 time to create 1 rle with old method : 0.017388582229614258 length of segment : 186 time for calcul the mask position with numpy : 0.0067784786224365234 nb_pixel_total : 209601 time to create 1 rle with new method : 0.0220944881439209 length of segment : 804 time for calcul the mask position with numpy : 0.0017273426055908203 nb_pixel_total : 54214 time to create 1 rle with old method : 0.06253361701965332 length of segment : 430 time for calcul the mask position with numpy : 0.0020263195037841797 nb_pixel_total : 102848 time to create 1 rle with old method : 0.12700128555297852 length of segment : 372 time for calcul the mask position with numpy : 0.0005209445953369141 nb_pixel_total : 21094 time to create 1 rle with old method : 0.025413036346435547 length of segment : 427 time for calcul the mask position with numpy : 0.0009903907775878906 nb_pixel_total : 36498 time to create 1 rle with old method : 0.04358172416687012 length of segment : 330 time for calcul the mask position with numpy : 0.00035500526428222656 nb_pixel_total : 16406 time to create 1 rle with old method : 0.019556760787963867 length of segment : 169 time for calcul the mask position with numpy : 0.0005922317504882812 nb_pixel_total : 28611 time to create 1 rle with old method : 0.03830432891845703 length of segment : 503 time for calcul the mask position with numpy : 0.0013442039489746094 nb_pixel_total : 53023 time to create 1 rle with old method : 0.061948537826538086 length of segment : 324 time for calcul the mask position with numpy : 0.0008416175842285156 nb_pixel_total : 39285 time to create 1 rle with old method : 0.05437612533569336 length of segment : 333 time for calcul the mask position with numpy : 0.000896453857421875 nb_pixel_total : 34991 time to create 1 rle with old method : 0.0466771125793457 length of segment : 289 time for calcul the mask position with numpy : 0.0008611679077148438 nb_pixel_total : 40527 time to create 1 rle with old method : 0.048697710037231445 length of segment : 251 time for calcul the mask position with numpy : 0.004563808441162109 nb_pixel_total : 91709 time to create 1 rle with old method : 0.1080770492553711 length of segment : 304 time for calcul the mask position with numpy : 0.0024878978729248047 nb_pixel_total : 49245 time to create 1 rle with old method : 0.05787205696105957 length of segment : 262 time for calcul the mask position with numpy : 0.0010089874267578125 nb_pixel_total : 29178 time to create 1 rle with old method : 0.03462982177734375 length of segment : 267 time for calcul the mask position with numpy : 0.002510547637939453 nb_pixel_total : 38224 time to create 1 rle with old method : 0.045264244079589844 length of segment : 375 time for calcul the mask position with numpy : 0.0023539066314697266 nb_pixel_total : 26211 time to create 1 rle with old method : 0.029564380645751953 length of segment : 217 time for calcul the mask position with numpy : 0.0030295848846435547 nb_pixel_total : 123623 time to create 1 rle with old method : 0.14183330535888672 length of segment : 472 time for calcul the mask position with numpy : 0.0014965534210205078 nb_pixel_total : 26741 time to create 1 rle with old method : 0.030256271362304688 length of segment : 568 time for calcul the mask position with numpy : 0.0036203861236572266 nb_pixel_total : 25005 time to create 1 rle with old method : 0.03627943992614746 length of segment : 214 time for calcul the mask position with numpy : 0.0012145042419433594 nb_pixel_total : 21575 time to create 1 rle with old method : 0.024258136749267578 length of segment : 217 time for calcul the mask position with numpy : 0.00033974647521972656 nb_pixel_total : 8800 time to create 1 rle with old method : 0.010432004928588867 length of segment : 93 time for calcul the mask position with numpy : 0.006094217300415039 nb_pixel_total : 93372 time to create 1 rle with old method : 0.11076831817626953 length of segment : 412 time for calcul the mask position with numpy : 0.006302356719970703 nb_pixel_total : 120900 time to create 1 rle with old method : 0.13715910911560059 length of segment : 652 time for calcul the mask position with numpy : 0.002185344696044922 nb_pixel_total : 35581 time to create 1 rle with old method : 0.04087972640991211 length of segment : 205 time for calcul the mask position with numpy : 0.003473997116088867 nb_pixel_total : 51812 time to create 1 rle with old method : 0.0586247444152832 length of segment : 318 time for calcul the mask position with numpy : 0.0020873546600341797 nb_pixel_total : 28642 time to create 1 rle with old method : 0.040555715560913086 length of segment : 227 time for calcul the mask position with numpy : 0.0007245540618896484 nb_pixel_total : 27080 time to create 1 rle with old method : 0.031014680862426758 length of segment : 154 time for calcul the mask position with numpy : 0.0006432533264160156 nb_pixel_total : 6459 time to create 1 rle with old method : 0.007934331893920898 length of segment : 132 time for calcul the mask position with numpy : 0.0008056163787841797 nb_pixel_total : 20473 time to create 1 rle with old method : 0.02412247657775879 length of segment : 125 time for calcul the mask position with numpy : 0.005608558654785156 nb_pixel_total : 96311 time to create 1 rle with old method : 0.11203765869140625 length of segment : 275 time for calcul the mask position with numpy : 0.0009903907775878906 nb_pixel_total : 22039 time to create 1 rle with old method : 0.025104522705078125 length of segment : 172 time for calcul the mask position with numpy : 0.002202749252319336 nb_pixel_total : 42937 time to create 1 rle with old method : 0.04937553405761719 length of segment : 169 time for calcul the mask position with numpy : 0.0013489723205566406 nb_pixel_total : 16144 time to create 1 rle with old method : 0.01848459243774414 length of segment : 180 time for calcul the mask position with numpy : 0.00509190559387207 nb_pixel_total : 82297 time to create 1 rle with old method : 0.10630941390991211 length of segment : 443 time for calcul the mask position with numpy : 0.0023038387298583984 nb_pixel_total : 31622 time to create 1 rle with old method : 0.03743934631347656 length of segment : 417 time for calcul the mask position with numpy : 0.009701013565063477 nb_pixel_total : 191241 time to create 1 rle with new method : 0.01606297492980957 length of segment : 535 time for calcul the mask position with numpy : 0.004095792770385742 nb_pixel_total : 74723 time to create 1 rle with old method : 0.08638477325439453 length of segment : 546 time for calcul the mask position with numpy : 0.003437519073486328 nb_pixel_total : 81675 time to create 1 rle with old method : 0.09629964828491211 length of segment : 293 time for calcul the mask position with numpy : 0.0007624626159667969 nb_pixel_total : 13973 time to create 1 rle with old method : 0.016867876052856445 length of segment : 113 time for calcul the mask position with numpy : 0.0028629302978515625 nb_pixel_total : 57040 time to create 1 rle with old method : 0.06690597534179688 length of segment : 309 time for calcul the mask position with numpy : 0.0013880729675292969 nb_pixel_total : 19978 time to create 1 rle with old method : 0.024260282516479492 length of segment : 175 time for calcul the mask position with numpy : 0.0037522315979003906 nb_pixel_total : 94098 time to create 1 rle with old method : 0.11134767532348633 length of segment : 458 time for calcul the mask position with numpy : 0.0013434886932373047 nb_pixel_total : 24285 time to create 1 rle with old method : 0.029083251953125 length of segment : 191 time for calcul the mask position with numpy : 0.0013628005981445312 nb_pixel_total : 23971 time to create 1 rle with old method : 0.028197288513183594 length of segment : 239 time for calcul the mask position with numpy : 0.0029201507568359375 nb_pixel_total : 43745 time to create 1 rle with old method : 0.05286431312561035 length of segment : 342 time for calcul the mask position with numpy : 0.00520777702331543 nb_pixel_total : 94802 time to create 1 rle with old method : 0.1109168529510498 length of segment : 696 time for calcul the mask position with numpy : 0.0013661384582519531 nb_pixel_total : 31989 time to create 1 rle with old method : 0.037323951721191406 length of segment : 351 time for calcul the mask position with numpy : 0.0056002140045166016 nb_pixel_total : 144569 time to create 1 rle with old method : 0.19195318222045898 length of segment : 278 time for calcul the mask position with numpy : 0.003209829330444336 nb_pixel_total : 54902 time to create 1 rle with old method : 0.0637812614440918 length of segment : 384 time for calcul the mask position with numpy : 0.0022230148315429688 nb_pixel_total : 39502 time to create 1 rle with old method : 0.04717755317687988 length of segment : 271 time for calcul the mask position with numpy : 0.002207040786743164 nb_pixel_total : 35843 time to create 1 rle with old method : 0.04285454750061035 length of segment : 496 time for calcul the mask position with numpy : 0.0021779537200927734 nb_pixel_total : 37441 time to create 1 rle with old method : 0.04425930976867676 length of segment : 294 time for calcul the mask position with numpy : 0.002341747283935547 nb_pixel_total : 55243 time to create 1 rle with old method : 0.07162070274353027 length of segment : 313 time for calcul the mask position with numpy : 0.0004055500030517578 nb_pixel_total : 6750 time to create 1 rle with old method : 0.008118152618408203 length of segment : 95 time for calcul the mask position with numpy : 0.002862691879272461 nb_pixel_total : 62116 time to create 1 rle with old method : 0.07642030715942383 length of segment : 353 time for calcul the mask position with numpy : 0.010526895523071289 nb_pixel_total : 192795 time to create 1 rle with new method : 0.014073371887207031 length of segment : 664 time for calcul the mask position with numpy : 0.000736236572265625 nb_pixel_total : 10654 time to create 1 rle with old method : 0.013050317764282227 length of segment : 306 time for calcul the mask position with numpy : 0.001102447509765625 nb_pixel_total : 17107 time to create 1 rle with old method : 0.023088693618774414 length of segment : 218 time for calcul the mask position with numpy : 0.0027217864990234375 nb_pixel_total : 67926 time to create 1 rle with old method : 0.07915401458740234 length of segment : 331 time for calcul the mask position with numpy : 0.0011012554168701172 nb_pixel_total : 27462 time to create 1 rle with old method : 0.032785654067993164 length of segment : 147 time for calcul the mask position with numpy : 0.0013756752014160156 nb_pixel_total : 26342 time to create 1 rle with old method : 0.03267312049865723 length of segment : 230 time for calcul the mask position with numpy : 0.0016865730285644531 nb_pixel_total : 35750 time to create 1 rle with old method : 0.04192543029785156 length of segment : 247 time for calcul the mask position with numpy : 0.001760244369506836 nb_pixel_total : 48342 time to create 1 rle with old method : 0.057129859924316406 length of segment : 350 time for calcul the mask position with numpy : 0.001360177993774414 nb_pixel_total : 35319 time to create 1 rle with old method : 0.041640520095825195 length of segment : 252 time for calcul the mask position with numpy : 0.0009527206420898438 nb_pixel_total : 32309 time to create 1 rle with old method : 0.03873133659362793 length of segment : 163 time for calcul the mask position with numpy : 0.0010647773742675781 nb_pixel_total : 33658 time to create 1 rle with old method : 0.03981447219848633 length of segment : 188 time for calcul the mask position with numpy : 0.000997304916381836 nb_pixel_total : 24650 time to create 1 rle with old method : 0.02936387062072754 length of segment : 177 time for calcul the mask position with numpy : 0.0006570816040039062 nb_pixel_total : 18221 time to create 1 rle with old method : 0.021967411041259766 length of segment : 146 time for calcul the mask position with numpy : 0.0012104511260986328 nb_pixel_total : 40583 time to create 1 rle with old method : 0.047954559326171875 length of segment : 220 time for calcul the mask position with numpy : 0.003844022750854492 nb_pixel_total : 135712 time to create 1 rle with old method : 0.17900371551513672 length of segment : 499 time for calcul the mask position with numpy : 0.0007739067077636719 nb_pixel_total : 19826 time to create 1 rle with old method : 0.023501873016357422 length of segment : 182 time for calcul the mask position with numpy : 0.001567840576171875 nb_pixel_total : 51551 time to create 1 rle with old method : 0.06088423728942871 length of segment : 353 time for calcul the mask position with numpy : 0.0022172927856445312 nb_pixel_total : 39633 time to create 1 rle with old method : 0.04722857475280762 length of segment : 341 time for calcul the mask position with numpy : 0.0008347034454345703 nb_pixel_total : 39957 time to create 1 rle with old method : 0.04746747016906738 length of segment : 234 time for calcul the mask position with numpy : 0.0014188289642333984 nb_pixel_total : 39546 time to create 1 rle with old method : 0.04729771614074707 length of segment : 213 time for calcul the mask position with numpy : 0.0015485286712646484 nb_pixel_total : 51502 time to create 1 rle with old method : 0.0618741512298584 length of segment : 279 time for calcul the mask position with numpy : 0.0007157325744628906 nb_pixel_total : 20747 time to create 1 rle with old method : 0.02477741241455078 length of segment : 163 time for calcul the mask position with numpy : 0.0006122589111328125 nb_pixel_total : 13172 time to create 1 rle with old method : 0.015883445739746094 length of segment : 172 time for calcul the mask position with numpy : 0.0007824897766113281 nb_pixel_total : 19242 time to create 1 rle with old method : 0.02312779426574707 length of segment : 193 time for calcul the mask position with numpy : 0.0003361701965332031 nb_pixel_total : 7835 time to create 1 rle with old method : 0.00985264778137207 length of segment : 72 time for calcul the mask position with numpy : 0.0026407241821289062 nb_pixel_total : 77959 time to create 1 rle with old method : 0.09160780906677246 length of segment : 356 time for calcul the mask position with numpy : 0.0015728473663330078 nb_pixel_total : 43335 time to create 1 rle with old method : 0.054032087326049805 length of segment : 226 time for calcul the mask position with numpy : 0.0011904239654541016 nb_pixel_total : 33849 time to create 1 rle with old method : 0.04001808166503906 length of segment : 256 time for calcul the mask position with numpy : 0.0012891292572021484 nb_pixel_total : 34843 time to create 1 rle with old method : 0.054209232330322266 length of segment : 210 time for calcul the mask position with numpy : 0.0017619132995605469 nb_pixel_total : 43555 time to create 1 rle with old method : 0.053617000579833984 length of segment : 235 time for calcul the mask position with numpy : 0.0008041858673095703 nb_pixel_total : 23267 time to create 1 rle with old method : 0.02836918830871582 length of segment : 154 time for calcul the mask position with numpy : 0.002312183380126953 nb_pixel_total : 49568 time to create 1 rle with old method : 0.06254363059997559 length of segment : 277 time for calcul the mask position with numpy : 0.0003299713134765625 nb_pixel_total : 15660 time to create 1 rle with old method : 0.01865386962890625 length of segment : 159 time for calcul the mask position with numpy : 0.9737515449523926 nb_pixel_total : 4316808 time to create 1 rle with new method : 0.5066018104553223 length of segment : 2058 time for calcul the mask position with numpy : 0.004943132400512695 nb_pixel_total : 231552 time to create 1 rle with new method : 0.012281179428100586 length of segment : 641 time for calcul the mask position with numpy : 0.0006954669952392578 nb_pixel_total : 37571 time to create 1 rle with old method : 0.04864001274108887 length of segment : 227 time for calcul the mask position with numpy : 0.00026154518127441406 nb_pixel_total : 13075 time to create 1 rle with old method : 0.016121625900268555 length of segment : 95 time for calcul the mask position with numpy : 0.003145456314086914 nb_pixel_total : 132120 time to create 1 rle with old method : 0.16200590133666992 length of segment : 682 time spent for convertir_results : 12.541217565536499 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 106 chid ids of type : 3594 Number RLEs to save : 34784 save missing photos in datou_result : time spend for datou_step_exec : 58.14076042175293 time spend to save output : 2.112370014190674 total time spend for step 1 : 60.2531304359436 step2:crop_condition Wed May 14 23:21:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 106 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 81 About to insert : list_path_to_insert length 81 new photo from crops ! About to upload 81 photos upload in portfolio : 3736932 init cache_photo without model_param we have 81 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747257707_752540 we have uploaded 81 photos in the portfolio 3736932 time of upload the photos Elapsed time : 19.149690628051758 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 3736932 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747257732_752540 we have uploaded 12 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.159367322921753 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747257736_752540 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0008289813995361 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3736932 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747257760_752540 we have uploaded 8 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.105311155319214 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747257766_752540 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9240992069244385 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1358319669, 1358319620, 1358319585, 1358319551, 1358319499] Looping around the photos to save general results len do output : 106 /1358357001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358357334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319669', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319620', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319585', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319551', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319499', None, None, None, None, None, '2854873') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 323 time used for this insertion : 0.026727914810180664 save_final save missing photos in datou_result : time spend for datou_step_exec : 78.07375597953796 time spend to save output : 0.03058147430419922 total time spend for step 2 : 78.10433745384216 step3:rle_unique_nms_with_priority Wed May 14 23:22:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 106 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 21 nb_hashtags : 2 time to prepare the origin masks : 9.41563868522644 time for calcul the mask position with numpy : 0.3879430294036865 nb_pixel_total : 7187147 time to create 1 rle with new method : 0.6258718967437744 time for calcul the mask position with numpy : 0.04017162322998047 nb_pixel_total : 53023 time to create 1 rle with old method : 0.061920166015625 time for calcul the mask position with numpy : 0.03949618339538574 nb_pixel_total : 25682 time to create 1 rle with old method : 0.029950380325317383 time for calcul the mask position with numpy : 0.024455785751342773 nb_pixel_total : 16406 time to create 1 rle with old method : 0.019072771072387695 time for calcul the mask position with numpy : 0.025475263595581055 nb_pixel_total : 36498 time to create 1 rle with old method : 0.042406320571899414 time for calcul the mask position with numpy : 0.026329755783081055 nb_pixel_total : 21094 time to create 1 rle with old method : 0.02457118034362793 time for calcul the mask position with numpy : 0.02558112144470215 nb_pixel_total : 102108 time to create 1 rle with old method : 0.11676931381225586 time for calcul the mask position with numpy : 0.02566671371459961 nb_pixel_total : 54214 time to create 1 rle with old method : 0.0623936653137207 time for calcul the mask position with numpy : 0.026316165924072266 nb_pixel_total : 209601 time to create 1 rle with new method : 0.984229326248169 time for calcul the mask position with numpy : 0.025464534759521484 nb_pixel_total : 13045 time to create 1 rle with old method : 0.0155487060546875 time for calcul the mask position with numpy : 0.028652667999267578 nb_pixel_total : 122065 time to create 1 rle with old method : 0.14219951629638672 time for calcul the mask position with numpy : 0.025871753692626953 nb_pixel_total : 48893 time to create 1 rle with old method : 0.05662107467651367 time for calcul the mask position with numpy : 0.02557539939880371 nb_pixel_total : 19900 time to create 1 rle with old method : 0.023366451263427734 time for calcul the mask position with numpy : 0.025734901428222656 nb_pixel_total : 50651 time to create 1 rle with old method : 0.058899641036987305 time for calcul the mask position with numpy : 0.026635408401489258 nb_pixel_total : 17995 time to create 1 rle with old method : 0.02123570442199707 time for calcul the mask position with numpy : 0.02542567253112793 nb_pixel_total : 25565 time to create 1 rle with old method : 0.031601905822753906 time for calcul the mask position with numpy : 0.02564859390258789 nb_pixel_total : 79301 time to create 1 rle with old method : 0.09418129920959473 time for calcul the mask position with numpy : 0.025084257125854492 nb_pixel_total : 33654 time to create 1 rle with old method : 0.040981292724609375 time for calcul the mask position with numpy : 0.030498504638671875 nb_pixel_total : 29161 time to create 1 rle with old method : 0.034088134765625 time for calcul the mask position with numpy : 0.026888132095336914 nb_pixel_total : 84244 time to create 1 rle with old method : 0.09782266616821289 time for calcul the mask position with numpy : 0.02570056915283203 nb_pixel_total : 44829 time to create 1 rle with old method : 0.052979230880737305 time for calcul the mask position with numpy : 0.02633190155029297 nb_pixel_total : 19324 time to create 1 rle with old method : 0.0229036808013916 create new chi : 3.689164400100708 time to delete rle : 0.02493000030517578 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 18737 TO DO : save crop sub photo not yet done ! save time : 1.0770540237426758 nb_obj : 27 nb_hashtags : 3 time to prepare the origin masks : 4.500203371047974 time for calcul the mask position with numpy : 0.9374957084655762 nb_pixel_total : 7086607 time to create 1 rle with new method : 2.097900390625 time for calcul the mask position with numpy : 0.033284664154052734 nb_pixel_total : 91709 time to create 1 rle with old method : 0.1011052131652832 time for calcul the mask position with numpy : 0.03205704689025879 nb_pixel_total : 38224 time to create 1 rle with old method : 0.04238128662109375 time for calcul the mask position with numpy : 0.032874345779418945 nb_pixel_total : 21575 time to create 1 rle with old method : 0.02412247657775879 time for calcul the mask position with numpy : 0.03262829780578613 nb_pixel_total : 26211 time to create 1 rle with old method : 0.037454843521118164 time for calcul the mask position with numpy : 0.0391385555267334 nb_pixel_total : 26741 time to create 1 rle with old method : 0.0369715690612793 time for calcul the mask position with numpy : 0.03334927558898926 nb_pixel_total : 49245 time to create 1 rle with old method : 0.05626177787780762 time for calcul the mask position with numpy : 0.034052371978759766 nb_pixel_total : 123623 time to create 1 rle with old method : 0.13901472091674805 time for calcul the mask position with numpy : 0.03564929962158203 nb_pixel_total : 29178 time to create 1 rle with old method : 0.03406929969787598 time for calcul the mask position with numpy : 0.03431439399719238 nb_pixel_total : 39285 time to create 1 rle with old method : 0.04489850997924805 time for calcul the mask position with numpy : 0.0328068733215332 nb_pixel_total : 28642 time to create 1 rle with old method : 0.032793283462524414 time for calcul the mask position with numpy : 0.03388547897338867 nb_pixel_total : 22039 time to create 1 rle with old method : 0.025130510330200195 time for calcul the mask position with numpy : 0.03355765342712402 nb_pixel_total : 35581 time to create 1 rle with old method : 0.04014873504638672 time for calcul the mask position with numpy : 0.03336668014526367 nb_pixel_total : 34991 time to create 1 rle with old method : 0.03902006149291992 time for calcul the mask position with numpy : 0.0351107120513916 nb_pixel_total : 16144 time to create 1 rle with old method : 0.01835036277770996 time for calcul the mask position with numpy : 0.032633304595947266 nb_pixel_total : 25005 time to create 1 rle with old method : 0.028888940811157227 time for calcul the mask position with numpy : 0.033034563064575195 nb_pixel_total : 30437 time to create 1 rle with old method : 0.03549528121948242 time for calcul the mask position with numpy : 0.033603668212890625 nb_pixel_total : 82297 time to create 1 rle with old method : 0.0928182601928711 time for calcul the mask position with numpy : 0.0336456298828125 nb_pixel_total : 40527 time to create 1 rle with old method : 0.04681539535522461 time for calcul the mask position with numpy : 0.03427696228027344 nb_pixel_total : 42937 time to create 1 rle with old method : 0.049915313720703125 time for calcul the mask position with numpy : 0.03378915786743164 nb_pixel_total : 20473 time to create 1 rle with old method : 0.02379465103149414 time for calcul the mask position with numpy : 0.0336451530456543 nb_pixel_total : 6459 time to create 1 rle with old method : 0.00761103630065918 time for calcul the mask position with numpy : 0.03348135948181152 nb_pixel_total : 48271 time to create 1 rle with old method : 0.054044246673583984 time for calcul the mask position with numpy : 0.03292512893676758 nb_pixel_total : 93372 time to create 1 rle with old method : 0.10565733909606934 time for calcul the mask position with numpy : 0.03295540809631348 nb_pixel_total : 8816 time to create 1 rle with old method : 0.010081052780151367 time for calcul the mask position with numpy : 0.03382682800292969 nb_pixel_total : 120900 time to create 1 rle with old method : 0.13871479034423828 time for calcul the mask position with numpy : 0.03310275077819824 nb_pixel_total : 8800 time to create 1 rle with old method : 0.009882688522338867 time for calcul the mask position with numpy : 0.03276515007019043 nb_pixel_total : 96311 time to create 1 rle with old method : 0.10752630233764648 create new chi : 5.367086887359619 time to delete rle : 0.002277851104736328 batch 1 Loaded 55 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 17362 TO DO : save crop sub photo not yet done ! save time : 1.0523667335510254 nb_obj : 23 nb_hashtags : 3 time to prepare the origin masks : 10.103797197341919 time for calcul the mask position with numpy : 0.5529773235321045 nb_pixel_total : 6888519 time to create 1 rle with new method : 1.065885305404663 time for calcul the mask position with numpy : 0.031858205795288086 nb_pixel_total : 17107 time to create 1 rle with old method : 0.02670741081237793 time for calcul the mask position with numpy : 0.02957749366760254 nb_pixel_total : 8093 time to create 1 rle with old method : 0.009571552276611328 time for calcul the mask position with numpy : 0.027679443359375 nb_pixel_total : 192795 time to create 1 rle with new method : 0.7062427997589111 time for calcul the mask position with numpy : 0.027492523193359375 nb_pixel_total : 62116 time to create 1 rle with old method : 0.08815574645996094 time for calcul the mask position with numpy : 0.028936386108398438 nb_pixel_total : 6750 time to create 1 rle with old method : 0.007843732833862305 time for calcul the mask position with numpy : 0.025092601776123047 nb_pixel_total : 55243 time to create 1 rle with old method : 0.06306719779968262 time for calcul the mask position with numpy : 0.02700638771057129 nb_pixel_total : 37441 time to create 1 rle with old method : 0.04377555847167969 time for calcul the mask position with numpy : 0.02569270133972168 nb_pixel_total : 35843 time to create 1 rle with old method : 0.04656386375427246 time for calcul the mask position with numpy : 0.02541947364807129 nb_pixel_total : 39502 time to create 1 rle with old method : 0.04664444923400879 time for calcul the mask position with numpy : 0.0281064510345459 nb_pixel_total : 54902 time to create 1 rle with old method : 0.06510066986083984 time for calcul the mask position with numpy : 0.02714085578918457 nb_pixel_total : 144569 time to create 1 rle with old method : 0.16744565963745117 time for calcul the mask position with numpy : 0.026035070419311523 nb_pixel_total : 31989 time to create 1 rle with old method : 0.037338972091674805 time for calcul the mask position with numpy : 0.025484561920166016 nb_pixel_total : 94802 time to create 1 rle with old method : 0.11024832725524902 time for calcul the mask position with numpy : 0.02836775779724121 nb_pixel_total : 43745 time to create 1 rle with old method : 0.05113816261291504 time for calcul the mask position with numpy : 0.031455039978027344 nb_pixel_total : 23971 time to create 1 rle with old method : 0.028333425521850586 time for calcul the mask position with numpy : 0.027619361877441406 nb_pixel_total : 24285 time to create 1 rle with old method : 0.03158688545227051 time for calcul the mask position with numpy : 0.028861522674560547 nb_pixel_total : 94098 time to create 1 rle with old method : 0.11618161201477051 time for calcul the mask position with numpy : 0.02975320816040039 nb_pixel_total : 19978 time to create 1 rle with old method : 0.023427963256835938 time for calcul the mask position with numpy : 0.02709054946899414 nb_pixel_total : 57040 time to create 1 rle with old method : 0.0668022632598877 time for calcul the mask position with numpy : 0.025687217712402344 nb_pixel_total : 13973 time to create 1 rle with old method : 0.016390085220336914 time for calcul the mask position with numpy : 0.02532672882080078 nb_pixel_total : 81675 time to create 1 rle with old method : 0.09487462043762207 time for calcul the mask position with numpy : 0.026368379592895508 nb_pixel_total : 74723 time to create 1 rle with old method : 0.08559536933898926 time for calcul the mask position with numpy : 0.027394533157348633 nb_pixel_total : 191241 time to create 1 rle with new method : 0.8860349655151367 create new chi : 5.166148662567139 time to delete rle : 0.002424955368041992 batch 1 Loaded 47 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++Number RLEs to save : 17790 TO DO : save crop sub photo not yet done ! save time : 1.0829789638519287 nb_obj : 17 nb_hashtags : 5 time to prepare the origin masks : 8.850312948226929 time for calcul the mask position with numpy : 0.6313807964324951 nb_pixel_total : 7615999 time to create 1 rle with new method : 0.8191804885864258 time for calcul the mask position with numpy : 0.02488088607788086 nb_pixel_total : 39546 time to create 1 rle with old method : 0.045024871826171875 time for calcul the mask position with numpy : 0.02516007423400879 nb_pixel_total : 1571 time to create 1 rle with old method : 0.002026796340942383 time for calcul the mask position with numpy : 0.025069713592529297 nb_pixel_total : 39633 time to create 1 rle with old method : 0.04570126533508301 time for calcul the mask position with numpy : 0.025404930114746094 nb_pixel_total : 51551 time to create 1 rle with old method : 0.060365915298461914 time for calcul the mask position with numpy : 0.026182889938354492 nb_pixel_total : 19826 time to create 1 rle with old method : 0.023236989974975586 time for calcul the mask position with numpy : 0.02685713768005371 nb_pixel_total : 135712 time to create 1 rle with old method : 0.15676188468933105 time for calcul the mask position with numpy : 0.02541661262512207 nb_pixel_total : 40583 time to create 1 rle with old method : 0.04693794250488281 time for calcul the mask position with numpy : 0.024156808853149414 nb_pixel_total : 18221 time to create 1 rle with old method : 0.020856142044067383 time for calcul the mask position with numpy : 0.024599552154541016 nb_pixel_total : 24650 time to create 1 rle with old method : 0.0284116268157959 time for calcul the mask position with numpy : 0.025511503219604492 nb_pixel_total : 33658 time to create 1 rle with old method : 0.03898358345031738 time for calcul the mask position with numpy : 0.025884628295898438 nb_pixel_total : 32309 time to create 1 rle with old method : 0.03705644607543945 time for calcul the mask position with numpy : 0.02566814422607422 nb_pixel_total : 35319 time to create 1 rle with old method : 0.04071807861328125 time for calcul the mask position with numpy : 0.025496959686279297 nb_pixel_total : 48342 time to create 1 rle with old method : 0.05479001998901367 time for calcul the mask position with numpy : 0.025215625762939453 nb_pixel_total : 35750 time to create 1 rle with old method : 0.04033255577087402 time for calcul the mask position with numpy : 0.024421215057373047 nb_pixel_total : 26342 time to create 1 rle with old method : 0.030546188354492188 time for calcul the mask position with numpy : 0.025797128677368164 nb_pixel_total : 27462 time to create 1 rle with old method : 0.03205251693725586 time for calcul the mask position with numpy : 0.025727510452270508 nb_pixel_total : 67926 time to create 1 rle with old method : 0.08144521713256836 create new chi : 2.7118563652038574 time to delete rle : 0.0015177726745605469 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 10375 TO DO : save crop sub photo not yet done ! save time : 0.6124546527862549 nb_obj : 16 nb_hashtags : 4 time to prepare the origin masks : 8.7402024269104 time for calcul the mask position with numpy : 0.2722017765045166 nb_pixel_total : 3576759 time to create 1 rle with new method : 0.877934455871582 time for calcul the mask position with numpy : 0.024891138076782227 nb_pixel_total : 13075 time to create 1 rle with old method : 0.014997720718383789 time for calcul the mask position with numpy : 0.025607585906982422 nb_pixel_total : 231552 time to create 1 rle with new method : 0.8447868824005127 time for calcul the mask position with numpy : 0.30286169052124023 nb_pixel_total : 4038480 time to create 1 rle with new method : 0.8055529594421387 time for calcul the mask position with numpy : 0.02521347999572754 nb_pixel_total : 15660 time to create 1 rle with old method : 0.017819881439208984 time for calcul the mask position with numpy : 0.02510809898376465 nb_pixel_total : 49568 time to create 1 rle with old method : 0.0569765567779541 time for calcul the mask position with numpy : 0.024985551834106445 nb_pixel_total : 23267 time to create 1 rle with old method : 0.02788686752319336 time for calcul the mask position with numpy : 0.02714705467224121 nb_pixel_total : 43555 time to create 1 rle with old method : 0.06360459327697754 time for calcul the mask position with numpy : 0.024682998657226562 nb_pixel_total : 34843 time to create 1 rle with old method : 0.039426326751708984 time for calcul the mask position with numpy : 0.03532862663269043 nb_pixel_total : 33849 time to create 1 rle with old method : 0.038556814193725586 time for calcul the mask position with numpy : 0.025658607482910156 nb_pixel_total : 43335 time to create 1 rle with old method : 0.050052642822265625 time for calcul the mask position with numpy : 0.027180910110473633 nb_pixel_total : 77959 time to create 1 rle with old method : 0.09113502502441406 time for calcul the mask position with numpy : 0.025876998901367188 nb_pixel_total : 7835 time to create 1 rle with old method : 0.009865522384643555 time for calcul the mask position with numpy : 0.025510072708129883 nb_pixel_total : 19242 time to create 1 rle with old method : 0.027021169662475586 time for calcul the mask position with numpy : 0.027257680892944336 nb_pixel_total : 13172 time to create 1 rle with old method : 0.01613903045654297 time for calcul the mask position with numpy : 0.030600786209106445 nb_pixel_total : 20747 time to create 1 rle with old method : 0.028458118438720703 time for calcul the mask position with numpy : 0.029183149337768555 nb_pixel_total : 51502 time to create 1 rle with old method : 0.05943012237548828 create new chi : 4.144356966018677 time to delete rle : 0.0020341873168945312 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 13109 TO DO : save crop sub photo not yet done ! save time : 0.822711706161499 map_output_result : {1358319669: (0.0, 'Should be the crop_list due to order', 0), 1358319620: (0.0, 'Should be the crop_list due to order', 0), 1358319585: (0.0, 'Should be the crop_list due to order', 0), 1358319551: (0.0, 'Should be the crop_list due to order', 0), 1358319499: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1358319669, 1358319620, 1358319585, 1358319551, 1358319499] Looping around the photos to save general results len do output : 5 /1358319669.Didn't retrieve data . /1358319620.Didn't retrieve data . /1358319585.Didn't retrieve data . /1358319551.Didn't retrieve data . /1358319499.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319669', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319620', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319585', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319551', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319499', None, None, None, None, None, '2854873') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.012483596801757812 save_final save missing photos in datou_result : time spend for datou_step_exec : 68.44623017311096 time spend to save output : 0.012817144393920898 total time spend for step 3 : 68.45904731750488 step4:ventilate_hashtags_in_portfolio Wed May 14 23:23:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22982646 get user id for portfolio 22982646 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22982646 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','environnement','mal_croppe','pet_clair','papier','pehd','pet_fonce','carton','autre','metal','flou')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22982646 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','environnement','mal_croppe','pet_clair','papier','pehd','pet_fonce','carton','autre','metal','flou')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22982646 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','environnement','mal_croppe','pet_clair','papier','pehd','pet_fonce','carton','autre','metal','flou')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22985535,22985536,22985537,22985538,22985539,22985540,22985541,22985542,22985543,22985544,22985545?tags=background,environnement,mal_croppe,pet_clair,papier,pehd,pet_fonce,carton,autre,metal,flou Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1358319669, 1358319620, 1358319585, 1358319551, 1358319499] Looping around the photos to save general results len do output : 1 /22982646. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319669', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319620', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319585', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319551', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319499', None, None, None, None, None, '2854873') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.014014005661010742 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5632822513580322 time spend to save output : 0.0142974853515625 total time spend for step 4 : 1.5775797367095947 step5:final Wed May 14 23:23:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1358319669: ('0.2198343219521605',), 1358319620: ('0.2198343219521605',), 1358319585: ('0.2198343219521605',), 1358319551: ('0.2198343219521605',), 1358319499: ('0.2198343219521605',)} new output for save of step final : {1358319669: ('0.2198343219521605',), 1358319620: ('0.2198343219521605',), 1358319585: ('0.2198343219521605',), 1358319551: ('0.2198343219521605',), 1358319499: ('0.2198343219521605',)} [1358319669, 1358319620, 1358319585, 1358319551, 1358319499] Looping around the photos to save general results len do output : 5 /1358319669.Didn't retrieve data . /1358319620.Didn't retrieve data . /1358319585.Didn't retrieve data . /1358319551.Didn't retrieve data . /1358319499.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319669', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319620', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319585', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319551', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319499', None, None, None, None, None, '2854873') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.012449026107788086 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10782694816589355 time spend to save output : 0.012817621231079102 total time spend for step 5 : 0.12064456939697266 step6:blur_detection Wed May 14 23:23:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe.jpg resize: (2160, 3840) 1358319669 -6.569349558347118 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40.jpg resize: (2160, 3840) 1358319620 -6.598643732659362 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a.jpg resize: (2160, 3840) 1358319585 -6.639670935985679 treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7.jpg resize: (2160, 3840) 1358319551 -5.70429223198436 treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64.jpg resize: (2160, 3840) 1358319499 -5.007039342800613 treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100179_0.png resize: (322, 364) 1358357001 -1.4062238274574226 treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100189_0.png resize: (167, 148) 1358357002 -2.933361412349482 treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100192_0.png resize: (366, 381) 1358357003 -2.9870680678262764 treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100190_0.png resize: (772, 614) 1358357004 -1.2051280040029733 treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100194_0.png resize: (330, 270) 1358357005 -3.8462786101001107 treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100183_0.png resize: (571, 155) 1358357006 -3.6194746501073873 treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100182_0.png resize: (391, 377) 1358357007 -3.4880983969621098 treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100197_0.png resize: (301, 334) 1358357008 -3.5188124670414385 treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100193_0.png resize: (200, 192) 1358357009 -4.125737351971465 treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100178_0.png resize: (312, 224) 1358357010 -4.411057957318651 treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100196_0.png resize: (279, 190) 1358357011 -1.9737922498988631 treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100184_0.png resize: (181, 189) 1358357012 -0.8113191594852309 treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100186_0.png resize: (301, 151) 1358357013 -4.132024705834803 treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100187_0.png resize: (246, 335) 1358357014 -2.990132901026499 treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100185_0.png resize: (271, 258) 1358357015 3.457828285564138 treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100181_0.png resize: (240, 210) 1358357016 -1.9449666495918485 treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100177_0.png resize: (207, 115) 1358357017 -0.5276472724923079 treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100191_0.png resize: (430, 231) 1358357018 -3.8843348308952375 treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100180_0.png resize: (201, 235) 1358357019 -2.650063148055795 treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100195_0.png resize: (163, 149) 1358357020 -1.50080482467885 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100198_0.png resize: (312, 164) 1358357021 -0.9675805472826314 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100215_0.png resize: (198, 213) 1358357022 -3.1586425385507653 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100220_0.png resize: (172, 153) 1358357023 -3.49817705824477 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100209_0.png resize: (216, 193) 1358357024 -2.0499961027892954 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100208_0.png resize: (212, 219) 1358357025 -1.9447087082522718 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100207_0.png resize: (313, 161) 1358357026 -1.1208914877218923 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100199_0.png resize: (289, 191) 1358357027 -1.768625753644634 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100224_0.png resize: (347, 212) 1358357028 -3.9902116648148067 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100200_0.png resize: (238, 274) 1358357029 0.5715284645845211 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100214_0.png resize: (288, 275) 1358357030 -4.166747335843396 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100210_0.png resize: (93, 111) 1358357031 -1.0241886822344903 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100211_0.png resize: (406, 402) 1358357032 -0.9039816279460812 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100219_0.png resize: (245, 711) 1358357033 -4.217849243581216 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100205_0.png resize: (205, 273) 1358357034 0.8923113591655174 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100206_0.png resize: (447, 426) 1358357035 -3.647879826710264 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100217_0.png resize: (121, 101) 1358357036 -4.2495816888718565 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100212_0.png resize: (373, 536) 1358357037 -4.369953847663959 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100218_0.png resize: (120, 197) 1358357038 -3.2339324334538575 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100216_0.png resize: (151, 248) 1358357039 -0.4264884034372699 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100202_0.png resize: (249, 275) 1358357040 -3.3566715902627497 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100201_0.png resize: (298, 478) 1358357041 -1.3740586135551978 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100223_0.png resize: (418, 317) 1358357042 -3.558271954756449 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100221_0.png resize: (168, 284) 1358357043 -1.938844623591272 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100204_0.png resize: (375, 211) 1358357044 -3.1986664758092997 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100203_0.png resize: (251, 166) 1358357045 -3.799580392987902 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100236_0.png resize: (351, 118) 1358357046 -1.3354486742751486 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100232_0.png resize: (186, 264) 1358357047 -3.819914813392162 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100247_0.png resize: (215, 136) 1358357048 -3.3138147642255813 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100231_0.png resize: (387, 375) 1358357049 -4.57282849915706 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100246_0.png resize: (213, 139) 1358357050 -4.201198615340776 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100228_0.png resize: (113, 181) 1358357051 -4.023297400519007 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100239_0.png resize: (266, 261) 1358357052 -4.016613449593946 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100241_0.png resize: (294, 200) 1358357053 -4.019293784422154 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100244_0.png resize: (304, 293) 1358357054 -2.5077377574088784 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100226_0.png resize: (404, 298) 1358357055 -3.101058080247641 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100240_0.png resize: (309, 220) 1358357056 -4.300760041061644 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100229_0.png resize: (309, 279) 1358357057 -3.0537110214296006 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100233_0.png resize: (239, 161) 1358357058 -4.0255032311762164 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100243_0.png resize: (92, 92) 1358357059 -2.739844643371885 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100230_0.png resize: (170, 198) 1358357060 -4.212023616996228 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100242_0.png resize: (305, 236) 1358357061 -3.3463692447595363 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100227_0.png resize: (271, 439) 1358357062 -3.737644903091191 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100235_0.png resize: (667, 282) 1358357063 -4.256474162226531 treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100260_0.png resize: (182, 136) 1358357064 1.1328765356120847 treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100264_0.png resize: (204, 274) 1358357065 -3.4096780190426266 treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100250_0.png resize: (230, 182) 1358357066 -3.0650764202393233 treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100253_0.png resize: (252, 189) 1358357067 -4.2598071646678655 treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100248_0.png resize: (319, 317) 1358357068 -2.996085972758495 treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100263_0.png resize: (233, 255) 1358357069 -2.952708264313013 treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100249_0.png resize: (147, 308) 1358357070 -2.9265467468459914 treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100252_0.png resize: (327, 231) 1358357071 -3.443481258935148 treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100261_0.png resize: (353, 213) 1358357072 -4.259359330177439 treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100275_0.png resize: (154, 183) 1358357073 -5.540704274614727 treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100271_0.png resize: (226, 314) 1358357074 -5.117910574976342 treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100265_0.png resize: (279, 260) 1358357075 -3.07685811380477 treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100266_0.png resize: (162, 172) 1358357076 -4.257288448236913 treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100272_0.png resize: (254, 216) 1358357077 -3.7355542361110823 treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100273_0.png resize: (208, 277) 1358357079 -3.9328583984329724 treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100281_0.png resize: (91, 172) 1358357080 -2.6052667510242626 treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100277_0.png resize: (158, 129) 1358357081 -4.478666619267001 treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100267_0.png resize: (172, 137) 1358357082 -4.183960342079665 treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100188_0.png resize: (685, 351) 1358357086 -4.202412006299869 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100213_0.png resize: (189, 282) 1358357087 -3.2418375331491576 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100245_0.png resize: (492, 658) 1358357088 -4.463591029097066 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100234_0.png resize: (336, 327) 1358357089 -2.7530243761691593 treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100251_0.png resize: (241, 233) 1358357090 -3.1896114100539696 treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100258_0.png resize: (217, 265) 1358357091 -3.073037122384654 treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100282_0.png resize: (521, 562) 1358357093 -4.637091424303893 treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100280_0.png resize: (222, 263) 1358357094 -4.490910967713441 treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100268_0.png resize: (193, 140) 1358357095 -2.995023719966418 treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100276_0.png resize: (271, 258) 1358357096 -4.184728327985911 treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100269_0.png resize: (70, 128) 1358357097 -0.16999904853360032 treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100279_0.png resize: (626, 497) 1358357098 -4.971558442018364 treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100256_0.png resize: (177, 189) 1358357112 -4.517632242411714 treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100254_0.png resize: (143, 283) 1358357113 -3.9226049789047774 treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100274_0.png resize: (224, 262) 1358357114 -4.8973580021183905 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100225_0.png resize: (511, 735) 1358357294 -2.329023092817122 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100237_0.png resize: (272, 741) 1358357296 -3.797950945543694 treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100238_0.png resize: (340, 350) 1358357297 -3.6324361604481954 treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100257_0.png resize: (143, 185) 1358357298 -2.8575122067992993 treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100259_0.png resize: (457, 404) 1358357299 -4.7302149535603375 treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100262_0.png resize: (294, 305) 1358357301 -3.4938017669191597 treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100278_0.png resize: (1985, 2651) 1358357302 -4.550751497566304 treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100270_0.png resize: (337, 318) 1358357303 -5.068865475289054 treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100222_0.png resize: (180, 133) 1358357333 -4.871109860307833 treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100255_0.png resize: (188, 240) 1358357334 -2.8867097016529026 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 111 time used for this insertion : 0.016478538513183594 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 111 time used for this insertion : 0.031193971633911133 save missing photos in datou_result : time spend for datou_step_exec : 25.011746883392334 time spend to save output : 0.05295228958129883 total time spend for step 6 : 25.064699172973633 step7:brightness Wed May 14 23:24:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe.jpg treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40.jpg treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a.jpg treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7.jpg treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64.jpg treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100179_0.png treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100189_0.png treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100192_0.png treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100190_0.png treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100194_0.png treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100183_0.png treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100182_0.png treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100197_0.png treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100193_0.png treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100178_0.png treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100196_0.png treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100184_0.png treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100186_0.png treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100187_0.png treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100185_0.png treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100181_0.png treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100177_0.png treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100191_0.png treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100180_0.png treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100195_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100198_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100215_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100220_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100209_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100208_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100207_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100199_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100224_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100200_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100214_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100210_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100211_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100219_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100205_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100206_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100217_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100212_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100218_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100216_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100202_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100201_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100223_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100221_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100204_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100203_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100236_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100232_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100247_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100231_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100246_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100228_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100239_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100241_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100244_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100226_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100240_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100229_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100233_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100243_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100230_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100242_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100227_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100235_0.png treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100260_0.png treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100264_0.png treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100250_0.png treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100253_0.png treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100248_0.png treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100263_0.png treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100249_0.png treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100252_0.png treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100261_0.png treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100275_0.png treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100271_0.png treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100265_0.png treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100266_0.png treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100272_0.png treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100273_0.png treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100281_0.png treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100277_0.png treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100267_0.png treat image : temp/1747257627_752540_1358319669_7eba1f147282860986a703e496f7a8fe_rle_crop_3798100188_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100213_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100245_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100234_0.png treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100251_0.png treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100258_0.png treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100282_0.png treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100280_0.png treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100268_0.png treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100276_0.png treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100269_0.png treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100279_0.png treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100256_0.png treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100254_0.png treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100274_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100225_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100237_0.png treat image : temp/1747257627_752540_1358319585_0d89e978b873a13026a54914b0ba8b4a_rle_crop_3798100238_0.png treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100257_0.png treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100259_0.png treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100262_0.png treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100278_0.png treat image : temp/1747257627_752540_1358319499_7dc0a6fbcab52ef08d2ed4116b7a1e64_rle_crop_3798100270_0.png treat image : temp/1747257627_752540_1358319620_c87ca3d32ccb9be4c449252ec6a86d40_rle_crop_3798100222_0.png treat image : temp/1747257627_752540_1358319551_4a7738ffeb5d65b615c44fa5646637e7_rle_crop_3798100255_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 111 time used for this insertion : 0.01669597625732422 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 111 time used for this insertion : 0.029202699661254883 save missing photos in datou_result : time spend for datou_step_exec : 6.742313861846924 time spend to save output : 0.05075955390930176 total time spend for step 7 : 6.793073415756226 step8:velours_tree Wed May 14 23:24:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.14292383193969727 time spend to save output : 5.269050598144531e-05 total time spend for step 8 : 0.1429765224456787 step9:send_mail_cod Wed May 14 23:24:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22982646_14-05-2025_23_24_29.pdf 22985535 imagette229855351747257869 22985537 imagette229855371747257869 22985538 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229855381747257869 22985539 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229855391747257870 22985540 imagette229855401747257871 22985541 change filename to text .change filename to text .imagette229855411747257871 22985542 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229855421747257871 22985543 imagette229855431747257872 22985544 change filename to text .change filename to text .change filename to text .imagette229855441747257872 22985545 imagette229855451747257872 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22982646 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22985535,22985536,22985537,22985538,22985539,22985540,22985541,22985542,22985543,22985544,22985545?tags=background,environnement,mal_croppe,pet_clair,papier,pehd,pet_fonce,carton,autre,metal,flou args[1358319669] : ((1358319669, -6.569349558347118, 492609224), (1358319669, 0.8118243951863185, 2107752395), '0.2198343219521605') We are sending mail with results at report@fotonower.com args[1358319620] : ((1358319620, -6.598643732659362, 492609224), (1358319620, 0.731499617093659, 2107752395), '0.2198343219521605') We are sending mail with results at report@fotonower.com args[1358319585] : ((1358319585, -6.639670935985679, 492609224), (1358319585, 0.41727655737885205, 2107752395), '0.2198343219521605') We are sending mail with results at report@fotonower.com args[1358319551] : ((1358319551, -5.70429223198436, 492609224), (1358319551, 0.2737850483357727, 2107752395), '0.2198343219521605') We are sending mail with results at report@fotonower.com args[1358319499] : ((1358319499, -5.007039342800613, 492609224), (1358319499, -0.4757609338914994, 496442774), '0.2198343219521605') We are sending mail with results at report@fotonower.com refus_total : 0.2198343219521605 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22982646 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22982646_14-05-2025_23_24_29.pdf results_Auto_P22982646_14-05-2025_23_24_29.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22982646_14-05-2025_23_24_29.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22982646','results_Auto_P22982646_14-05-2025_23_24_29.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22982646_14-05-2025_23_24_29.pdf','pdf','','1.04','0.2198343219521605') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22982646

https://www.fotonower.com/image?json=false&list_photos_id=1358319669
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358319620
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358319585
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358319551
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358319499
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 21.98%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/22985538?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22985539?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/22985541?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22985542?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/22985544?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22982646_14-05-2025_23_24_29.pdf.

Lien vers velours :https://www.fotonower.com/velours/22985535,22985536,22985537,22985538,22985539,22985540,22985541,22985542,22985543,22985544,22985545?tags=background,environnement,mal_croppe,pet_clair,papier,pehd,pet_fonce,carton,autre,metal,flou.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 14 May 2025 21:24:35 GMT Content-Length: 0 Connection: close X-Message-Id: SO0LVc5XRrywPzHkhSd3WQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1358319669, 1358319620, 1358319585, 1358319551, 1358319499] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319669', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319620', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319585', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319551', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319499', None, None, None, None, None, '2854873') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.012441873550415039 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.903893947601318 time spend to save output : 0.012625455856323242 total time spend for step 9 : 5.916519403457642 step10:split_time_score Wed May 14 23:24:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 5),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 14052025 22982646 Nombre de photos uploadées : 5 / 23040 (0%) 14052025 22982646 Nombre de photos taguées (types de déchets): 0 / 5 (0%) 14052025 22982646 Nombre de photos taguées (volume) : 0 / 5 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ????? elapsed_time : fill_and_build_computed_from_old_data 0.0003178119659423828 elapsed_time : insert_dashboard_record_day_entry 0.023348331451416016 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.15093270158179015 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22948162_14-05-2025_07_47_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22948162 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22948162 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22948165 order by id desc limit 1 Qualite : 0.09967562451774692 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22949538_14-05-2025_08_24_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22949538 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22949538 AND mptpi.`type`=3594 To do Qualite : 0.19506076388888893 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22953035_14-05-2025_10_24_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22953035 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22953035 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22955733 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22958945 order by id desc limit 1 Qualite : 0.16447810169110086 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22960477_14-05-2025_13_05_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22960477 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22960477 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22967472 order by id desc limit 1 Qualite : 0.12331786104681071 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22967479_14-05-2025_15_57_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22967479 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22967479 AND mptpi.`type`=3594 To do Qualite : 0.20919277722663138 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22967499_14-05-2025_15_46_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22967499 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22967499 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22974921 order by id desc limit 1 Qualite : 0.15173109266493065 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22974925_14-05-2025_19_13_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22974925 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22974925 AND mptpi.`type`=3594 To do Qualite : 0.1544977334104938 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22974926_14-05-2025_18_54_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22974926 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22974926 AND mptpi.`type`=3594 To do Qualite : 0.11856669560185185 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22976914_14-05-2025_19_54_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22976914 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22976914 AND mptpi.`type`=3594 To do Qualite : 0.07834983327821868 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22976916_14-05-2025_19_44_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22976916 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22976916 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22979633 order by id desc limit 1 Qualite : 0.2198343219521605 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22982646_14-05-2025_23_24_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22982646 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22982646 AND mptpi.`type`=3594 To do Qualite : 0.14339604751043938 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22982647_14-05-2025_22_33_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22982647 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22982647 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'14052025': {'nb_upload': 5, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1358319669, 1358319620, 1358319585, 1358319551, 1358319499] Looping around the photos to save general results len do output : 1 /22982646Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319669', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319620', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319585', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319551', None, None, None, None, None, '2854873') ('3318', None, None, None, None, None, None, None, '2854873') ('3318', '22982646', '1358319499', None, None, None, None, None, '2854873') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.014564752578735352 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.2838380336761475 time spend to save output : 0.01472330093383789 total time spend for step 10 : 6.298561334609985 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 5 set_done_treatment 124.97user 90.45system 4:15.58elapsed 84%CPU (0avgtext+0avgdata 5112752maxresident)k 526880inputs+154240outputs (178major+10074238minor)pagefaults 0swaps