python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2426679 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2647383'] with mtr_portfolio_ids : ['21136601'] and first list_photo_ids : [] new path : /proc/2426679/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 2.7132999897003174 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Mar 7 11:30:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3165 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-07 11:30:33.876612: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-07 11:30:33.888819: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-07 11:30:33.891002: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f0de4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-07 11:30:33.891082: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-07 11:30:33.895278: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-07 11:30:34.081441: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3e35e870 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-07 11:30:34.081502: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-07 11:30:34.082410: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-07 11:30:34.083246: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 11:30:34.086415: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 11:30:34.089341: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-07 11:30:34.089858: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-07 11:30:34.117527: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-07 11:30:34.122589: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-07 11:30:34.179907: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-07 11:30:34.182412: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-07 11:30:34.182926: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 11:30:34.184158: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-07 11:30:34.184178: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-07 11:30:34.184190: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-07 11:30:34.186353: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2562 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-07 11:30:34.635010: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-07 11:30:34.635186: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 11:30:34.635211: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 11:30:34.635231: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-07 11:30:34.635248: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-07 11:30:34.635266: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-07 11:30:34.635288: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-07 11:30:34.635309: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-07 11:30:34.636206: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-07 11:30:34.637448: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-07 11:30:34.637506: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 11:30:34.637526: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 11:30:34.637543: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-07 11:30:34.637562: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-07 11:30:34.637579: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-07 11:30:34.637595: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-07 11:30:34.637612: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-07 11:30:34.639003: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-07 11:30:34.639064: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-07 11:30:34.639077: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-07 11:30:34.639087: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-07 11:30:34.640808: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2562 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-07 11:30:49.124225: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 11:30:49.315290: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-07 11:30:51.085665: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-07 11:30:51.085767: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-07 11:30:51.096365: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-07 11:30:51.096417: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-07 11:30:51.106382: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.106421: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-07 11:30:51.106960: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.106980: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-07 11:30:51.202706: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-07 11:30:51.202735: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-07 11:30:51.215380: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.215403: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-07 11:30:51.215917: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.215935: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-07 11:30:51.311845: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.312385: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.423442: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.424285: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.462648: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.463535: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.469741: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.470812: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.491406: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.492251: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.497970: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.499030: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.510917: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.511623: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.516362: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.517160: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.598534: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.599211: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.599862: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.600512: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.612572: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.613441: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.654747: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.655506: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.656152: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.656867: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.684532: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.685217: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.686139: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.687198: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.706026: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.706790: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.717930: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.718595: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.738591: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.739323: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.745682: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.746353: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.746989: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.747628: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.748666: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.749319: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.768620: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.769394: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.770199: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.771037: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.772301: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.773412: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.830681: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.831622: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.868536: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.868622: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-03-07 11:30:51.869599: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.870551: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.878024: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.879076: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.887396: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.887992: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.914614: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.915685: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.916375: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.916921: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.921091: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.921671: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.922224: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.922795: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.925190: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.934279: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.934942: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.944325: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.944908: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.945480: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.946034: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.946592: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 11:30:51.947170: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.35000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.85000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.85000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 44 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.85000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.85000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.60000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.35000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 6.00000 max: 254.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.35000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 Detection mask done ! Trying to reset tf kernel 2427459 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1972 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3165 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00037479400634765625 nb_pixel_total : 12972 time to create 1 rle with old method : 0.015237808227539062 length of segment : 92 time for calcul the mask position with numpy : 0.0028493404388427734 nb_pixel_total : 109552 time to create 1 rle with old method : 0.12227845191955566 length of segment : 333 time for calcul the mask position with numpy : 0.0009856224060058594 nb_pixel_total : 39293 time to create 1 rle with old method : 0.05971407890319824 length of segment : 271 time for calcul the mask position with numpy : 0.0019481182098388672 nb_pixel_total : 105656 time to create 1 rle with old method : 0.1260669231414795 length of segment : 469 time for calcul the mask position with numpy : 0.004380464553833008 nb_pixel_total : 185182 time to create 1 rle with new method : 0.010871410369873047 length of segment : 418 time for calcul the mask position with numpy : 0.0007836818695068359 nb_pixel_total : 24350 time to create 1 rle with old method : 0.02840137481689453 length of segment : 256 time for calcul the mask position with numpy : 0.0003497600555419922 nb_pixel_total : 12401 time to create 1 rle with old method : 0.014037847518920898 length of segment : 99 time for calcul the mask position with numpy : 0.0005867481231689453 nb_pixel_total : 23637 time to create 1 rle with old method : 0.027450084686279297 length of segment : 233 time for calcul the mask position with numpy : 0.0008690357208251953 nb_pixel_total : 34246 time to create 1 rle with old method : 0.03868865966796875 length of segment : 217 time for calcul the mask position with numpy : 0.0004870891571044922 nb_pixel_total : 22907 time to create 1 rle with old method : 0.02605748176574707 length of segment : 230 time for calcul the mask position with numpy : 0.0005478858947753906 nb_pixel_total : 28569 time to create 1 rle with old method : 0.032566070556640625 length of segment : 254 time for calcul the mask position with numpy : 0.0009696483612060547 nb_pixel_total : 55815 time to create 1 rle with old method : 0.06766748428344727 length of segment : 288 time for calcul the mask position with numpy : 0.0008931159973144531 nb_pixel_total : 47357 time to create 1 rle with old method : 0.05695152282714844 length of segment : 265 time for calcul the mask position with numpy : 0.0014889240264892578 nb_pixel_total : 82554 time to create 1 rle with old method : 0.11699366569519043 length of segment : 335 time for calcul the mask position with numpy : 0.0025587081909179688 nb_pixel_total : 161084 time to create 1 rle with new method : 0.008396148681640625 length of segment : 506 time for calcul the mask position with numpy : 0.002399921417236328 nb_pixel_total : 161973 time to create 1 rle with new method : 0.009746789932250977 length of segment : 593 time for calcul the mask position with numpy : 0.32155323028564453 nb_pixel_total : 1567478 time to create 1 rle with new method : 0.5174827575683594 length of segment : 1976 time for calcul the mask position with numpy : 0.003778696060180664 nb_pixel_total : 136620 time to create 1 rle with old method : 0.2242124080657959 length of segment : 493 time for calcul the mask position with numpy : 0.005045890808105469 nb_pixel_total : 210932 time to create 1 rle with new method : 0.011796236038208008 length of segment : 665 time for calcul the mask position with numpy : 0.005799770355224609 nb_pixel_total : 144061 time to create 1 rle with old method : 0.1846766471862793 length of segment : 492 time for calcul the mask position with numpy : 0.012252330780029297 nb_pixel_total : 263740 time to create 1 rle with new method : 0.023159265518188477 length of segment : 768 time for calcul the mask position with numpy : 0.006717205047607422 nb_pixel_total : 196726 time to create 1 rle with new method : 0.008713245391845703 length of segment : 519 time for calcul the mask position with numpy : 0.003579378128051758 nb_pixel_total : 82997 time to create 1 rle with old method : 0.09532618522644043 length of segment : 357 time for calcul the mask position with numpy : 0.00471043586730957 nb_pixel_total : 124907 time to create 1 rle with old method : 0.151505708694458 length of segment : 334 time for calcul the mask position with numpy : 0.0030324459075927734 nb_pixel_total : 63566 time to create 1 rle with old method : 0.0770721435546875 length of segment : 392 time for calcul the mask position with numpy : 0.0008139610290527344 nb_pixel_total : 11980 time to create 1 rle with old method : 0.014126777648925781 length of segment : 133 time for calcul the mask position with numpy : 0.0007703304290771484 nb_pixel_total : 14951 time to create 1 rle with old method : 0.01735997200012207 length of segment : 113 time for calcul the mask position with numpy : 0.003728628158569336 nb_pixel_total : 88318 time to create 1 rle with old method : 0.11958146095275879 length of segment : 468 time for calcul the mask position with numpy : 0.001959085464477539 nb_pixel_total : 41815 time to create 1 rle with old method : 0.04750204086303711 length of segment : 306 time for calcul the mask position with numpy : 0.006407499313354492 nb_pixel_total : 104241 time to create 1 rle with old method : 0.12034916877746582 length of segment : 488 time for calcul the mask position with numpy : 0.0020771026611328125 nb_pixel_total : 53738 time to create 1 rle with old method : 0.06126236915588379 length of segment : 379 time for calcul the mask position with numpy : 0.0006718635559082031 nb_pixel_total : 16330 time to create 1 rle with old method : 0.019403457641601562 length of segment : 125 time for calcul the mask position with numpy : 0.019500255584716797 nb_pixel_total : 529401 time to create 1 rle with new method : 0.025537729263305664 length of segment : 945 time for calcul the mask position with numpy : 0.003202676773071289 nb_pixel_total : 98386 time to create 1 rle with old method : 0.1090996265411377 length of segment : 446 time for calcul the mask position with numpy : 0.0006356239318847656 nb_pixel_total : 11066 time to create 1 rle with old method : 0.012428760528564453 length of segment : 140 time for calcul the mask position with numpy : 0.0013461112976074219 nb_pixel_total : 50491 time to create 1 rle with old method : 0.0570986270904541 length of segment : 210 time for calcul the mask position with numpy : 0.0010974407196044922 nb_pixel_total : 38475 time to create 1 rle with old method : 0.044883012771606445 length of segment : 284 time for calcul the mask position with numpy : 0.00042319297790527344 nb_pixel_total : 10282 time to create 1 rle with old method : 0.011864662170410156 length of segment : 115 time for calcul the mask position with numpy : 0.0007266998291015625 nb_pixel_total : 17253 time to create 1 rle with old method : 0.019966840744018555 length of segment : 306 time for calcul the mask position with numpy : 0.002588510513305664 nb_pixel_total : 41650 time to create 1 rle with old method : 0.04604291915893555 length of segment : 384 time for calcul the mask position with numpy : 0.0045392513275146484 nb_pixel_total : 108916 time to create 1 rle with old method : 0.12466812133789062 length of segment : 399 time for calcul the mask position with numpy : 0.001596212387084961 nb_pixel_total : 44119 time to create 1 rle with old method : 0.05449366569519043 length of segment : 252 time for calcul the mask position with numpy : 0.0006003379821777344 nb_pixel_total : 13258 time to create 1 rle with old method : 0.022162675857543945 length of segment : 198 time for calcul the mask position with numpy : 0.0026352405548095703 nb_pixel_total : 90222 time to create 1 rle with old method : 0.10133504867553711 length of segment : 274 time for calcul the mask position with numpy : 0.00441288948059082 nb_pixel_total : 141827 time to create 1 rle with old method : 0.17938613891601562 length of segment : 429 time for calcul the mask position with numpy : 0.005625009536743164 nb_pixel_total : 152565 time to create 1 rle with new method : 0.009496688842773438 length of segment : 451 time for calcul the mask position with numpy : 0.005664348602294922 nb_pixel_total : 120219 time to create 1 rle with old method : 0.13232922554016113 length of segment : 580 time for calcul the mask position with numpy : 0.002223491668701172 nb_pixel_total : 51572 time to create 1 rle with old method : 0.05825543403625488 length of segment : 347 time for calcul the mask position with numpy : 0.0005235671997070312 nb_pixel_total : 8895 time to create 1 rle with old method : 0.010416507720947266 length of segment : 111 time for calcul the mask position with numpy : 0.0011334419250488281 nb_pixel_total : 31197 time to create 1 rle with old method : 0.03566122055053711 length of segment : 276 time for calcul the mask position with numpy : 0.0006425380706787109 nb_pixel_total : 13530 time to create 1 rle with old method : 0.01565694808959961 length of segment : 157 time for calcul the mask position with numpy : 0.006089448928833008 nb_pixel_total : 174880 time to create 1 rle with new method : 0.010223865509033203 length of segment : 527 time for calcul the mask position with numpy : 0.0010886192321777344 nb_pixel_total : 17725 time to create 1 rle with old method : 0.020520687103271484 length of segment : 263 time for calcul the mask position with numpy : 0.005023479461669922 nb_pixel_total : 111895 time to create 1 rle with old method : 0.15226054191589355 length of segment : 694 time for calcul the mask position with numpy : 0.0007088184356689453 nb_pixel_total : 17382 time to create 1 rle with old method : 0.020069360733032227 length of segment : 184 time for calcul the mask position with numpy : 0.0007467269897460938 nb_pixel_total : 11833 time to create 1 rle with old method : 0.014754056930541992 length of segment : 175 time for calcul the mask position with numpy : 0.008442878723144531 nb_pixel_total : 212681 time to create 1 rle with new method : 0.011900186538696289 length of segment : 836 time for calcul the mask position with numpy : 0.0016045570373535156 nb_pixel_total : 36897 time to create 1 rle with old method : 0.04135584831237793 length of segment : 179 time for calcul the mask position with numpy : 0.0012907981872558594 nb_pixel_total : 31114 time to create 1 rle with old method : 0.03531455993652344 length of segment : 464 time for calcul the mask position with numpy : 0.001047372817993164 nb_pixel_total : 18125 time to create 1 rle with old method : 0.020766496658325195 length of segment : 260 time for calcul the mask position with numpy : 0.0030295848846435547 nb_pixel_total : 107501 time to create 1 rle with old method : 0.11804580688476562 length of segment : 211 time for calcul the mask position with numpy : 0.0007622241973876953 nb_pixel_total : 15193 time to create 1 rle with old method : 0.017307043075561523 length of segment : 181 time for calcul the mask position with numpy : 0.0018610954284667969 nb_pixel_total : 43268 time to create 1 rle with old method : 0.04792428016662598 length of segment : 240 time for calcul the mask position with numpy : 0.0005183219909667969 nb_pixel_total : 9907 time to create 1 rle with old method : 0.011085033416748047 length of segment : 164 time for calcul the mask position with numpy : 0.001171112060546875 nb_pixel_total : 32921 time to create 1 rle with old method : 0.03969860076904297 length of segment : 195 time for calcul the mask position with numpy : 0.007016897201538086 nb_pixel_total : 146492 time to create 1 rle with old method : 0.207322359085083 length of segment : 537 time for calcul the mask position with numpy : 0.0017366409301757812 nb_pixel_total : 48869 time to create 1 rle with old method : 0.05328655242919922 length of segment : 253 time for calcul the mask position with numpy : 0.0005347728729248047 nb_pixel_total : 13874 time to create 1 rle with old method : 0.015188217163085938 length of segment : 156 time for calcul the mask position with numpy : 0.002850770950317383 nb_pixel_total : 77184 time to create 1 rle with old method : 0.08762979507446289 length of segment : 485 time for calcul the mask position with numpy : 0.0072002410888671875 nb_pixel_total : 240222 time to create 1 rle with new method : 0.01016545295715332 length of segment : 964 time for calcul the mask position with numpy : 0.0013222694396972656 nb_pixel_total : 39490 time to create 1 rle with old method : 0.04448652267456055 length of segment : 1053 time for calcul the mask position with numpy : 0.008024930953979492 nb_pixel_total : 234299 time to create 1 rle with new method : 0.011580228805541992 length of segment : 700 time for calcul the mask position with numpy : 0.0054433345794677734 nb_pixel_total : 149392 time to create 1 rle with old method : 0.1660902500152588 length of segment : 597 time for calcul the mask position with numpy : 0.0003566741943359375 nb_pixel_total : 11050 time to create 1 rle with old method : 0.01403951644897461 length of segment : 154 time for calcul the mask position with numpy : 0.0010104179382324219 nb_pixel_total : 31506 time to create 1 rle with old method : 0.03594231605529785 length of segment : 213 time for calcul the mask position with numpy : 0.0013532638549804688 nb_pixel_total : 29241 time to create 1 rle with old method : 0.04334688186645508 length of segment : 246 time for calcul the mask position with numpy : 0.003425121307373047 nb_pixel_total : 62849 time to create 1 rle with old method : 0.08081579208374023 length of segment : 402 time for calcul the mask position with numpy : 0.0008528232574462891 nb_pixel_total : 36249 time to create 1 rle with old method : 0.04314732551574707 length of segment : 364 time for calcul the mask position with numpy : 0.0020399093627929688 nb_pixel_total : 22970 time to create 1 rle with old method : 0.05190849304199219 length of segment : 186 time for calcul the mask position with numpy : 0.006796360015869141 nb_pixel_total : 229731 time to create 1 rle with new method : 0.011588096618652344 length of segment : 699 time for calcul the mask position with numpy : 0.00052642822265625 nb_pixel_total : 7075 time to create 1 rle with old method : 0.0085296630859375 length of segment : 307 time for calcul the mask position with numpy : 0.0014672279357910156 nb_pixel_total : 32645 time to create 1 rle with old method : 0.036894798278808594 length of segment : 224 time for calcul the mask position with numpy : 0.006986141204833984 nb_pixel_total : 205981 time to create 1 rle with new method : 0.008906364440917969 length of segment : 488 time for calcul the mask position with numpy : 0.0019910335540771484 nb_pixel_total : 40458 time to create 1 rle with old method : 0.06705713272094727 length of segment : 160 time for calcul the mask position with numpy : 0.006033182144165039 nb_pixel_total : 129941 time to create 1 rle with old method : 0.1437697410583496 length of segment : 539 time for calcul the mask position with numpy : 0.0025815963745117188 nb_pixel_total : 87707 time to create 1 rle with old method : 0.09517693519592285 length of segment : 228 time for calcul the mask position with numpy : 0.0018396377563476562 nb_pixel_total : 34655 time to create 1 rle with old method : 0.038420915603637695 length of segment : 372 time for calcul the mask position with numpy : 0.0020456314086914062 nb_pixel_total : 62372 time to create 1 rle with old method : 0.06746602058410645 length of segment : 239 time for calcul the mask position with numpy : 0.0044863224029541016 nb_pixel_total : 138093 time to create 1 rle with old method : 0.1504969596862793 length of segment : 531 time for calcul the mask position with numpy : 0.001844167709350586 nb_pixel_total : 45842 time to create 1 rle with old method : 0.05105900764465332 length of segment : 193 time for calcul the mask position with numpy : 0.003711223602294922 nb_pixel_total : 117129 time to create 1 rle with old method : 0.12934637069702148 length of segment : 570 time for calcul the mask position with numpy : 0.000530242919921875 nb_pixel_total : 15181 time to create 1 rle with old method : 0.017108678817749023 length of segment : 141 time for calcul the mask position with numpy : 0.025722265243530273 nb_pixel_total : 729186 time to create 1 rle with new method : 0.13782978057861328 length of segment : 1528 time for calcul the mask position with numpy : 0.00448298454284668 nb_pixel_total : 113957 time to create 1 rle with old method : 0.12473320960998535 length of segment : 418 time for calcul the mask position with numpy : 0.0010483264923095703 nb_pixel_total : 32363 time to create 1 rle with old method : 0.03609800338745117 length of segment : 129 time for calcul the mask position with numpy : 0.007643222808837891 nb_pixel_total : 226508 time to create 1 rle with new method : 0.01319742202758789 length of segment : 808 time for calcul the mask position with numpy : 0.0014526844024658203 nb_pixel_total : 36220 time to create 1 rle with old method : 0.04069113731384277 length of segment : 106 time for calcul the mask position with numpy : 0.002390146255493164 nb_pixel_total : 73332 time to create 1 rle with old method : 0.08045220375061035 length of segment : 357 time for calcul the mask position with numpy : 0.005089521408081055 nb_pixel_total : 151528 time to create 1 rle with new method : 0.005616426467895508 length of segment : 448 time for calcul the mask position with numpy : 0.0014998912811279297 nb_pixel_total : 31599 time to create 1 rle with old method : 0.038338661193847656 length of segment : 254 time for calcul the mask position with numpy : 0.0033893585205078125 nb_pixel_total : 113239 time to create 1 rle with old method : 0.12242627143859863 length of segment : 529 time for calcul the mask position with numpy : 0.0006215572357177734 nb_pixel_total : 12686 time to create 1 rle with old method : 0.01363229751586914 length of segment : 142 time for calcul the mask position with numpy : 0.0027260780334472656 nb_pixel_total : 56621 time to create 1 rle with old method : 0.06151843070983887 length of segment : 616 time for calcul the mask position with numpy : 0.02031111717224121 nb_pixel_total : 799254 time to create 1 rle with new method : 0.03260493278503418 length of segment : 988 time for calcul the mask position with numpy : 0.0020847320556640625 nb_pixel_total : 49615 time to create 1 rle with old method : 0.05529165267944336 length of segment : 349 time for calcul the mask position with numpy : 0.0005190372467041016 nb_pixel_total : 12040 time to create 1 rle with old method : 0.013597726821899414 length of segment : 164 time for calcul the mask position with numpy : 0.001068115234375 nb_pixel_total : 23813 time to create 1 rle with old method : 0.030292987823486328 length of segment : 126 time for calcul the mask position with numpy : 0.0025458335876464844 nb_pixel_total : 61661 time to create 1 rle with old method : 0.07307982444763184 length of segment : 193 time for calcul the mask position with numpy : 0.004475831985473633 nb_pixel_total : 113938 time to create 1 rle with old method : 0.12659478187561035 length of segment : 495 time for calcul the mask position with numpy : 0.0034613609313964844 nb_pixel_total : 79579 time to create 1 rle with old method : 0.09204888343811035 length of segment : 711 time for calcul the mask position with numpy : 0.007710695266723633 nb_pixel_total : 319005 time to create 1 rle with new method : 0.012178421020507812 length of segment : 571 time for calcul the mask position with numpy : 0.0042874813079833984 nb_pixel_total : 185878 time to create 1 rle with new method : 0.00627446174621582 length of segment : 588 time for calcul the mask position with numpy : 0.002830982208251953 nb_pixel_total : 141649 time to create 1 rle with old method : 0.15702533721923828 length of segment : 369 time for calcul the mask position with numpy : 0.0013394355773925781 nb_pixel_total : 50298 time to create 1 rle with old method : 0.056641340255737305 length of segment : 330 time for calcul the mask position with numpy : 0.0008702278137207031 nb_pixel_total : 26055 time to create 1 rle with old method : 0.02992868423461914 length of segment : 223 time for calcul the mask position with numpy : 0.0027620792388916016 nb_pixel_total : 117225 time to create 1 rle with old method : 0.12792158126831055 length of segment : 546 time for calcul the mask position with numpy : 0.0012524127960205078 nb_pixel_total : 58770 time to create 1 rle with old method : 0.06641602516174316 length of segment : 195 time for calcul the mask position with numpy : 0.0011897087097167969 nb_pixel_total : 72269 time to create 1 rle with old method : 0.08291101455688477 length of segment : 402 time for calcul the mask position with numpy : 0.0021119117736816406 nb_pixel_total : 55223 time to create 1 rle with old method : 0.06328082084655762 length of segment : 396 time for calcul the mask position with numpy : 0.0009424686431884766 nb_pixel_total : 39395 time to create 1 rle with old method : 0.0448298454284668 length of segment : 414 time for calcul the mask position with numpy : 0.00036716461181640625 nb_pixel_total : 14546 time to create 1 rle with old method : 0.023868799209594727 length of segment : 318 time for calcul the mask position with numpy : 0.0015950202941894531 nb_pixel_total : 100706 time to create 1 rle with old method : 0.11118030548095703 length of segment : 506 time for calcul the mask position with numpy : 0.001936197280883789 nb_pixel_total : 82389 time to create 1 rle with old method : 0.11775064468383789 length of segment : 501 time spent for convertir_results : 16.540356397628784 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 123 chid ids of type : 3594 Number RLEs to save : 48465 save missing photos in datou_result : time spend for datou_step_exec : 95.20007681846619 time spend to save output : 2.779909372329712 total time spend for step 1 : 97.9799861907959 step2:crop_condition Fri Mar 7 11:32:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 123 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 79 About to insert : list_path_to_insert length 79 new photo from crops ! About to upload 79 photos upload in portfolio : 3736932 init cache_photo without model_param we have 79 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741343559_2426679 we have uploaded 79 photos in the portfolio 3736932 time of upload the photos Elapsed time : 42.59150695800781 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 18 About to insert : list_path_to_insert length 18 new photo from crops ! About to upload 18 photos upload in portfolio : 3736932 init cache_photo without model_param we have 18 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741343609_2426679 we have uploaded 18 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.0019636154174805 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741343616_2426679 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6869230270385742 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 3736932 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741343640_2426679 we have uploaded 21 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.195165634155273 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741343650_2426679 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8231761455535889 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741343653_2426679 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.892462968826294 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1327677593, 1327677589, 1327677585, 1327677583, 1327677579, 1327677575, 1327677574, 1327677566] Looping around the photos to save general results len do output : 123 /1341440713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341440830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341441408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677593', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677589', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677585', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677583', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677579', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677575', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677574', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677566', None, None, None, None, None, '2647383') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 377 time used for this insertion : 0.028090715408325195 save_final save missing photos in datou_result : time spend for datou_step_exec : 124.98509955406189 time spend to save output : 0.03102278709411621 total time spend for step 2 : 125.016122341156 step3:rle_unique_nms_with_priority Fri Mar 7 11:34:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 123 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 13 nb_hashtags : 2 time to prepare the origin masks : 6.940742254257202 time for calcul the mask position with numpy : 0.5580737590789795 nb_pixel_total : 7616019 time to create 1 rle with new method : 1.1623387336730957 time for calcul the mask position with numpy : 0.04295921325683594 nb_pixel_total : 47357 time to create 1 rle with old method : 0.05270648002624512 time for calcul the mask position with numpy : 0.0267026424407959 nb_pixel_total : 55815 time to create 1 rle with old method : 0.06228303909301758 time for calcul the mask position with numpy : 0.02580714225769043 nb_pixel_total : 28569 time to create 1 rle with old method : 0.0315704345703125 time for calcul the mask position with numpy : 0.026554584503173828 nb_pixel_total : 22907 time to create 1 rle with old method : 0.026752710342407227 time for calcul the mask position with numpy : 0.026242971420288086 nb_pixel_total : 34246 time to create 1 rle with old method : 0.03790593147277832 time for calcul the mask position with numpy : 0.025148630142211914 nb_pixel_total : 418 time to create 1 rle with old method : 0.0006392002105712891 time for calcul the mask position with numpy : 0.025120019912719727 nb_pixel_total : 12401 time to create 1 rle with old method : 0.013775825500488281 time for calcul the mask position with numpy : 0.026170969009399414 nb_pixel_total : 24350 time to create 1 rle with old method : 0.027094602584838867 time for calcul the mask position with numpy : 0.028798580169677734 nb_pixel_total : 184845 time to create 1 rle with new method : 0.8464274406433105 time for calcul the mask position with numpy : 0.027302026748657227 nb_pixel_total : 105656 time to create 1 rle with old method : 0.11447358131408691 time for calcul the mask position with numpy : 0.026236534118652344 nb_pixel_total : 39293 time to create 1 rle with old method : 0.04352259635925293 time for calcul the mask position with numpy : 0.02662968635559082 nb_pixel_total : 109552 time to create 1 rle with old method : 0.11954855918884277 time for calcul the mask position with numpy : 0.02458047866821289 nb_pixel_total : 12972 time to create 1 rle with old method : 0.014191150665283203 create new chi : 3.537726879119873 time to delete rle : 0.018075942993164062 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++Number RLEs to save : 8659 TO DO : save crop sub photo not yet done ! save time : 0.5192444324493408 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 3.8799614906311035 time for calcul the mask position with numpy : 0.4475984573364258 nb_pixel_total : 6098790 time to create 1 rle with new method : 1.2135207653045654 time for calcul the mask position with numpy : 0.029003381729125977 nb_pixel_total : 210932 time to create 1 rle with new method : 0.936028242111206 time for calcul the mask position with numpy : 0.026650190353393555 nb_pixel_total : 11649 time to create 1 rle with old method : 0.013094663619995117 time for calcul the mask position with numpy : 0.04290318489074707 nb_pixel_total : 1567418 time to create 1 rle with new method : 1.2526922225952148 time for calcul the mask position with numpy : 0.04366588592529297 nb_pixel_total : 161973 time to create 1 rle with new method : 1.1915807723999023 time for calcul the mask position with numpy : 0.04443764686584473 nb_pixel_total : 161084 time to create 1 rle with new method : 1.0564994812011719 time for calcul the mask position with numpy : 0.0455169677734375 nb_pixel_total : 82554 time to create 1 rle with old method : 0.09427595138549805 create new chi : 6.608811140060425 time to delete rle : 0.002820730209350586 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 10387 TO DO : save crop sub photo not yet done ! save time : 0.6576871871948242 nb_obj : 24 nb_hashtags : 5 time to prepare the origin masks : 13.059792518615723 time for calcul the mask position with numpy : 0.6898319721221924 nb_pixel_total : 6177710 time to create 1 rle with new method : 1.4709100723266602 time for calcul the mask position with numpy : 0.04502701759338379 nb_pixel_total : 13171 time to create 1 rle with old method : 0.014915227890014648 time for calcul the mask position with numpy : 0.04311847686767578 nb_pixel_total : 44119 time to create 1 rle with old method : 0.0489802360534668 time for calcul the mask position with numpy : 0.04021573066711426 nb_pixel_total : 108916 time to create 1 rle with old method : 0.12153148651123047 time for calcul the mask position with numpy : 0.04318046569824219 nb_pixel_total : 41650 time to create 1 rle with old method : 0.04665517807006836 time for calcul the mask position with numpy : 0.04371237754821777 nb_pixel_total : 15896 time to create 1 rle with old method : 0.020511388778686523 time for calcul the mask position with numpy : 0.04318737983703613 nb_pixel_total : 10282 time to create 1 rle with old method : 0.01170039176940918 time for calcul the mask position with numpy : 0.04761314392089844 nb_pixel_total : 38475 time to create 1 rle with old method : 0.05930685997009277 time for calcul the mask position with numpy : 0.04214882850646973 nb_pixel_total : 50491 time to create 1 rle with old method : 0.056648969650268555 time for calcul the mask position with numpy : 0.04120278358459473 nb_pixel_total : 11066 time to create 1 rle with old method : 0.012552499771118164 time for calcul the mask position with numpy : 0.04172253608703613 nb_pixel_total : 45853 time to create 1 rle with old method : 0.05247163772583008 time for calcul the mask position with numpy : 0.05068063735961914 nb_pixel_total : 529401 time to create 1 rle with new method : 0.6194314956665039 time for calcul the mask position with numpy : 0.04490947723388672 nb_pixel_total : 16330 time to create 1 rle with old method : 0.018499135971069336 time for calcul the mask position with numpy : 0.04888606071472168 nb_pixel_total : 53738 time to create 1 rle with old method : 0.0868215560913086 time for calcul the mask position with numpy : 0.04679679870605469 nb_pixel_total : 104241 time to create 1 rle with old method : 0.11676859855651855 time for calcul the mask position with numpy : 0.04390120506286621 nb_pixel_total : 41815 time to create 1 rle with old method : 0.04659461975097656 time for calcul the mask position with numpy : 0.042960405349731445 nb_pixel_total : 88318 time to create 1 rle with old method : 0.10188889503479004 time for calcul the mask position with numpy : 0.04272603988647461 nb_pixel_total : 14951 time to create 1 rle with old method : 0.01682114601135254 time for calcul the mask position with numpy : 0.04297995567321777 nb_pixel_total : 11980 time to create 1 rle with old method : 0.013509511947631836 time for calcul the mask position with numpy : 0.04105830192565918 nb_pixel_total : 63566 time to create 1 rle with old method : 0.10601234436035156 time for calcul the mask position with numpy : 0.048137664794921875 nb_pixel_total : 124907 time to create 1 rle with old method : 0.16475605964660645 time for calcul the mask position with numpy : 0.05099201202392578 nb_pixel_total : 82997 time to create 1 rle with old method : 0.09299445152282715 time for calcul the mask position with numpy : 0.04894256591796875 nb_pixel_total : 196726 time to create 1 rle with new method : 0.596590518951416 time for calcul the mask position with numpy : 0.04322099685668945 nb_pixel_total : 263740 time to create 1 rle with new method : 1.0586988925933838 time for calcul the mask position with numpy : 0.04150843620300293 nb_pixel_total : 144061 time to create 1 rle with old method : 0.16574668884277344 create new chi : 7.031422138214111 time to delete rle : 0.0054090023040771484 batch 1 Loaded 49 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++Number RLEs to save : 18790 TO DO : save crop sub photo not yet done ! save time : 1.102647066116333 nb_obj : 20 nb_hashtags : 3 time to prepare the origin masks : 11.634702205657959 time for calcul the mask position with numpy : 0.8527543544769287 nb_pixel_total : 6903003 time to create 1 rle with new method : 0.9298007488250732 time for calcul the mask position with numpy : 0.04106307029724121 nb_pixel_total : 43268 time to create 1 rle with old method : 0.04820370674133301 time for calcul the mask position with numpy : 0.04333329200744629 nb_pixel_total : 15186 time to create 1 rle with old method : 0.022239208221435547 time for calcul the mask position with numpy : 0.045592546463012695 nb_pixel_total : 107501 time to create 1 rle with old method : 0.1376209259033203 time for calcul the mask position with numpy : 0.04342484474182129 nb_pixel_total : 18125 time to create 1 rle with old method : 0.022233009338378906 time for calcul the mask position with numpy : 0.04613161087036133 nb_pixel_total : 13997 time to create 1 rle with old method : 0.016688108444213867 time for calcul the mask position with numpy : 0.04247021675109863 nb_pixel_total : 36897 time to create 1 rle with old method : 0.04021453857421875 time for calcul the mask position with numpy : 0.04314732551574707 nb_pixel_total : 212681 time to create 1 rle with new method : 0.7399430274963379 time for calcul the mask position with numpy : 0.0508420467376709 nb_pixel_total : 11833 time to create 1 rle with old method : 0.013880729675292969 time for calcul the mask position with numpy : 0.04305219650268555 nb_pixel_total : 17382 time to create 1 rle with old method : 0.020595073699951172 time for calcul the mask position with numpy : 0.045363664627075195 nb_pixel_total : 111895 time to create 1 rle with old method : 0.12601065635681152 time for calcul the mask position with numpy : 0.0422053337097168 nb_pixel_total : 17725 time to create 1 rle with old method : 0.019516944885253906 time for calcul the mask position with numpy : 0.043604373931884766 nb_pixel_total : 174880 time to create 1 rle with new method : 0.9666252136230469 time for calcul the mask position with numpy : 0.04439067840576172 nb_pixel_total : 13530 time to create 1 rle with old method : 0.015343189239501953 time for calcul the mask position with numpy : 0.04189300537109375 nb_pixel_total : 31197 time to create 1 rle with old method : 0.03492093086242676 time for calcul the mask position with numpy : 0.03983902931213379 nb_pixel_total : 8895 time to create 1 rle with old method : 0.010079622268676758 time for calcul the mask position with numpy : 0.04118919372558594 nb_pixel_total : 51572 time to create 1 rle with old method : 0.059656620025634766 time for calcul the mask position with numpy : 0.04209494590759277 nb_pixel_total : 120219 time to create 1 rle with old method : 0.1341724395751953 time for calcul the mask position with numpy : 0.04255867004394531 nb_pixel_total : 152565 time to create 1 rle with new method : 1.0604729652404785 time for calcul the mask position with numpy : 0.031080245971679688 nb_pixel_total : 141827 time to create 1 rle with old method : 0.1564159393310547 time for calcul the mask position with numpy : 0.037560224533081055 nb_pixel_total : 90222 time to create 1 rle with old method : 0.10216403007507324 create new chi : 6.522977828979492 time to delete rle : 0.003820657730102539 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 15385 TO DO : save crop sub photo not yet done ! save time : 1.4569900035858154 nb_obj : 19 nb_hashtags : 4 time to prepare the origin masks : 11.200539588928223 time for calcul the mask position with numpy : 0.5383481979370117 nb_pixel_total : 6873090 time to create 1 rle with new method : 0.7900588512420654 time for calcul the mask position with numpy : 0.043154239654541016 nb_pixel_total : 32645 time to create 1 rle with old method : 0.039102792739868164 time for calcul the mask position with numpy : 0.04695844650268555 nb_pixel_total : 5674 time to create 1 rle with old method : 0.0065915584564208984 time for calcul the mask position with numpy : 0.04811668395996094 nb_pixel_total : 229731 time to create 1 rle with new method : 0.8179278373718262 time for calcul the mask position with numpy : 0.04257965087890625 nb_pixel_total : 22970 time to create 1 rle with old method : 0.02576446533203125 time for calcul the mask position with numpy : 0.04055166244506836 nb_pixel_total : 36249 time to create 1 rle with old method : 0.040728092193603516 time for calcul the mask position with numpy : 0.04026675224304199 nb_pixel_total : 62849 time to create 1 rle with old method : 0.07559609413146973 time for calcul the mask position with numpy : 0.040750980377197266 nb_pixel_total : 29241 time to create 1 rle with old method : 0.03249788284301758 time for calcul the mask position with numpy : 0.04112863540649414 nb_pixel_total : 31506 time to create 1 rle with old method : 0.034890174865722656 time for calcul the mask position with numpy : 0.040200233459472656 nb_pixel_total : 3440 time to create 1 rle with old method : 0.004004001617431641 time for calcul the mask position with numpy : 0.04158377647399902 nb_pixel_total : 149392 time to create 1 rle with old method : 0.1650846004486084 time for calcul the mask position with numpy : 0.03239607810974121 nb_pixel_total : 234299 time to create 1 rle with new method : 0.6500816345214844 time for calcul the mask position with numpy : 0.034052133560180664 nb_pixel_total : 13845 time to create 1 rle with old method : 0.02989792823791504 time for calcul the mask position with numpy : 0.048001766204833984 nb_pixel_total : 240222 time to create 1 rle with new method : 1.007173776626587 time for calcul the mask position with numpy : 0.0428614616394043 nb_pixel_total : 77184 time to create 1 rle with old method : 0.0965127944946289 time for calcul the mask position with numpy : 0.04513835906982422 nb_pixel_total : 13874 time to create 1 rle with old method : 0.0167539119720459 time for calcul the mask position with numpy : 0.043204307556152344 nb_pixel_total : 48869 time to create 1 rle with old method : 0.0625917911529541 time for calcul the mask position with numpy : 0.04124736785888672 nb_pixel_total : 146492 time to create 1 rle with old method : 0.18366408348083496 time for calcul the mask position with numpy : 0.04837775230407715 nb_pixel_total : 32921 time to create 1 rle with old method : 0.04093289375305176 time for calcul the mask position with numpy : 0.040589094161987305 nb_pixel_total : 9907 time to create 1 rle with old method : 0.013738870620727539 create new chi : 5.614217042922974 time to delete rle : 0.003760099411010742 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++Number RLEs to save : 16626 TO DO : save crop sub photo not yet done ! save time : 0.9901416301727295 nb_obj : 14 nb_hashtags : 5 time to prepare the origin masks : 10.66559362411499 time for calcul the mask position with numpy : 0.43976545333862305 nb_pixel_total : 6326984 time to create 1 rle with new method : 0.7431979179382324 time for calcul the mask position with numpy : 0.04398322105407715 nb_pixel_total : 226508 time to create 1 rle with new method : 0.7780132293701172 time for calcul the mask position with numpy : 0.04759573936462402 nb_pixel_total : 32363 time to create 1 rle with old method : 0.051397085189819336 time for calcul the mask position with numpy : 0.0538790225982666 nb_pixel_total : 113957 time to create 1 rle with old method : 0.14583539962768555 time for calcul the mask position with numpy : 0.05782318115234375 nb_pixel_total : 721835 time to create 1 rle with new method : 0.5282633304595947 time for calcul the mask position with numpy : 0.0407254695892334 nb_pixel_total : 15181 time to create 1 rle with old method : 0.01752305030822754 time for calcul the mask position with numpy : 0.04276132583618164 nb_pixel_total : 117129 time to create 1 rle with old method : 0.1350255012512207 time for calcul the mask position with numpy : 0.04364895820617676 nb_pixel_total : 45842 time to create 1 rle with old method : 0.0534062385559082 time for calcul the mask position with numpy : 0.04520869255065918 nb_pixel_total : 138093 time to create 1 rle with old method : 0.15496015548706055 time for calcul the mask position with numpy : 0.04252219200134277 nb_pixel_total : 62372 time to create 1 rle with old method : 0.06918120384216309 time for calcul the mask position with numpy : 0.04329991340637207 nb_pixel_total : 34655 time to create 1 rle with old method : 0.03872179985046387 time for calcul the mask position with numpy : 0.05235648155212402 nb_pixel_total : 87707 time to create 1 rle with old method : 0.1019904613494873 time for calcul the mask position with numpy : 0.04257774353027344 nb_pixel_total : 125335 time to create 1 rle with old method : 0.1462841033935547 time for calcul the mask position with numpy : 0.043932437896728516 nb_pixel_total : 40458 time to create 1 rle with old method : 0.0533294677734375 time for calcul the mask position with numpy : 0.05314064025878906 nb_pixel_total : 205981 time to create 1 rle with new method : 1.2968876361846924 create new chi : 5.5514748096466064 time to delete rle : 0.004769802093505859 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 14586 TO DO : save crop sub photo not yet done ! save time : 0.9749047756195068 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 9.525485754013062 time for calcul the mask position with numpy : 0.6904563903808594 nb_pixel_total : 6703912 time to create 1 rle with new method : 0.9075956344604492 time for calcul the mask position with numpy : 0.03843259811401367 nb_pixel_total : 79579 time to create 1 rle with old method : 0.0912468433380127 time for calcul the mask position with numpy : 0.03525662422180176 nb_pixel_total : 89390 time to create 1 rle with old method : 0.10404849052429199 time for calcul the mask position with numpy : 0.028866291046142578 nb_pixel_total : 61572 time to create 1 rle with old method : 0.07476377487182617 time for calcul the mask position with numpy : 0.04508543014526367 nb_pixel_total : 23813 time to create 1 rle with old method : 0.027924537658691406 time for calcul the mask position with numpy : 0.0460813045501709 nb_pixel_total : 12040 time to create 1 rle with old method : 0.013571739196777344 time for calcul the mask position with numpy : 0.046594858169555664 nb_pixel_total : 49615 time to create 1 rle with old method : 0.05483865737915039 time for calcul the mask position with numpy : 0.05156302452087402 nb_pixel_total : 799254 time to create 1 rle with new method : 0.6879124641418457 time for calcul the mask position with numpy : 0.0492706298828125 nb_pixel_total : 56621 time to create 1 rle with old method : 0.09415221214294434 time for calcul the mask position with numpy : 0.040915727615356445 nb_pixel_total : 12686 time to create 1 rle with old method : 0.014113664627075195 time for calcul the mask position with numpy : 0.03435540199279785 nb_pixel_total : 113239 time to create 1 rle with old method : 0.13376545906066895 time for calcul the mask position with numpy : 0.034734249114990234 nb_pixel_total : 31599 time to create 1 rle with old method : 0.03497314453125 time for calcul the mask position with numpy : 0.03587937355041504 nb_pixel_total : 151528 time to create 1 rle with new method : 0.7701714038848877 time for calcul the mask position with numpy : 0.02819085121154785 nb_pixel_total : 73332 time to create 1 rle with old method : 0.11535906791687012 time for calcul the mask position with numpy : 0.02731609344482422 nb_pixel_total : 36220 time to create 1 rle with old method : 0.04255795478820801 create new chi : 4.515009164810181 time to delete rle : 0.002735614776611328 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 12884 TO DO : save crop sub photo not yet done ! save time : 0.8162376880645752 nb_obj : 13 nb_hashtags : 2 time to prepare the origin masks : 6.256821155548096 time for calcul the mask position with numpy : 0.7494471073150635 nb_pixel_total : 7139048 time to create 1 rle with new method : 0.6442279815673828 time for calcul the mask position with numpy : 0.04699873924255371 nb_pixel_total : 82273 time to create 1 rle with old method : 0.09857583045959473 time for calcul the mask position with numpy : 0.04356551170349121 nb_pixel_total : 5628 time to create 1 rle with old method : 0.007096052169799805 time for calcul the mask position with numpy : 0.04252028465270996 nb_pixel_total : 2527 time to create 1 rle with old method : 0.0031147003173828125 time for calcul the mask position with numpy : 0.04396867752075195 nb_pixel_total : 39395 time to create 1 rle with old method : 0.04393172264099121 time for calcul the mask position with numpy : 0.04386281967163086 nb_pixel_total : 55223 time to create 1 rle with old method : 0.061731576919555664 time for calcul the mask position with numpy : 0.04302191734313965 nb_pixel_total : 72269 time to create 1 rle with old method : 0.08371877670288086 time for calcul the mask position with numpy : 0.04378986358642578 nb_pixel_total : 58770 time to create 1 rle with old method : 0.07018518447875977 time for calcul the mask position with numpy : 0.04282093048095703 nb_pixel_total : 116382 time to create 1 rle with old method : 0.12972760200500488 time for calcul the mask position with numpy : 0.0425875186920166 nb_pixel_total : 26055 time to create 1 rle with old method : 0.030712127685546875 time for calcul the mask position with numpy : 0.04111504554748535 nb_pixel_total : 50298 time to create 1 rle with old method : 0.05643630027770996 time for calcul the mask position with numpy : 0.042734384536743164 nb_pixel_total : 141649 time to create 1 rle with old method : 0.17878508567810059 time for calcul the mask position with numpy : 0.04819440841674805 nb_pixel_total : 185878 time to create 1 rle with new method : 0.7993917465209961 time for calcul the mask position with numpy : 0.04586601257324219 nb_pixel_total : 319005 time to create 1 rle with new method : 0.6478509902954102 create new chi : 4.290081739425659 time to delete rle : 0.003084897994995117 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 11585 TO DO : save crop sub photo not yet done ! save time : 0.9967327117919922 map_output_result : {1327677593: (0.0, 'Should be the crop_list due to order', 0), 1327677589: (0.0, 'Should be the crop_list due to order', 0), 1327677585: (0.0, 'Should be the crop_list due to order', 0), 1327677583: (0.0, 'Should be the crop_list due to order', 0), 1327677579: (0.0, 'Should be the crop_list due to order', 0), 1327677575: (0.0, 'Should be the crop_list due to order', 0), 1327677574: (0.0, 'Should be the crop_list due to order', 0), 1327677566: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1327677593, 1327677589, 1327677585, 1327677583, 1327677579, 1327677575, 1327677574, 1327677566] Looping around the photos to save general results len do output : 8 /1327677593.Didn't retrieve data . /1327677589.Didn't retrieve data . /1327677585.Didn't retrieve data . /1327677583.Didn't retrieve data . /1327677579.Didn't retrieve data . /1327677575.Didn't retrieve data . /1327677574.Didn't retrieve data . /1327677566.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677593', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677589', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677585', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677583', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677579', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677575', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677574', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677566', None, None, None, None, None, '2647383') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.13559579849243164 save_final save missing photos in datou_result : time spend for datou_step_exec : 126.0179831981659 time spend to save output : 0.1360011100769043 total time spend for step 3 : 126.1539843082428 step4:ventilate_hashtags_in_portfolio Fri Mar 7 11:36:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 21136601 get user id for portfolio 21136601 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136601 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','pehd','pet_fonce','papier','environnement','flou','metal','mal_croppe','background','autre','carton')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136601 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','pehd','pet_fonce','papier','environnement','flou','metal','mal_croppe','background','autre','carton')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136601 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','pehd','pet_fonce','papier','environnement','flou','metal','mal_croppe','background','autre','carton')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/21139893,21139894,21139895,21139896,21139897,21139898,21139899,21139900,21139901,21139902,21139903?tags=pet_clair,pehd,pet_fonce,papier,environnement,flou,metal,mal_croppe,background,autre,carton Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1327677593, 1327677589, 1327677585, 1327677583, 1327677579, 1327677575, 1327677574, 1327677566] Looping around the photos to save general results len do output : 1 /21136601. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677593', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677589', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677585', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677583', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677579', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677575', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677574', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677566', None, None, None, None, None, '2647383') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014187097549438477 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7206854820251465 time spend to save output : 0.014481067657470703 total time spend for step 4 : 1.7351665496826172 step5:final Fri Mar 7 11:36:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1327677593: ('0.18863094376929013',), 1327677589: ('0.18863094376929013',), 1327677585: ('0.18863094376929013',), 1327677583: ('0.18863094376929013',), 1327677579: ('0.18863094376929013',), 1327677575: ('0.18863094376929013',), 1327677574: ('0.18863094376929013',), 1327677566: ('0.18863094376929013',)} new output for save of step final : {1327677593: ('0.18863094376929013',), 1327677589: ('0.18863094376929013',), 1327677585: ('0.18863094376929013',), 1327677583: ('0.18863094376929013',), 1327677579: ('0.18863094376929013',), 1327677575: ('0.18863094376929013',), 1327677574: ('0.18863094376929013',), 1327677566: ('0.18863094376929013',)} [1327677593, 1327677589, 1327677585, 1327677583, 1327677579, 1327677575, 1327677574, 1327677566] Looping around the photos to save general results len do output : 8 /1327677593.Didn't retrieve data . /1327677589.Didn't retrieve data . /1327677585.Didn't retrieve data . /1327677583.Didn't retrieve data . /1327677579.Didn't retrieve data . /1327677575.Didn't retrieve data . /1327677574.Didn't retrieve data . /1327677566.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677593', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677589', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677585', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677583', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677579', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677575', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677574', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677566', None, None, None, None, None, '2647383') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.013723373413085938 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10785365104675293 time spend to save output : 0.01427316665649414 total time spend for step 5 : 0.12212681770324707 step6:blur_detection Fri Mar 7 11:36:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c.jpg resize: (2160, 3840) 1327677593 -4.905043308443077 treat image : temp/1741343428_2426679_1327677589_c61bc0f6ac8b47e67c2072c17a459423.jpg resize: (2160, 3840) 1327677589 -3.4516924160287235 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907.jpg resize: (2160, 3840) 1327677585 -5.340969320567143 treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9.jpg resize: (2160, 3840) 1327677583 -5.39100724859068 treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e.jpg resize: (2160, 3840) 1327677579 -5.287873368342359 treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932.jpg resize: (2160, 3840) 1327677575 -5.293087789730074 treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f.jpg resize: (2160, 3840) 1327677574 -5.3948225510872465 treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4.jpg resize: (2160, 3840) 1327677566 -3.2977570501357927 treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170104_0.png resize: (418, 624) 1341440713 -4.659939394899724 treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170101_0.png resize: (333, 495) 1341440714 -4.600959065464634 treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170111_0.png resize: (288, 309) 1341440715 -5.1904327696559225 treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170102_0.png resize: (264, 276) 1341440716 -3.8873936904538606 treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170103_0.png resize: (469, 308) 1341440717 -3.4958917469682715 treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170100_0.png resize: (91, 168) 1341440718 -2.1765673356046484 treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170109_0.png resize: (230, 166) 1341440719 -3.9147527511959166 treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170107_0.png resize: (223, 236) 1341440720 -2.8656642348533006 treat image : temp/1741343428_2426679_1327677589_c61bc0f6ac8b47e67c2072c17a459423_rle_crop_3697170114_0.png resize: (454, 551) 1341440721 -2.7633217860428476 treat image : temp/1741343428_2426679_1327677589_c61bc0f6ac8b47e67c2072c17a459423_rle_crop_3697170113_0.png resize: (322, 368) 1341440722 -3.8315285651356 treat image : temp/1741343428_2426679_1327677589_c61bc0f6ac8b47e67c2072c17a459423_rle_crop_3697170118_0.png resize: (593, 499) 1341440723 -4.217642052049297 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170130_0.png resize: (282, 273) 1341440724 -2.752834983351243 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170135_0.png resize: (207, 321) 1341440725 -3.1650170041613346 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170142_0.png resize: (183, 128) 1341440726 -3.49606937771119 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170129_0.png resize: (488, 445) 1341440727 -3.194582969043402 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170120_0.png resize: (767, 622) 1341440728 -4.0570514271511575 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170126_0.png resize: (111, 168) 1341440729 -3.8906637207846444 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170131_0.png resize: (121, 194) 1341440730 -0.7169298326508601 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170123_0.png resize: (329, 523) 1341440731 -2.4864971195497456 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170121_0.png resize: (507, 494) 1341440732 -2.723185134307602 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170138_0.png resize: (205, 145) 1341440733 -2.718367652055987 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170137_0.png resize: (114, 106) 1341440734 -0.16920914144153254 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170119_0.png resize: (492, 421) 1341440735 -4.341580477907324 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170134_0.png resize: (128, 126) 1341440736 -3.906857347029714 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170139_0.png resize: (354, 246) 1341440737 -3.9459607278789184 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170125_0.png resize: (133, 144) 1341440738 -3.7906749457311393 treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170143_0.png resize: (263, 458) 1341440739 -3.683836494151591 treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170148_0.png resize: (111, 113) 1341440740 -2.3751376671387696 treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170150_0.png resize: (151, 106) 1341440741 -2.238993252885696 treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170147_0.png resize: (339, 225) 1341440742 -2.7210233883659476 treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170156_0.png resize: (633, 649) 1341440743 -4.319104892323134 treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170151_0.png resize: (527, 584) 1341440744 -4.154008485091052 treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170145_0.png resize: (449, 457) 1341440745 -4.536152577138488 treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170154_0.png resize: (174, 178) 1341440746 -2.8262080420060967 treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170161_0.png resize: (181, 128) 1341440747 -4.259852276644471 treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170152_0.png resize: (250, 103) 1341440748 -3.654565129472311 treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170153_0.png resize: (444, 469) 1341440749 -4.164960381656304 treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170146_0.png resize: (485, 433) 1341440750 -4.152404954884419 treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170158_0.png resize: (373, 257) 1341440751 -3.3517786482603893 treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170168_0.png resize: (484, 234) 1341440752 -4.270191718562091 treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170166_0.png resize: (249, 293) 1341440753 -3.8719125651423787 treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170172_0.png resize: (590, 426) 1341440754 -2.8133608736063804 treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170164_0.png resize: (195, 231) 1341440755 -2.1741694199008705 treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170165_0.png resize: (433, 669) 1341440756 -4.157995764173515 treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170174_0.png resize: (213, 184) 1341440757 -2.2673033763777113 treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170180_0.png resize: (253, 109) 1341440758 -3.0491716039939605 treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170178_0.png resize: (186, 211) 1341440759 -3.775786167723463 treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170173_0.png resize: (110, 138) 1341440760 -3.1736403683065197 treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170169_0.png resize: (785, 454) 1341440761 -4.2108968007781735 treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170167_0.png resize: (154, 96) 1341440762 2.0728404962933418 treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170170_0.png resize: (531, 230) 1341440763 -4.271971280019433 treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170176_0.png resize: (335, 289) 1341440764 -4.481143646038503 treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170171_0.png resize: (632, 705) 1341440765 -3.3373904392602913 treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170177_0.png resize: (333, 130) 1341440766 -2.7389687919866126 treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170163_0.png resize: (164, 92) 1341440767 -3.6642774834743386 treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170191_0.png resize: (140, 152) 1341440768 -4.4409981828630825 treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170190_0.png resize: (552, 269) 1341440769 -4.168074477425572 treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170195_0.png resize: (493, 748) 1341440770 -4.227257306250898 treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170182_0.png resize: (451, 674) 1341440771 -4.080057544461874 treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170184_0.png resize: (272, 1103) 1341440772 -3.435963422174402 treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170189_0.png resize: (180, 446) 1341440773 -2.87795958157656 treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170193_0.png resize: (396, 591) 1341440774 -3.3915106781066275 treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170207_0.png resize: (175, 593) 1341440775 -3.5671075875837968 treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170204_0.png resize: (259, 364) 1341440776 -4.190524743608297 treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170196_0.png resize: (106, 575) 1341440777 -2.7105233770211594 treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170208_0.png resize: (367, 568) 1341440778 -2.816511818053067 treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170205_0.png resize: (155, 112) 1341440779 -3.661026299361652 treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170206_0.png resize: (115, 290) 1341440780 -2.6051655890044083 treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170202_0.png resize: (384, 280) 1341440781 -3.46533368332692 treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170199_0.png resize: (219, 253) 1341440782 -3.580517865179474 treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170209_0.png resize: (409, 415) 1341440783 -3.9253952165080483 treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170210_0.png resize: (590, 884) 1341440784 -2.7310499191751187 treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170219_0.png resize: (242, 356) 1341440785 -3.9931971247441043 treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170216_0.png resize: (182, 484) 1341440787 -3.633460568443981 treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170214_0.png resize: (195, 243) 1341440788 -2.6245287269830264 treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170220_0.png resize: (224, 126) 1341440789 -3.354298560600468 treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170221_0.png resize: (368, 553) 1341440790 -3.161073430766923 treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170222_0.png resize: (398, 405) 1341440791 -4.056998553227759 treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170218_0.png resize: (388, 247) 1341440792 -3.9716013574963114 treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170106_0.png resize: (95, 168) 1341440812 -3.4261967640512756 treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170108_0.png resize: (217, 243) 1341440813 -3.9843819530021833 treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170110_0.png resize: (249, 164) 1341440814 -1.6971122701784305 treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170112_0.png resize: (254, 266) 1341440815 -4.536392748719939 treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170105_0.png resize: (238, 239) 1341440816 -2.9127853668125527 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170132_0.png resize: (825, 835) 1341440817 -5.628032480769493 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170133_0.png resize: (442, 373) 1341440818 -2.7779969165691174 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170136_0.png resize: (228, 263) 1341440819 -3.3157293171499482 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170124_0.png resize: (392, 211) 1341440820 -4.39838842248812 treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170157_0.png resize: (178, 285) 1341440821 -1.7391404142614657 treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170160_0.png resize: (203, 575) 1341440822 -1.5473014060198915 treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170149_0.png resize: (274, 159) 1341440823 -2.473454421343969 treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170159_0.png resize: (260, 100) 1341440824 -4.227466650369915 treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170155_0.png resize: (173, 111) 1341440825 -2.5821211568420246 treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170175_0.png resize: (246, 194) 1341440826 -3.2314517030752516 treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170183_0.png resize: (155, 386) 1341440827 -1.4736689938715934 treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170186_0.png resize: (338, 217) 1341440828 -4.008685904700073 treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170201_0.png resize: (141, 140) 1341440829 -3.188181844314219 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170141_0.png resize: (252, 237) 1341440830 -3.7236799295148786 treat image : temp/1741343428_2426679_1327677589_c61bc0f6ac8b47e67c2072c17a459423_rle_crop_3697170116_0.png resize: (1229, 2072) 1341441315 -3.3204611668755426 treat image : temp/1741343428_2426679_1327677589_c61bc0f6ac8b47e67c2072c17a459423_rle_crop_3697170117_0.png resize: (488, 319) 1341441317 -4.512392219647295 treat image : temp/1741343428_2426679_1327677589_c61bc0f6ac8b47e67c2072c17a459423_rle_crop_3697170115_0.png resize: (484, 552) 1341441319 -3.585513329396614 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170140_0.png resize: (399, 421) 1341441321 -4.250766561298566 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170122_0.png resize: (281, 406) 1341441323 -3.981906535867699 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170127_0.png resize: (440, 278) 1341441326 -3.5457111280844655 treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170144_0.png resize: (423, 444) 1341441328 -4.645027645345583 treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170162_0.png resize: (240, 268) 1341441330 -3.3274359835254117 treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170179_0.png resize: (698, 421) 1341441332 -4.212260023687853 treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170192_0.png resize: (1319, 984) 1341441334 -3.9046717740822485 treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170194_0.png resize: (128, 304) 1341441336 -2.8568354381519385 treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170187_0.png resize: (216, 456) 1341441338 -3.3092656893166588 treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170200_0.png resize: (519, 277) 1341441340 -2.4710979070638563 treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170197_0.png resize: (357, 271) 1341441343 -3.4644414541682047 treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170198_0.png resize: (446, 516) 1341441345 -3.7990542387334987 treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170203_0.png resize: (961, 1097) 1341441347 -3.5602362727870003 treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170213_0.png resize: (296, 260) 1341441349 -4.2818873479583885 treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170217_0.png resize: (268, 398) 1341441350 -3.8547947868895363 treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170211_0.png resize: (586, 461) 1341441352 -3.043573568450094 treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170212_0.png resize: (363, 568) 1341441354 -3.0091637945387473 treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170215_0.png resize: (521, 443) 1341441356 -3.648211654491436 treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170128_0.png resize: (259, 263) 1341441403 -1.9548864544522797 treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170188_0.png resize: (531, 422) 1341441405 -2.4919872678555404 treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170181_0.png resize: (224, 224) 1341441407 -4.123881908516325 treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170185_0.png resize: (228, 470) 1341441408 -2.5626413665204146 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 131 time used for this insertion : 0.017737388610839844 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 131 time used for this insertion : 0.03297114372253418 save missing photos in datou_result : time spend for datou_step_exec : 44.749051094055176 time spend to save output : 0.05675172805786133 total time spend for step 6 : 44.80580282211304 step7:brightness Fri Mar 7 11:37:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c.jpg treat image : temp/1741343428_2426679_1327677589_c61bc0f6ac8b47e67c2072c17a459423.jpg treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907.jpg treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9.jpg treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e.jpg treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932.jpg treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f.jpg treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4.jpg treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170104_0.png treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170101_0.png treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170111_0.png treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170102_0.png treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170103_0.png treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170100_0.png treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170109_0.png treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170107_0.png treat image : temp/1741343428_2426679_1327677589_c61bc0f6ac8b47e67c2072c17a459423_rle_crop_3697170114_0.png treat image : temp/1741343428_2426679_1327677589_c61bc0f6ac8b47e67c2072c17a459423_rle_crop_3697170113_0.png treat image : temp/1741343428_2426679_1327677589_c61bc0f6ac8b47e67c2072c17a459423_rle_crop_3697170118_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170130_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170135_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170142_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170129_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170120_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170126_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170131_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170123_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170121_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170138_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170137_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170119_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170134_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170139_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170125_0.png treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170143_0.png treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170148_0.png treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170150_0.png treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170147_0.png treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170156_0.png treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170151_0.png treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170145_0.png treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170154_0.png treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170161_0.png treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170152_0.png treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170153_0.png treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170146_0.png treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170158_0.png treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170168_0.png treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170166_0.png treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170172_0.png treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170164_0.png treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170165_0.png treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170174_0.png treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170180_0.png treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170178_0.png treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170173_0.png treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170169_0.png treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170167_0.png treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170170_0.png treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170176_0.png treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170171_0.png treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170177_0.png treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170163_0.png treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170191_0.png treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170190_0.png treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170195_0.png treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170182_0.png treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170184_0.png treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170189_0.png treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170193_0.png treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170207_0.png treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170204_0.png treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170196_0.png treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170208_0.png treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170205_0.png treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170206_0.png treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170202_0.png treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170199_0.png treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170209_0.png treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170210_0.png treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170219_0.png treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170216_0.png treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170214_0.png treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170220_0.png treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170221_0.png treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170222_0.png treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170218_0.png treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170106_0.png treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170108_0.png treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170110_0.png treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170112_0.png treat image : temp/1741343428_2426679_1327677593_b4e9e263abed2c9ba521971c0f434e7c_rle_crop_3697170105_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170132_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170133_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170136_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170124_0.png treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170157_0.png treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170160_0.png treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170149_0.png treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170159_0.png treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170155_0.png treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170175_0.png treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170183_0.png treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170186_0.png treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170201_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170141_0.png treat image : temp/1741343428_2426679_1327677589_c61bc0f6ac8b47e67c2072c17a459423_rle_crop_3697170116_0.png treat image : temp/1741343428_2426679_1327677589_c61bc0f6ac8b47e67c2072c17a459423_rle_crop_3697170117_0.png treat image : temp/1741343428_2426679_1327677589_c61bc0f6ac8b47e67c2072c17a459423_rle_crop_3697170115_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170140_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170122_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170127_0.png treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170144_0.png treat image : temp/1741343428_2426679_1327677583_21efd225c03a182b63ebf97990d865f9_rle_crop_3697170162_0.png treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170179_0.png treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170192_0.png treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170194_0.png treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170187_0.png treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170200_0.png treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170197_0.png treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170198_0.png treat image : temp/1741343428_2426679_1327677574_96e15a2384eb0df7c14975ed32b1909f_rle_crop_3697170203_0.png treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170213_0.png treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170217_0.png treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170211_0.png treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170212_0.png treat image : temp/1741343428_2426679_1327677566_18387bca0b3f90ed7e653152f0e60eb4_rle_crop_3697170215_0.png treat image : temp/1741343428_2426679_1327677585_7082aa5db3c070855a31944370d10907_rle_crop_3697170128_0.png treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170188_0.png treat image : temp/1741343428_2426679_1327677579_10ee574e911b518f2c9e9babf3f2fc8e_rle_crop_3697170181_0.png treat image : temp/1741343428_2426679_1327677575_15272c64b8495d8633b09f88daa7f932_rle_crop_3697170185_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 131 time used for this insertion : 0.018393516540527344 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 131 time used for this insertion : 0.028887271881103516 save missing photos in datou_result : time spend for datou_step_exec : 9.863670825958252 time spend to save output : 0.05278730392456055 total time spend for step 7 : 9.916458129882812 step8:velours_tree Fri Mar 7 11:37:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.6193397045135498 time spend to save output : 3.5762786865234375e-05 total time spend for step 8 : 0.619375467300415 step9:send_mail_cod Fri Mar 7 11:37:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P21136601_07-03-2025_11_37_17.pdf 21139893 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211398931741343837 21139894 imagette211398941741343838 21139895 change filename to text .change filename to text .imagette211398951741343838 21139896 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211398961741343839 21139898 imagette211398981741343840 21139899 change filename to text .imagette211398991741343840 21139900 imagette211399001741343840 21139901 imagette211399011741343840 21139902 change filename to text .change filename to text .imagette211399021741343840 21139903 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211399031741343840 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21136601 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21139893,21139894,21139895,21139896,21139897,21139898,21139899,21139900,21139901,21139902,21139903?tags=pet_clair,pehd,pet_fonce,papier,environnement,flou,metal,mal_croppe,background,autre,carton args[1327677593] : ((1327677593, -4.905043308443077, 492609224), (1327677593, -1.0224158513997161, 501862349), '0.18863094376929013') We are sending mail with results at report@fotonower.com args[1327677589] : ((1327677589, -3.4516924160287235, 492609224), (1327677589, -1.2772588401019278, 501862349), '0.18863094376929013') We are sending mail with results at report@fotonower.com args[1327677585] : ((1327677585, -5.340969320567143, 492609224), (1327677585, -0.22352670080954282, 496442774), '0.18863094376929013') We are sending mail with results at report@fotonower.com args[1327677583] : ((1327677583, -5.39100724859068, 492609224), (1327677583, -0.6526842656978187, 501862349), '0.18863094376929013') We are sending mail with results at report@fotonower.com args[1327677579] : ((1327677579, -5.287873368342359, 492609224), (1327677579, -0.4496130983265721, 496442774), '0.18863094376929013') We are sending mail with results at report@fotonower.com args[1327677575] : ((1327677575, -5.293087789730074, 492609224), (1327677575, 0.010479172530845014, 2107752395), '0.18863094376929013') We are sending mail with results at report@fotonower.com args[1327677574] : ((1327677574, -5.3948225510872465, 492609224), (1327677574, -0.01810974845602749, 2107752395), '0.18863094376929013') We are sending mail with results at report@fotonower.com args[1327677566] : ((1327677566, -3.2977570501357927, 492609224), (1327677566, -1.0028473667150744, 501862349), '0.18863094376929013') We are sending mail with results at report@fotonower.com refus_total : 0.18863094376929013 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21136601 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136601_07-03-2025_11_37_17.pdf results_Auto_P21136601_07-03-2025_11_37_17.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136601_07-03-2025_11_37_17.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','21136601','results_Auto_P21136601_07-03-2025_11_37_17.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136601_07-03-2025_11_37_17.pdf','pdf','','1.33','0.18863094376929013') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/21136601

https://www.fotonower.com/image?json=false&list_photos_id=1327677593
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1327677589
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1327677585
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1327677583
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1327677579
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1327677575
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1327677574
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1327677566
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 18.86%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/21139893?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/21139895?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/21139896?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/21139899?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/21139902?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/21139903?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136601_07-03-2025_11_37_17.pdf.

Lien vers velours :https://www.fotonower.com/velours/21139893,21139894,21139895,21139896,21139897,21139898,21139899,21139900,21139901,21139902,21139903?tags=pet_clair,pehd,pet_fonce,papier,environnement,flou,metal,mal_croppe,background,autre,carton.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 07 Mar 2025 10:37:25 GMT Content-Length: 0 Connection: close X-Message-Id: 0JoWhh_YTHOsJh5jqRGGUQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1327677593, 1327677589, 1327677585, 1327677583, 1327677579, 1327677575, 1327677574, 1327677566] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677593', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677589', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677585', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677583', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677579', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677575', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677574', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677566', None, None, None, None, None, '2647383') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.0135498046875 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.054802656173706 time spend to save output : 0.013779401779174805 total time spend for step 9 : 8.06858205795288 step10:split_time_score Fri Mar 7 11:37:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('17', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 09012025 21136601 Nombre de photos uploadées : 8 / 23040 (0%) 09012025 21136601 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 09012025 21136601 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 3.814697265625e-06 elapsed_time : order_list_meta_photo_and_scores 1.049041748046875e-05 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.00044083595275878906 elapsed_time : insert_dashboard_record_day_entry 0.025556564331054688 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.035256224334702845 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136549_07-03-2025_08_49_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136549 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136549 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136550 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136559 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136560 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136567 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136572 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136574 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136576 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136578 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136581 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136582 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136584 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136586 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136588 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136589 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136592 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136594 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136598 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136599 order by id desc limit 1 Qualite : 0.18863094376929013 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136601_07-03-2025_11_37_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136601 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136601 AND mptpi.`type`=3594 To do Qualite : 0.18673976819701646 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136603_07-03-2025_11_07_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136603 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136603 AND mptpi.`type`=3594 To do Qualite : 0.2611221579562976 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136604_07-03-2025_08_59_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136604 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136604 AND mptpi.`type`=3726 To do Qualite : 0.11537128665123461 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136606_07-03-2025_10_43_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136606 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136606 AND mptpi.`type`=3594 To do Qualite : 0.2301076630015433 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136608_07-03-2025_10_36_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136608 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136608 AND mptpi.`type`=3594 To do Qualite : 0.1896752411517101 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136611_07-03-2025_08_59_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136611 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136611 AND mptpi.`type`=3726 To do Qualite : 0.14011606626157402 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136617_07-03-2025_10_28_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136617 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136617 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136618 order by id desc limit 1 Qualite : 0.17791785220550416 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136619_07-03-2025_10_20_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136619 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136619 AND mptpi.`type`=3594 To do Qualite : 0.18365381514099943 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136620_07-03-2025_08_53_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136620 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136620 AND mptpi.`type`=3726 To do Qualite : 0.1966467536329733 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136621_07-03-2025_09_55_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136621 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136621 AND mptpi.`type`=3594 To do Qualite : 0.19561166771154836 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136624_07-03-2025_09_51_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136624 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136624 AND mptpi.`type`=3594 To do Qualite : 0.11718202298280422 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136628_07-03-2025_09_35_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136628 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136628 AND mptpi.`type`=3594 To do Qualite : 0.21043726289223244 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136630_07-03-2025_09_31_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136630 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136630 AND mptpi.`type`=3594 To do Qualite : 0.19457695855034723 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136633_07-03-2025_09_18_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136633 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136633 AND mptpi.`type`=3594 To do Qualite : 0.18427746431327163 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136639_07-03-2025_10_10_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136639 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136639 AND mptpi.`type`=3594 To do Qualite : 0.1498098851165981 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136640_07-03-2025_09_05_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136640 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136640 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'09012025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1327677593, 1327677589, 1327677585, 1327677583, 1327677579, 1327677575, 1327677574, 1327677566] Looping around the photos to save general results len do output : 1 /21136601Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677593', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677589', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677585', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677583', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677579', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677575', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677574', None, None, None, None, None, '2647383') ('3318', None, None, None, None, None, None, None, '2647383') ('3318', '21136601', '1327677566', None, None, None, None, None, '2647383') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.013939142227172852 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.982355117797852 time spend to save output : 0.01427602767944336 total time spend for step 10 : 15.996631145477295 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 176.81user 169.40system 7:16.91elapsed 79%CPU (0avgtext+0avgdata 4855292maxresident)k 1129624inputs+216384outputs (6040major+15823897minor)pagefaults 0swaps