python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 4052 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2853002'] with mtr_portfolio_ids : ['22976914'] and first list_photo_ids : [] new path : /proc/4052/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 0.934237003326416 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed May 14 19:50:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 8958 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-14 19:50:33.816953: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-14 19:50:33.855315: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-14 19:50:33.857623: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fc73c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-14 19:50:33.857698: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-14 19:50:33.863251: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-14 19:50:34.160413: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2e2f2290 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-14 19:50:34.160456: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-14 19:50:34.162612: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-14 19:50:34.163021: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-14 19:50:34.165405: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-14 19:50:34.167825: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-14 19:50:34.168223: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-14 19:50:34.170787: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-14 19:50:34.172101: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-14 19:50:34.177102: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-14 19:50:34.180759: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-14 19:50:34.181247: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-14 19:50:34.183910: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-14 19:50:34.183933: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-14 19:50:34.183946: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-14 19:50:34.193372: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8269 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-14 19:50:34.733258: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-14 19:50:34.733454: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-14 19:50:34.733512: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-14 19:50:34.733546: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-14 19:50:34.733582: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-14 19:50:34.733632: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-14 19:50:34.733682: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-14 19:50:34.733745: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-14 19:50:34.735678: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-14 19:50:34.737734: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-14 19:50:34.737849: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-14 19:50:34.737900: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-14 19:50:34.737944: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-14 19:50:34.737974: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-14 19:50:34.738011: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-14 19:50:34.738048: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-14 19:50:34.738122: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-14 19:50:34.739916: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-14 19:50:34.739975: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-14 19:50:34.739999: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-14 19:50:34.740015: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-14 19:50:34.741805: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8269 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-14 19:50:47.783209: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-14 19:50:48.026430: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-14 19:50:49.747269: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 42 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 48 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 38 Detection mask done ! Trying to reset tf kernel 4620 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 300 tf kernel not reseted sub process len(results) : 5 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 5 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 8739 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.001987457275390625 nb_pixel_total : 48032 time to create 1 rle with old method : 0.05753302574157715 length of segment : 360 time for calcul the mask position with numpy : 0.0007941722869873047 nb_pixel_total : 33153 time to create 1 rle with old method : 0.043959617614746094 length of segment : 186 time for calcul the mask position with numpy : 0.005158901214599609 nb_pixel_total : 131773 time to create 1 rle with old method : 0.21378850936889648 length of segment : 433 time for calcul the mask position with numpy : 0.0010221004486083984 nb_pixel_total : 52404 time to create 1 rle with old method : 0.0623021125793457 length of segment : 247 time for calcul the mask position with numpy : 0.0020017623901367188 nb_pixel_total : 69549 time to create 1 rle with old method : 0.08356046676635742 length of segment : 536 time for calcul the mask position with numpy : 0.0009686946868896484 nb_pixel_total : 39219 time to create 1 rle with old method : 0.050574541091918945 length of segment : 342 time for calcul the mask position with numpy : 0.0016834735870361328 nb_pixel_total : 70221 time to create 1 rle with old method : 0.07894754409790039 length of segment : 418 time for calcul the mask position with numpy : 0.00045108795166015625 nb_pixel_total : 6754 time to create 1 rle with old method : 0.00823211669921875 length of segment : 223 time for calcul the mask position with numpy : 0.001796722412109375 nb_pixel_total : 94821 time to create 1 rle with old method : 0.1177830696105957 length of segment : 404 time for calcul the mask position with numpy : 0.0020203590393066406 nb_pixel_total : 98846 time to create 1 rle with old method : 0.11832761764526367 length of segment : 363 time for calcul the mask position with numpy : 0.001934051513671875 nb_pixel_total : 34984 time to create 1 rle with old method : 0.06607294082641602 length of segment : 350 time for calcul the mask position with numpy : 0.002566099166870117 nb_pixel_total : 138203 time to create 1 rle with old method : 0.16508030891418457 length of segment : 393 time for calcul the mask position with numpy : 0.0022542476654052734 nb_pixel_total : 27524 time to create 1 rle with old method : 0.03188967704772949 length of segment : 312 time for calcul the mask position with numpy : 0.0016129016876220703 nb_pixel_total : 23874 time to create 1 rle with old method : 0.02831864356994629 length of segment : 261 time for calcul the mask position with numpy : 0.0017321109771728516 nb_pixel_total : 14617 time to create 1 rle with old method : 0.01973724365234375 length of segment : 128 time for calcul the mask position with numpy : 0.0033006668090820312 nb_pixel_total : 100762 time to create 1 rle with old method : 0.1128997802734375 length of segment : 329 time for calcul the mask position with numpy : 0.0016162395477294922 nb_pixel_total : 43910 time to create 1 rle with old method : 0.050809621810913086 length of segment : 257 time for calcul the mask position with numpy : 0.0012123584747314453 nb_pixel_total : 18327 time to create 1 rle with old method : 0.021170616149902344 length of segment : 165 time for calcul the mask position with numpy : 0.001079559326171875 nb_pixel_total : 22882 time to create 1 rle with old method : 0.02617478370666504 length of segment : 208 time for calcul the mask position with numpy : 0.006498575210571289 nb_pixel_total : 188372 time to create 1 rle with new method : 0.009812355041503906 length of segment : 525 time for calcul the mask position with numpy : 0.0008847713470458984 nb_pixel_total : 25683 time to create 1 rle with old method : 0.029766559600830078 length of segment : 155 time for calcul the mask position with numpy : 0.0006840229034423828 nb_pixel_total : 21053 time to create 1 rle with old method : 0.024189233779907227 length of segment : 167 time for calcul the mask position with numpy : 0.00043582916259765625 nb_pixel_total : 8197 time to create 1 rle with old method : 0.00959157943725586 length of segment : 122 time for calcul the mask position with numpy : 0.0011641979217529297 nb_pixel_total : 31978 time to create 1 rle with old method : 0.036538124084472656 length of segment : 230 time for calcul the mask position with numpy : 0.0007617473602294922 nb_pixel_total : 14123 time to create 1 rle with old method : 0.01619553565979004 length of segment : 148 time for calcul the mask position with numpy : 0.00021529197692871094 nb_pixel_total : 4210 time to create 1 rle with old method : 0.0051991939544677734 length of segment : 91 time for calcul the mask position with numpy : 0.0012273788452148438 nb_pixel_total : 33353 time to create 1 rle with old method : 0.03928542137145996 length of segment : 205 time for calcul the mask position with numpy : 0.0035860538482666016 nb_pixel_total : 105650 time to create 1 rle with old method : 0.12035107612609863 length of segment : 439 time for calcul the mask position with numpy : 0.0012030601501464844 nb_pixel_total : 37972 time to create 1 rle with old method : 0.04534339904785156 length of segment : 257 time for calcul the mask position with numpy : 0.0006489753723144531 nb_pixel_total : 15282 time to create 1 rle with old method : 0.017765522003173828 length of segment : 141 time for calcul the mask position with numpy : 0.0018177032470703125 nb_pixel_total : 51964 time to create 1 rle with old method : 0.061925649642944336 length of segment : 511 time for calcul the mask position with numpy : 0.0016009807586669922 nb_pixel_total : 49972 time to create 1 rle with old method : 0.057442426681518555 length of segment : 289 time for calcul the mask position with numpy : 0.0016961097717285156 nb_pixel_total : 30610 time to create 1 rle with old method : 0.053522586822509766 length of segment : 201 time for calcul the mask position with numpy : 0.002658843994140625 nb_pixel_total : 79478 time to create 1 rle with old method : 0.0999000072479248 length of segment : 383 time for calcul the mask position with numpy : 0.003173351287841797 nb_pixel_total : 94250 time to create 1 rle with old method : 0.10782694816589355 length of segment : 412 time for calcul the mask position with numpy : 0.0027871131896972656 nb_pixel_total : 67264 time to create 1 rle with old method : 0.07654762268066406 length of segment : 426 time for calcul the mask position with numpy : 0.010788679122924805 nb_pixel_total : 231952 time to create 1 rle with new method : 0.012419939041137695 length of segment : 693 time for calcul the mask position with numpy : 0.003233194351196289 nb_pixel_total : 93868 time to create 1 rle with old method : 0.1057577133178711 length of segment : 326 time for calcul the mask position with numpy : 0.0016713142395019531 nb_pixel_total : 46370 time to create 1 rle with old method : 0.0522305965423584 length of segment : 246 time for calcul the mask position with numpy : 0.0008451938629150391 nb_pixel_total : 19510 time to create 1 rle with old method : 0.022477149963378906 length of segment : 161 time for calcul the mask position with numpy : 0.001535654067993164 nb_pixel_total : 48042 time to create 1 rle with old method : 0.0559992790222168 length of segment : 262 time for calcul the mask position with numpy : 0.0019478797912597656 nb_pixel_total : 50624 time to create 1 rle with old method : 0.06331753730773926 length of segment : 174 time for calcul the mask position with numpy : 0.0022203922271728516 nb_pixel_total : 69620 time to create 1 rle with old method : 0.10979890823364258 length of segment : 316 time for calcul the mask position with numpy : 0.0009958744049072266 nb_pixel_total : 16668 time to create 1 rle with old method : 0.019160032272338867 length of segment : 194 time for calcul the mask position with numpy : 0.002980470657348633 nb_pixel_total : 81563 time to create 1 rle with old method : 0.09446454048156738 length of segment : 482 time for calcul the mask position with numpy : 0.0022497177124023438 nb_pixel_total : 58655 time to create 1 rle with old method : 0.06623983383178711 length of segment : 258 time for calcul the mask position with numpy : 0.0014293193817138672 nb_pixel_total : 56404 time to create 1 rle with old method : 0.06612968444824219 length of segment : 456 time for calcul the mask position with numpy : 0.0009098052978515625 nb_pixel_total : 21179 time to create 1 rle with old method : 0.025838136672973633 length of segment : 210 time for calcul the mask position with numpy : 0.002309083938598633 nb_pixel_total : 50674 time to create 1 rle with old method : 0.05745649337768555 length of segment : 592 time for calcul the mask position with numpy : 0.009876489639282227 nb_pixel_total : 204817 time to create 1 rle with new method : 0.01604485511779785 length of segment : 607 time for calcul the mask position with numpy : 0.001390695571899414 nb_pixel_total : 26322 time to create 1 rle with old method : 0.029955148696899414 length of segment : 214 time for calcul the mask position with numpy : 0.0041811466217041016 nb_pixel_total : 121457 time to create 1 rle with old method : 0.13551545143127441 length of segment : 434 time for calcul the mask position with numpy : 0.0017600059509277344 nb_pixel_total : 50792 time to create 1 rle with old method : 0.05800223350524902 length of segment : 244 time for calcul the mask position with numpy : 0.0012252330780029297 nb_pixel_total : 18633 time to create 1 rle with old method : 0.025799036026000977 length of segment : 216 time for calcul the mask position with numpy : 0.0014126300811767578 nb_pixel_total : 26596 time to create 1 rle with old method : 0.030606985092163086 length of segment : 395 time for calcul the mask position with numpy : 0.003392457962036133 nb_pixel_total : 68683 time to create 1 rle with old method : 0.08363008499145508 length of segment : 454 time for calcul the mask position with numpy : 0.003999233245849609 nb_pixel_total : 99609 time to create 1 rle with old method : 0.1128542423248291 length of segment : 539 time for calcul the mask position with numpy : 0.0012059211730957031 nb_pixel_total : 27844 time to create 1 rle with old method : 0.033640146255493164 length of segment : 127 time for calcul the mask position with numpy : 0.0032417774200439453 nb_pixel_total : 45544 time to create 1 rle with old method : 0.05331158638000488 length of segment : 254 time for calcul the mask position with numpy : 0.0005075931549072266 nb_pixel_total : 18303 time to create 1 rle with old method : 0.02096843719482422 length of segment : 159 time for calcul the mask position with numpy : 0.0008289813995361328 nb_pixel_total : 17382 time to create 1 rle with old method : 0.01999640464782715 length of segment : 170 time for calcul the mask position with numpy : 0.0010211467742919922 nb_pixel_total : 22827 time to create 1 rle with old method : 0.02610325813293457 length of segment : 273 time for calcul the mask position with numpy : 0.004880428314208984 nb_pixel_total : 135061 time to create 1 rle with old method : 0.15406370162963867 length of segment : 376 time for calcul the mask position with numpy : 0.0010764598846435547 nb_pixel_total : 21395 time to create 1 rle with old method : 0.0245821475982666 length of segment : 193 time for calcul the mask position with numpy : 0.003858804702758789 nb_pixel_total : 90898 time to create 1 rle with old method : 0.10306668281555176 length of segment : 436 time for calcul the mask position with numpy : 0.0014605522155761719 nb_pixel_total : 41679 time to create 1 rle with old method : 0.0473024845123291 length of segment : 219 time for calcul the mask position with numpy : 0.0008766651153564453 nb_pixel_total : 27513 time to create 1 rle with old method : 0.0316004753112793 length of segment : 209 time for calcul the mask position with numpy : 0.011073827743530273 nb_pixel_total : 197969 time to create 1 rle with new method : 0.043161630630493164 length of segment : 944 time for calcul the mask position with numpy : 0.0008640289306640625 nb_pixel_total : 24589 time to create 1 rle with old method : 0.02831554412841797 length of segment : 142 time for calcul the mask position with numpy : 0.005528688430786133 nb_pixel_total : 97589 time to create 1 rle with old method : 0.1100928783416748 length of segment : 303 time for calcul the mask position with numpy : 0.003920078277587891 nb_pixel_total : 119766 time to create 1 rle with old method : 0.1363544464111328 length of segment : 435 time for calcul the mask position with numpy : 0.008294105529785156 nb_pixel_total : 204721 time to create 1 rle with new method : 0.011654138565063477 length of segment : 621 time for calcul the mask position with numpy : 0.0007052421569824219 nb_pixel_total : 17202 time to create 1 rle with old method : 0.019788503646850586 length of segment : 197 time for calcul the mask position with numpy : 0.0006792545318603516 nb_pixel_total : 15858 time to create 1 rle with old method : 0.02044224739074707 length of segment : 157 time for calcul the mask position with numpy : 0.0010330677032470703 nb_pixel_total : 21856 time to create 1 rle with old method : 0.0249025821685791 length of segment : 413 time for calcul the mask position with numpy : 0.0009629726409912109 nb_pixel_total : 32672 time to create 1 rle with old method : 0.03737354278564453 length of segment : 181 time for calcul the mask position with numpy : 0.0011775493621826172 nb_pixel_total : 30631 time to create 1 rle with old method : 0.03539848327636719 length of segment : 211 time for calcul the mask position with numpy : 0.0021648406982421875 nb_pixel_total : 59013 time to create 1 rle with old method : 0.06650257110595703 length of segment : 298 time for calcul the mask position with numpy : 0.0003216266632080078 nb_pixel_total : 7007 time to create 1 rle with old method : 0.008295774459838867 length of segment : 70 time for calcul the mask position with numpy : 0.0016660690307617188 nb_pixel_total : 48465 time to create 1 rle with old method : 0.054648399353027344 length of segment : 230 time for calcul the mask position with numpy : 0.0006222724914550781 nb_pixel_total : 16261 time to create 1 rle with old method : 0.018540382385253906 length of segment : 139 time for calcul the mask position with numpy : 0.0006256103515625 nb_pixel_total : 18312 time to create 1 rle with old method : 0.021088838577270508 length of segment : 149 time for calcul the mask position with numpy : 0.005276679992675781 nb_pixel_total : 172067 time to create 1 rle with new method : 0.009914875030517578 length of segment : 448 time for calcul the mask position with numpy : 0.00041604042053222656 nb_pixel_total : 6757 time to create 1 rle with old method : 0.007903337478637695 length of segment : 124 time for calcul the mask position with numpy : 0.001466989517211914 nb_pixel_total : 34454 time to create 1 rle with old method : 0.05562138557434082 length of segment : 272 time spent for convertir_results : 9.389968156814575 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 85 chid ids of type : 3594 Number RLEs to save : 25840 save missing photos in datou_result : time spend for datou_step_exec : 63.87967610359192 time spend to save output : 1.5190379619598389 total time spend for step 1 : 65.39871406555176 step2:crop_condition Wed May 14 19:51:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 85 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 51 About to insert : list_path_to_insert length 51 new photo from crops ! About to upload 51 photos upload in portfolio : 3736932 init cache_photo without model_param we have 51 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747245107_4052 we have uploaded 51 photos in the portfolio 3736932 time of upload the photos Elapsed time : 13.143235445022583 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747245122_4052 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1711230278015137 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 27 About to insert : list_path_to_insert length 27 new photo from crops ! About to upload 27 photos upload in portfolio : 3736932 init cache_photo without model_param we have 27 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747245134_4052 we have uploaded 27 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.877109050750732 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747245143_4052 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1199774742126465 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1358282981, 1358282800, 1358282769, 1358282733, 1358282700] Looping around the photos to save general results len do output : 85 /1358304743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358304964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282981', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282800', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282769', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282733', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282700', None, None, None, None, None, '2853002') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 260 time used for this insertion : 0.024247407913208008 save_final save missing photos in datou_result : time spend for datou_step_exec : 49.574552059173584 time spend to save output : 0.02660822868347168 total time spend for step 2 : 49.601160287857056 step3:rle_unique_nms_with_priority Wed May 14 19:52:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 85 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 12.274700164794922 time for calcul the mask position with numpy : 0.6845672130584717 nb_pixel_total : 7224545 time to create 1 rle with new method : 1.4055087566375732 time for calcul the mask position with numpy : 0.044594764709472656 nb_pixel_total : 22882 time to create 1 rle with old method : 0.025481224060058594 time for calcul the mask position with numpy : 0.0457761287689209 nb_pixel_total : 18327 time to create 1 rle with old method : 0.020613670349121094 time for calcul the mask position with numpy : 0.04494762420654297 nb_pixel_total : 43910 time to create 1 rle with old method : 0.04873967170715332 time for calcul the mask position with numpy : 0.04474639892578125 nb_pixel_total : 100762 time to create 1 rle with old method : 0.11182737350463867 time for calcul the mask position with numpy : 0.045619964599609375 nb_pixel_total : 14617 time to create 1 rle with old method : 0.016312122344970703 time for calcul the mask position with numpy : 0.04593014717102051 nb_pixel_total : 23874 time to create 1 rle with old method : 0.02675914764404297 time for calcul the mask position with numpy : 0.04538440704345703 nb_pixel_total : 27524 time to create 1 rle with old method : 0.03104424476623535 time for calcul the mask position with numpy : 0.04457283020019531 nb_pixel_total : 138203 time to create 1 rle with old method : 0.1586625576019287 time for calcul the mask position with numpy : 0.047773122787475586 nb_pixel_total : 34984 time to create 1 rle with old method : 0.03888964653015137 time for calcul the mask position with numpy : 0.04994678497314453 nb_pixel_total : 98846 time to create 1 rle with old method : 0.10927438735961914 time for calcul the mask position with numpy : 0.027941226959228516 nb_pixel_total : 94821 time to create 1 rle with old method : 0.10627365112304688 time for calcul the mask position with numpy : 0.029972553253173828 nb_pixel_total : 6754 time to create 1 rle with old method : 0.007758617401123047 time for calcul the mask position with numpy : 0.027971506118774414 nb_pixel_total : 70221 time to create 1 rle with old method : 0.07764530181884766 time for calcul the mask position with numpy : 0.032480478286743164 nb_pixel_total : 39219 time to create 1 rle with old method : 0.0437006950378418 time for calcul the mask position with numpy : 0.026473283767700195 nb_pixel_total : 69549 time to create 1 rle with old method : 0.07757735252380371 time for calcul the mask position with numpy : 0.030291080474853516 nb_pixel_total : 52404 time to create 1 rle with old method : 0.06030464172363281 time for calcul the mask position with numpy : 0.030730485916137695 nb_pixel_total : 131773 time to create 1 rle with old method : 0.14729785919189453 time for calcul the mask position with numpy : 0.03296089172363281 nb_pixel_total : 33153 time to create 1 rle with old method : 0.03694510459899902 time for calcul the mask position with numpy : 0.028192520141601562 nb_pixel_total : 48032 time to create 1 rle with old method : 0.05367755889892578 create new chi : 4.058605194091797 time to delete rle : 0.029366493225097656 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 13990 TO DO : save crop sub photo not yet done ! save time : 0.8471333980560303 nb_obj : 13 nb_hashtags : 2 time to prepare the origin masks : 7.777163505554199 time for calcul the mask position with numpy : 1.400378704071045 nb_pixel_total : 7707302 time to create 1 rle with new method : 0.9684875011444092 time for calcul the mask position with numpy : 0.04130268096923828 nb_pixel_total : 49972 time to create 1 rle with old method : 0.05708575248718262 time for calcul the mask position with numpy : 0.044061899185180664 nb_pixel_total : 51964 time to create 1 rle with old method : 0.05729794502258301 time for calcul the mask position with numpy : 0.04194808006286621 nb_pixel_total : 15282 time to create 1 rle with old method : 0.01718306541442871 time for calcul the mask position with numpy : 0.04362654685974121 nb_pixel_total : 37972 time to create 1 rle with old method : 0.04250383377075195 time for calcul the mask position with numpy : 0.04437541961669922 nb_pixel_total : 105650 time to create 1 rle with old method : 0.1174018383026123 time for calcul the mask position with numpy : 0.04288625717163086 nb_pixel_total : 33353 time to create 1 rle with old method : 0.03747272491455078 time for calcul the mask position with numpy : 0.043443918228149414 nb_pixel_total : 3499 time to create 1 rle with old method : 0.004023075103759766 time for calcul the mask position with numpy : 0.04240107536315918 nb_pixel_total : 14123 time to create 1 rle with old method : 0.018161535263061523 time for calcul the mask position with numpy : 0.04082989692687988 nb_pixel_total : 31978 time to create 1 rle with old method : 0.0357205867767334 time for calcul the mask position with numpy : 0.040497541427612305 nb_pixel_total : 8197 time to create 1 rle with old method : 0.009316205978393555 time for calcul the mask position with numpy : 0.026365041732788086 nb_pixel_total : 21053 time to create 1 rle with old method : 0.024567842483520508 time for calcul the mask position with numpy : 0.03206443786621094 nb_pixel_total : 25683 time to create 1 rle with old method : 0.0285341739654541 time for calcul the mask position with numpy : 0.042166948318481445 nb_pixel_total : 188372 time to create 1 rle with new method : 0.6599335670471191 create new chi : 4.086365461349487 time to delete rle : 0.0015838146209716797 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 8670 TO DO : save crop sub photo not yet done ! save time : 0.5389404296875 nb_obj : 17 nb_hashtags : 2 time to prepare the origin masks : 9.63127851486206 time for calcul the mask position with numpy : 0.9398927688598633 nb_pixel_total : 7177669 time to create 1 rle with new method : 0.921471118927002 time for calcul the mask position with numpy : 0.04495096206665039 nb_pixel_total : 50674 time to create 1 rle with old method : 0.05471968650817871 time for calcul the mask position with numpy : 0.042723894119262695 nb_pixel_total : 21179 time to create 1 rle with old method : 0.02369856834411621 time for calcul the mask position with numpy : 0.04752373695373535 nb_pixel_total : 56404 time to create 1 rle with old method : 0.06325292587280273 time for calcul the mask position with numpy : 0.04650735855102539 nb_pixel_total : 58655 time to create 1 rle with old method : 0.06419634819030762 time for calcul the mask position with numpy : 0.035227060317993164 nb_pixel_total : 81563 time to create 1 rle with old method : 0.08954668045043945 time for calcul the mask position with numpy : 0.03986644744873047 nb_pixel_total : 16668 time to create 1 rle with old method : 0.01884317398071289 time for calcul the mask position with numpy : 0.04331660270690918 nb_pixel_total : 69620 time to create 1 rle with old method : 0.08010625839233398 time for calcul the mask position with numpy : 0.04407095909118652 nb_pixel_total : 50624 time to create 1 rle with old method : 0.056470394134521484 time for calcul the mask position with numpy : 0.04839468002319336 nb_pixel_total : 48042 time to create 1 rle with old method : 0.05343270301818848 time for calcul the mask position with numpy : 0.04175925254821777 nb_pixel_total : 19510 time to create 1 rle with old method : 0.022827863693237305 time for calcul the mask position with numpy : 0.04819846153259277 nb_pixel_total : 46370 time to create 1 rle with old method : 0.05018329620361328 time for calcul the mask position with numpy : 0.05007219314575195 nb_pixel_total : 93868 time to create 1 rle with old method : 0.14216136932373047 time for calcul the mask position with numpy : 0.04342770576477051 nb_pixel_total : 231952 time to create 1 rle with new method : 1.263535499572754 time for calcul the mask position with numpy : 0.03275489807128906 nb_pixel_total : 67264 time to create 1 rle with old method : 0.07294654846191406 time for calcul the mask position with numpy : 0.028287172317504883 nb_pixel_total : 94250 time to create 1 rle with old method : 0.10324907302856445 time for calcul the mask position with numpy : 0.02621746063232422 nb_pixel_total : 79478 time to create 1 rle with old method : 0.08600497245788574 time for calcul the mask position with numpy : 0.02598428726196289 nb_pixel_total : 30610 time to create 1 rle with old method : 0.034043073654174805 create new chi : 4.916035175323486 time to delete rle : 0.003051280975341797 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 13744 TO DO : save crop sub photo not yet done ! save time : 0.8763377666473389 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 12.809083700180054 time for calcul the mask position with numpy : 1.7153630256652832 nb_pixel_total : 7072470 time to create 1 rle with new method : 0.9107666015625 time for calcul the mask position with numpy : 0.05044198036193848 nb_pixel_total : 192233 time to create 1 rle with new method : 1.0521056652069092 time for calcul the mask position with numpy : 0.04724407196044922 nb_pixel_total : 8735 time to create 1 rle with old method : 0.010896444320678711 time for calcul the mask position with numpy : 0.054868221282958984 nb_pixel_total : 39409 time to create 1 rle with old method : 0.04800105094909668 time for calcul the mask position with numpy : 0.045156240463256836 nb_pixel_total : 90898 time to create 1 rle with old method : 0.10472321510314941 time for calcul the mask position with numpy : 0.04462385177612305 nb_pixel_total : 21395 time to create 1 rle with old method : 0.023891448974609375 time for calcul the mask position with numpy : 0.04508566856384277 nb_pixel_total : 134554 time to create 1 rle with old method : 0.1486186981201172 time for calcul the mask position with numpy : 0.04383707046508789 nb_pixel_total : 22827 time to create 1 rle with old method : 0.025608062744140625 time for calcul the mask position with numpy : 0.04185605049133301 nb_pixel_total : 17382 time to create 1 rle with old method : 0.020749568939208984 time for calcul the mask position with numpy : 0.04790997505187988 nb_pixel_total : 4200 time to create 1 rle with old method : 0.007029056549072266 time for calcul the mask position with numpy : 0.044490814208984375 nb_pixel_total : 45544 time to create 1 rle with old method : 0.050843000411987305 time for calcul the mask position with numpy : 0.04380321502685547 nb_pixel_total : 27844 time to create 1 rle with old method : 0.03104376792907715 time for calcul the mask position with numpy : 0.02789783477783203 nb_pixel_total : 99609 time to create 1 rle with old method : 0.13723301887512207 time for calcul the mask position with numpy : 0.028025388717651367 nb_pixel_total : 68683 time to create 1 rle with old method : 0.07686829566955566 time for calcul the mask position with numpy : 0.02748870849609375 nb_pixel_total : 26596 time to create 1 rle with old method : 0.03751015663146973 time for calcul the mask position with numpy : 0.028963327407836914 nb_pixel_total : 18633 time to create 1 rle with old method : 0.020532608032226562 time for calcul the mask position with numpy : 0.03336286544799805 nb_pixel_total : 50792 time to create 1 rle with old method : 0.05606889724731445 time for calcul the mask position with numpy : 0.04500603675842285 nb_pixel_total : 121457 time to create 1 rle with old method : 0.13315892219543457 time for calcul the mask position with numpy : 0.04484748840332031 nb_pixel_total : 26322 time to create 1 rle with old method : 0.03258085250854492 time for calcul the mask position with numpy : 0.04768562316894531 nb_pixel_total : 204817 time to create 1 rle with new method : 0.9642491340637207 create new chi : 6.538034200668335 time to delete rle : 0.0026094913482666016 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 14372 TO DO : save crop sub photo not yet done ! save time : 0.8711996078491211 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 11.693217515945435 time for calcul the mask position with numpy : 1.0731842517852783 nb_pixel_total : 7372816 time to create 1 rle with new method : 1.7984087467193604 time for calcul the mask position with numpy : 0.027742385864257812 nb_pixel_total : 34454 time to create 1 rle with old method : 0.03822922706604004 time for calcul the mask position with numpy : 0.035280704498291016 nb_pixel_total : 6757 time to create 1 rle with old method : 0.007658958435058594 time for calcul the mask position with numpy : 0.03349494934082031 nb_pixel_total : 170039 time to create 1 rle with new method : 1.3085358142852783 time for calcul the mask position with numpy : 0.028026580810546875 nb_pixel_total : 18312 time to create 1 rle with old method : 0.020642757415771484 time for calcul the mask position with numpy : 0.03360247611999512 nb_pixel_total : 16261 time to create 1 rle with old method : 0.01809978485107422 time for calcul the mask position with numpy : 0.028983354568481445 nb_pixel_total : 48465 time to create 1 rle with old method : 0.0538020133972168 time for calcul the mask position with numpy : 0.02773737907409668 nb_pixel_total : 7007 time to create 1 rle with old method : 0.007962942123413086 time for calcul the mask position with numpy : 0.040921688079833984 nb_pixel_total : 59013 time to create 1 rle with old method : 0.06533646583557129 time for calcul the mask position with numpy : 0.04374384880065918 nb_pixel_total : 30631 time to create 1 rle with old method : 0.033887624740600586 time for calcul the mask position with numpy : 0.04497408866882324 nb_pixel_total : 29064 time to create 1 rle with old method : 0.036550045013427734 time for calcul the mask position with numpy : 0.06191754341125488 nb_pixel_total : 21856 time to create 1 rle with old method : 0.036443233489990234 time for calcul the mask position with numpy : 0.042591094970703125 nb_pixel_total : 15858 time to create 1 rle with old method : 0.017811298370361328 time for calcul the mask position with numpy : 0.027835607528686523 nb_pixel_total : 17202 time to create 1 rle with old method : 0.01925373077392578 time for calcul the mask position with numpy : 0.029314756393432617 nb_pixel_total : 204721 time to create 1 rle with new method : 1.5210392475128174 time for calcul the mask position with numpy : 0.027808427810668945 nb_pixel_total : 119766 time to create 1 rle with old method : 0.1322312355041504 time for calcul the mask position with numpy : 0.027286052703857422 nb_pixel_total : 97589 time to create 1 rle with old method : 0.1133871078491211 time for calcul the mask position with numpy : 0.0273745059967041 nb_pixel_total : 24589 time to create 1 rle with old method : 0.028000831604003906 create new chi : 7.0419909954071045 time to delete rle : 0.0016739368438720703 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 10837 TO DO : save crop sub photo not yet done ! save time : 0.7025692462921143 map_output_result : {1358282981: (0.0, 'Should be the crop_list due to order', 0), 1358282800: (0.0, 'Should be the crop_list due to order', 0), 1358282769: (0.0, 'Should be the crop_list due to order', 0), 1358282733: (0.0, 'Should be the crop_list due to order', 0), 1358282700: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1358282981, 1358282800, 1358282769, 1358282733, 1358282700] Looping around the photos to save general results len do output : 5 /1358282981.Didn't retrieve data . /1358282800.Didn't retrieve data . /1358282769.Didn't retrieve data . /1358282733.Didn't retrieve data . /1358282700.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282981', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282800', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282769', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282733', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282700', None, None, None, None, None, '2853002') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.012083768844604492 save_final save missing photos in datou_result : time spend for datou_step_exec : 85.53026008605957 time spend to save output : 0.012420892715454102 total time spend for step 3 : 85.54268097877502 step4:ventilate_hashtags_in_portfolio Wed May 14 19:53:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22976914 get user id for portfolio 22976914 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22976914 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','metal','pehd','background','flou','mal_croppe','pet_clair','autre','environnement','carton','papier')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22976914 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','metal','pehd','background','flou','mal_croppe','pet_clair','autre','environnement','carton','papier')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22976914 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','metal','pehd','background','flou','mal_croppe','pet_clair','autre','environnement','carton','papier')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22977872,22977873,22977874,22977875,22977876,22977877,22977878,22977879,22977880,22977881,22977882?tags=pet_fonce,metal,pehd,background,flou,mal_croppe,pet_clair,autre,environnement,carton,papier Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1358282981, 1358282800, 1358282769, 1358282733, 1358282700] Looping around the photos to save general results len do output : 1 /22976914. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282981', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282800', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282769', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282733', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282700', None, None, None, None, None, '2853002') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.012392759323120117 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.7280864715576172 time spend to save output : 0.012729167938232422 total time spend for step 4 : 0.7408156394958496 step5:final Wed May 14 19:53:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1358282981: ('0.11856669560185185',), 1358282800: ('0.11856669560185185',), 1358282769: ('0.11856669560185185',), 1358282733: ('0.11856669560185185',), 1358282700: ('0.11856669560185185',)} new output for save of step final : {1358282981: ('0.11856669560185185',), 1358282800: ('0.11856669560185185',), 1358282769: ('0.11856669560185185',), 1358282733: ('0.11856669560185185',), 1358282700: ('0.11856669560185185',)} [1358282981, 1358282800, 1358282769, 1358282733, 1358282700] Looping around the photos to save general results len do output : 5 /1358282981.Didn't retrieve data . /1358282800.Didn't retrieve data . /1358282769.Didn't retrieve data . /1358282733.Didn't retrieve data . /1358282700.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282981', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282800', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282769', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282733', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282700', None, None, None, None, None, '2853002') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.01376199722290039 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10986661911010742 time spend to save output : 0.014089584350585938 total time spend for step 5 : 0.12395620346069336 step6:blur_detection Wed May 14 19:53:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105.jpg resize: (2160, 3840) 1358282981 -6.427657875381572 treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19.jpg resize: (2160, 3840) 1358282800 -5.84263151423897 treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17.jpg resize: (2160, 3840) 1358282769 -6.399956958409696 treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413.jpg resize: (2160, 3840) 1358282733 -6.635953879390217 treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2.jpg resize: (2160, 3840) 1358282700 -6.634860668467936 treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753135_0.png resize: (366, 352) 1358304743 -4.188203428836393 treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753134_0.png resize: (243, 269) 1358304744 -3.0546210188983594 treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753149_0.png resize: (208, 163) 1358304746 -3.7810202720318107 treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753132_0.png resize: (155, 302) 1358304748 -0.6085030842195986 treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753138_0.png resize: (133, 145) 1358304749 -2.782302981186971 treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753145_0.png resize: (126, 175) 1358304750 -3.5919002522462553 treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753143_0.png resize: (312, 226) 1358304752 -3.9493298716658622 treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753131_0.png resize: (358, 184) 1358304754 -3.8775728830162715 treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753141_0.png resize: (350, 236) 1358304755 -3.0734655275814386 treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753148_0.png resize: (144, 157) 1358304758 -2.1265524964279074 treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753161_0.png resize: (405, 193) 1358304759 -4.062843577930104 treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753155_0.png resize: (146, 157) 1358304762 -2.996490475817334 treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753150_0.png resize: (525, 472) 1358304763 -1.6939847609763032 treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753154_0.png resize: (229, 220) 1358304765 -3.1221519423427524 treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753159_0.png resize: (257, 209) 1358304767 -3.5527933502486304 treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753160_0.png resize: (140, 150) 1358304768 -3.264174516764581 treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753157_0.png resize: (205, 293) 1358304770 -3.6598839435616437 treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753152_0.png resize: (153, 177) 1358304771 -2.910913031925659 treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753151_0.png resize: (150, 243) 1358304773 -2.793104333064135 treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753153_0.png resize: (113, 107) 1358304774 -2.43681307816459 treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753156_0.png resize: (81, 95) 1358304776 -3.924342379583649 treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753169_0.png resize: (245, 295) 1358304778 -4.0927689114160195 treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753174_0.png resize: (174, 152) 1358304779 -3.1774146179689047 treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753178_0.png resize: (205, 140) 1358304781 -3.703387414755709 treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753163_0.png resize: (201, 270) 1358304783 -2.0927552151509885 treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753164_0.png resize: (361, 314) 1358304784 -4.2787418307327885 treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753170_0.png resize: (161, 184) 1358304786 -2.551343914921758 treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753171_0.png resize: (262, 263) 1358304788 -1.4508418717705136 treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753167_0.png resize: (680, 424) 1358304789 -3.6097802121577143 treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753177_0.png resize: (345, 235) 1358304792 -4.877881197591638 treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753166_0.png resize: (326, 323) 1358304793 -3.226844359643991 treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753185_0.png resize: (354, 109) 1358304795 -3.662960975140022 treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753180_0.png resize: (606, 514) 1358304797 -2.2984470729394677 treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753192_0.png resize: (176, 183) 1358304799 -4.236743099160406 treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753191_0.png resize: (170, 146) 1358304801 -2.2701237464335553 treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753184_0.png resize: (216, 115) 1358304802 -2.3630308411937953 treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753181_0.png resize: (214, 165) 1358304804 -3.6095119963620683 treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753188_0.png resize: (124, 338) 1358304806 -4.345656561957291 treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753190_0.png resize: (157, 147) 1358304808 -2.9453880713222067 treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753183_0.png resize: (197, 312) 1358304810 -3.067649264240935 treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753205_0.png resize: (339, 93) 1358304812 -3.473708497271051 treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753202_0.png resize: (621, 502) 1358304814 -2.3283722488556053 treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753209_0.png resize: (65, 120) 1358304815 -2.3292918396469102 treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753214_0.png resize: (123, 78) 1358304817 -0.27751924881529055 treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753203_0.png resize: (197, 107) 1358304819 -1.7898198770941114 treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753199_0.png resize: (119, 314) 1358304820 -4.3343086710976095 treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753215_0.png resize: (269, 177) 1358304822 -3.3648502726286202 treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753208_0.png resize: (291, 372) 1358304824 -3.4229045014563253 treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753204_0.png resize: (150, 138) 1358304825 -3.5659974752538703 treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753206_0.png resize: (150, 314) 1358304827 -2.8784323008279684 treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753211_0.png resize: (136, 147) 1358304828 -3.631027044754806 treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753147_0.png resize: (246, 222) 1358304865 -4.60094765024048 treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753144_0.png resize: (195, 287) 1358304867 -3.5226036989110625 treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753137_0.png resize: (406, 323) 1358304869 -2.7247055162585156 treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753142_0.png resize: (393, 430) 1358304931 -5.000887061758912 treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753140_0.png resize: (358, 417) 1358304932 -4.1810183922323105 treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753146_0.png resize: (329, 373) 1358304933 -4.564872687652984 treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753139_0.png resize: (334, 438) 1358304934 -4.323708247460798 treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753133_0.png resize: (425, 398) 1358304935 -4.648289616309965 treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753136_0.png resize: (342, 135) 1358304936 -4.040802839752606 treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753158_0.png resize: (439, 329) 1358304937 -3.0244484642673624 treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753162_0.png resize: (289, 232) 1358304939 -2.2354008722836913 treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753173_0.png resize: (316, 286) 1358304940 -1.5282190585826332 treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753179_0.png resize: (366, 274) 1358304941 -3.6766063889399856 treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753168_0.png resize: (322, 437) 1358304943 -2.2538237930363474 treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753165_0.png resize: (402, 340) 1358304944 -3.9986112289574685 treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753176_0.png resize: (257, 291) 1358304945 -2.920655415661734 treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753172_0.png resize: (170, 373) 1358304946 -2.3746632885347347 treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753175_0.png resize: (460, 237) 1358304947 -4.367574276240497 treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753198_0.png resize: (791, 572) 1358304948 -1.5797325028526985 treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753195_0.png resize: (390, 344) 1358304949 -5.3782694566985265 treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753189_0.png resize: (246, 257) 1358304950 -4.399751405607367 treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753186_0.png resize: (438, 202) 1358304951 -4.733081718449739 treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753193_0.png resize: (369, 494) 1358304952 -4.595752444433597 treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753194_0.png resize: (192, 169) 1358304953 -3.7441923701300905 treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753187_0.png resize: (539, 238) 1358304954 -3.9606147470554975 treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753196_0.png resize: (208, 339) 1358304955 -4.263366397025314 treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753197_0.png resize: (161, 263) 1358304956 -4.546425027936524 treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753213_0.png resize: (447, 548) 1358304957 -5.132294933337159 treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753200_0.png resize: (290, 415) 1358304958 -4.393814757454515 treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753210_0.png resize: (226, 353) 1358304959 -2.9160325015120945 treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753182_0.png resize: (434, 359) 1358304961 -2.2774738278311526 treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753207_0.png resize: (211, 212) 1358304962 -0.068012428176275 treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753201_0.png resize: (435, 355) 1358304963 -2.2746216473940386 treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753212_0.png resize: (149, 143) 1358304964 -2.9621730021275003 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 90 time used for this insertion : 0.015522003173828125 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 90 time used for this insertion : 0.01583075523376465 save missing photos in datou_result : time spend for datou_step_exec : 25.80217480659485 time spend to save output : 0.03705954551696777 total time spend for step 6 : 25.839234352111816 step7:brightness Wed May 14 19:54:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105.jpg treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19.jpg treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17.jpg treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413.jpg treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2.jpg treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753135_0.png treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753134_0.png treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753149_0.png treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753132_0.png treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753138_0.png treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753145_0.png treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753143_0.png treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753131_0.png treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753141_0.png treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753148_0.png treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753161_0.png treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753155_0.png treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753150_0.png treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753154_0.png treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753159_0.png treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753160_0.png treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753157_0.png treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753152_0.png treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753151_0.png treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753153_0.png treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753156_0.png treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753169_0.png treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753174_0.png treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753178_0.png treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753163_0.png treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753164_0.png treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753170_0.png treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753171_0.png treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753167_0.png treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753177_0.png treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753166_0.png treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753185_0.png treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753180_0.png treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753192_0.png treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753191_0.png treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753184_0.png treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753181_0.png treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753188_0.png treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753190_0.png treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753183_0.png treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753205_0.png treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753202_0.png treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753209_0.png treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753214_0.png treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753203_0.png treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753199_0.png treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753215_0.png treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753208_0.png treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753204_0.png treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753206_0.png treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753211_0.png treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753147_0.png treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753144_0.png treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753137_0.png treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753142_0.png treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753140_0.png treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753146_0.png treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753139_0.png treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753133_0.png treat image : temp/1747245029_4052_1358282981_c27c9c2327bc1a2b2e23c759cc706105_rle_crop_3797753136_0.png treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753158_0.png treat image : temp/1747245029_4052_1358282800_3929b0648239c27484e975ff5ce50d19_rle_crop_3797753162_0.png treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753173_0.png treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753179_0.png treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753168_0.png treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753165_0.png treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753176_0.png treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753172_0.png treat image : temp/1747245029_4052_1358282769_07e38b595ae1dae7ef3f775fb6c7bc17_rle_crop_3797753175_0.png treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753198_0.png treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753195_0.png treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753189_0.png treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753186_0.png treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753193_0.png treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753194_0.png treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753187_0.png treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753196_0.png treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753197_0.png treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753213_0.png treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753200_0.png treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753210_0.png treat image : temp/1747245029_4052_1358282733_b5b10a73778c4edefd0bb2255b298413_rle_crop_3797753182_0.png treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753207_0.png treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753201_0.png treat image : temp/1747245029_4052_1358282700_408b399e29aeea687fac6b92c779c2b2_rle_crop_3797753212_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 90 time used for this insertion : 0.01441812515258789 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 90 time used for this insertion : 0.01786208152770996 save missing photos in datou_result : time spend for datou_step_exec : 5.430403232574463 time spend to save output : 0.03755497932434082 total time spend for step 7 : 5.467958211898804 step8:velours_tree Wed May 14 19:54:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.26103758811950684 time spend to save output : 5.412101745605469e-05 total time spend for step 8 : 0.2610917091369629 step9:send_mail_cod Wed May 14 19:54:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22976914_14-05-2025_19_54_22.pdf 22977872 imagette229778721747245262 22977873 imagette229778731747245262 22977874 imagette229778741747245263 22977875 imagette229778751747245263 22977876 imagette229778761747245263 22977877 imagette229778771747245263 22977878 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229778781747245263 22977879 change filename to text .change filename to text .change filename to text .change filename to text .imagette229778791747245264 22977881 change filename to text .change filename to text .change filename to text .imagette229778811747245265 22977882 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229778821747245265 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22976914 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22977872,22977873,22977874,22977875,22977876,22977877,22977878,22977879,22977880,22977881,22977882?tags=pet_fonce,metal,pehd,background,flou,mal_croppe,pet_clair,autre,environnement,carton,papier args[1358282981] : ((1358282981, -6.427657875381572, 492609224), (1358282981, 0.4620788954629082, 2107752395), '0.11856669560185185') We are sending mail with results at report@fotonower.com args[1358282800] : ((1358282800, -5.84263151423897, 492609224), (1358282800, 0.46000942041992565, 2107752395), '0.11856669560185185') We are sending mail with results at report@fotonower.com args[1358282769] : ((1358282769, -6.399956958409696, 492609224), (1358282769, 0.48335724913878897, 2107752395), '0.11856669560185185') We are sending mail with results at report@fotonower.com args[1358282733] : ((1358282733, -6.635953879390217, 492609224), (1358282733, 0.4366097943994459, 2107752395), '0.11856669560185185') We are sending mail with results at report@fotonower.com args[1358282700] : ((1358282700, -6.634860668467936, 492609224), (1358282700, 0.47599482099930485, 2107752395), '0.11856669560185185') We are sending mail with results at report@fotonower.com refus_total : 0.11856669560185185 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22976914 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22976914_14-05-2025_19_54_22.pdf results_Auto_P22976914_14-05-2025_19_54_22.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22976914_14-05-2025_19_54_22.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22976914','results_Auto_P22976914_14-05-2025_19_54_22.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22976914_14-05-2025_19_54_22.pdf','pdf','','0.59','0.11856669560185185') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22976914

https://www.fotonower.com/image?json=false&list_photos_id=1358282981
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358282800
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358282769
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358282733
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358282700
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 11.86%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/22977878?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22977879?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22977881?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22977882?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22976914_14-05-2025_19_54_22.pdf.

Lien vers velours :https://www.fotonower.com/velours/22977872,22977873,22977874,22977875,22977876,22977877,22977878,22977879,22977880,22977881,22977882?tags=pet_fonce,metal,pehd,background,flou,mal_croppe,pet_clair,autre,environnement,carton,papier.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 14 May 2025 17:54:29 GMT Content-Length: 0 Connection: close X-Message-Id: e1ODnoIfTBCDod23P0BxOg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1358282981, 1358282800, 1358282769, 1358282733, 1358282700] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282981', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282800', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282769', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282733', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282700', None, None, None, None, None, '2853002') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.012318849563598633 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.4619598388671875 time spend to save output : 0.01256251335144043 total time spend for step 9 : 6.474522352218628 step10:split_time_score Wed May 14 19:54:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 5),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 14052025 22976914 Nombre de photos uploadées : 5 / 23040 (0%) 14052025 22976914 Nombre de photos taguées (types de déchets): 0 / 5 (0%) 14052025 22976914 Nombre de photos taguées (volume) : 0 / 5 (0%) elapsed_time : load_data_split_time_score 4.5299530029296875e-06 elapsed_time : order_list_meta_photo_and_scores 1.0013580322265625e-05 ????? elapsed_time : fill_and_build_computed_from_old_data 0.0004875659942626953 elapsed_time : insert_dashboard_record_day_entry 0.022348642349243164 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.15093270158179015 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22948162_14-05-2025_07_47_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22948162 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22948162 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22948165 order by id desc limit 1 Qualite : 0.09967562451774692 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22949538_14-05-2025_08_24_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22949538 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22949538 AND mptpi.`type`=3594 To do Qualite : 0.19506076388888893 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22953035_14-05-2025_10_24_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22953035 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22953035 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22955733 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22958945 order by id desc limit 1 Qualite : 0.16447810169110086 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22960477_14-05-2025_13_05_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22960477 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22960477 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22967472 order by id desc limit 1 Qualite : 0.12331786104681071 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22967479_14-05-2025_15_57_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22967479 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22967479 AND mptpi.`type`=3594 To do Qualite : 0.20919277722663138 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22967499_14-05-2025_15_46_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22967499 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22967499 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22974921 order by id desc limit 1 Qualite : 0.15173109266493065 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22974925_14-05-2025_19_13_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22974925 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22974925 AND mptpi.`type`=3594 To do Qualite : 0.1544977334104938 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22974926_14-05-2025_18_54_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22974926 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22974926 AND mptpi.`type`=3594 To do Qualite : 0.11856669560185185 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22976914_14-05-2025_19_54_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22976914 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22976914 AND mptpi.`type`=3594 To do Qualite : 0.07834983327821868 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22976916_14-05-2025_19_44_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22976916 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22976916 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'14052025': {'nb_upload': 5, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1358282981, 1358282800, 1358282769, 1358282733, 1358282700] Looping around the photos to save general results len do output : 1 /22976914Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282981', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282800', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282769', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282733', None, None, None, None, None, '2853002') ('3318', None, None, None, None, None, None, None, '2853002') ('3318', '22976914', '1358282700', None, None, None, None, None, '2853002') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.012590408325195312 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.09555721282959 time spend to save output : 0.01285243034362793 total time spend for step 10 : 5.108409643173218 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 5 set_done_treatment 98.10user 110.95system 4:10.02elapsed 83%CPU (0avgtext+0avgdata 4429876maxresident)k 1672352inputs+88776outputs (15310major+10287721minor)pagefaults 0swaps