python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1845739 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2778688'] with mtr_portfolio_ids : ['22582550'] and first list_photo_ids : [] new path : /proc/1845739/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.479100227355957 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu May 1 11:10:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 8954 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-01 11:10:32.139979: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-01 11:10:32.171137: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-01 11:10:32.173298: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fcf10000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-01 11:10:32.173365: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-01 11:10:32.178246: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-01 11:10:32.427872: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x417ad9b0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-01 11:10:32.427939: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-01 11:10:32.429483: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-01 11:10:32.430467: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-01 11:10:32.438146: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-01 11:10:32.449119: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-01 11:10:32.450138: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-01 11:10:32.456006: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-01 11:10:32.457823: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-01 11:10:32.478329: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-01 11:10:32.480190: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-01 11:10:32.480318: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-01 11:10:32.481706: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-01 11:10:32.481729: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-01 11:10:32.481741: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-01 11:10:32.483404: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8274 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-01 11:10:32.903152: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-01 11:10:32.903285: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-01 11:10:32.903325: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-01 11:10:32.903359: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-01 11:10:32.903384: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-01 11:10:32.903409: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-01 11:10:32.903432: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-01 11:10:32.903457: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-01 11:10:32.905005: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-01 11:10:32.906381: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-01 11:10:32.906423: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-01 11:10:32.906446: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-01 11:10:32.906464: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-01 11:10:32.906482: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-01 11:10:32.906499: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-01 11:10:32.906516: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-01 11:10:32.906533: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-01 11:10:32.908069: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-01 11:10:32.908110: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-01 11:10:32.908122: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-01 11:10:32.908136: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-01 11:10:32.909687: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8274 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-01 11:10:43.999265: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-01 11:10:44.211019: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 55 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 47.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 34 Detection mask done ! Trying to reset tf kernel 1846314 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2472 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 7761 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0007796287536621094 nb_pixel_total : 20687 time to create 1 rle with old method : 0.028607606887817383 length of segment : 176 time for calcul the mask position with numpy : 0.0006196498870849609 nb_pixel_total : 21995 time to create 1 rle with old method : 0.028564929962158203 length of segment : 216 time for calcul the mask position with numpy : 0.00020694732666015625 nb_pixel_total : 7290 time to create 1 rle with old method : 0.009027957916259766 length of segment : 67 time for calcul the mask position with numpy : 0.001298666000366211 nb_pixel_total : 58449 time to create 1 rle with old method : 0.0727236270904541 length of segment : 422 time for calcul the mask position with numpy : 0.00020456314086914062 nb_pixel_total : 10550 time to create 1 rle with old method : 0.012473106384277344 length of segment : 99 time for calcul the mask position with numpy : 0.00021409988403320312 nb_pixel_total : 8841 time to create 1 rle with old method : 0.010826587677001953 length of segment : 141 time for calcul the mask position with numpy : 0.0003457069396972656 nb_pixel_total : 15244 time to create 1 rle with old method : 0.021773099899291992 length of segment : 126 time for calcul the mask position with numpy : 0.0005300045013427734 nb_pixel_total : 26547 time to create 1 rle with old method : 0.036818504333496094 length of segment : 221 time for calcul the mask position with numpy : 0.003714323043823242 nb_pixel_total : 143402 time to create 1 rle with old method : 0.17223119735717773 length of segment : 371 time for calcul the mask position with numpy : 0.00022220611572265625 nb_pixel_total : 7330 time to create 1 rle with old method : 0.0095672607421875 length of segment : 171 time for calcul the mask position with numpy : 0.00015687942504882812 nb_pixel_total : 7674 time to create 1 rle with old method : 0.00933837890625 length of segment : 103 time for calcul the mask position with numpy : 0.0003962516784667969 nb_pixel_total : 25300 time to create 1 rle with old method : 0.03046441078186035 length of segment : 232 time for calcul the mask position with numpy : 0.0003764629364013672 nb_pixel_total : 19905 time to create 1 rle with old method : 0.024582624435424805 length of segment : 191 time for calcul the mask position with numpy : 0.000705718994140625 nb_pixel_total : 32880 time to create 1 rle with old method : 0.04001140594482422 length of segment : 306 time for calcul the mask position with numpy : 0.001058816909790039 nb_pixel_total : 50455 time to create 1 rle with old method : 0.06148386001586914 length of segment : 248 time for calcul the mask position with numpy : 0.0004756450653076172 nb_pixel_total : 21081 time to create 1 rle with old method : 0.03302621841430664 length of segment : 209 time for calcul the mask position with numpy : 0.001895904541015625 nb_pixel_total : 126580 time to create 1 rle with old method : 0.15206670761108398 length of segment : 368 time for calcul the mask position with numpy : 0.0014681816101074219 nb_pixel_total : 68353 time to create 1 rle with old method : 0.08509302139282227 length of segment : 432 time for calcul the mask position with numpy : 0.0011904239654541016 nb_pixel_total : 47107 time to create 1 rle with old method : 0.059145450592041016 length of segment : 410 time for calcul the mask position with numpy : 0.0006525516510009766 nb_pixel_total : 29142 time to create 1 rle with old method : 0.04678463935852051 length of segment : 178 time for calcul the mask position with numpy : 0.21085119247436523 nb_pixel_total : 342711 time to create 1 rle with new method : 0.3280324935913086 length of segment : 1138 time for calcul the mask position with numpy : 0.009827852249145508 nb_pixel_total : 274578 time to create 1 rle with new method : 0.14131498336791992 length of segment : 880 time for calcul the mask position with numpy : 0.0046460628509521484 nb_pixel_total : 114710 time to create 1 rle with old method : 0.14299321174621582 length of segment : 461 time for calcul the mask position with numpy : 0.0027320384979248047 nb_pixel_total : 79725 time to create 1 rle with old method : 0.10224246978759766 length of segment : 407 time for calcul the mask position with numpy : 0.0015211105346679688 nb_pixel_total : 30157 time to create 1 rle with old method : 0.03634977340698242 length of segment : 210 time for calcul the mask position with numpy : 0.0021398067474365234 nb_pixel_total : 74900 time to create 1 rle with old method : 0.11184287071228027 length of segment : 232 time for calcul the mask position with numpy : 0.0013883113861083984 nb_pixel_total : 30509 time to create 1 rle with old method : 0.038481712341308594 length of segment : 156 time for calcul the mask position with numpy : 0.0029993057250976562 nb_pixel_total : 44346 time to create 1 rle with old method : 0.06070828437805176 length of segment : 479 time for calcul the mask position with numpy : 0.0005657672882080078 nb_pixel_total : 12446 time to create 1 rle with old method : 0.015311241149902344 length of segment : 154 time for calcul the mask position with numpy : 0.0020651817321777344 nb_pixel_total : 54178 time to create 1 rle with old method : 0.0645449161529541 length of segment : 328 time for calcul the mask position with numpy : 0.0012476444244384766 nb_pixel_total : 32956 time to create 1 rle with old method : 0.038666725158691406 length of segment : 240 time for calcul the mask position with numpy : 0.0014026165008544922 nb_pixel_total : 40650 time to create 1 rle with old method : 0.04945492744445801 length of segment : 190 time for calcul the mask position with numpy : 0.003383636474609375 nb_pixel_total : 86464 time to create 1 rle with old method : 0.10279035568237305 length of segment : 350 time for calcul the mask position with numpy : 0.0005664825439453125 nb_pixel_total : 10368 time to create 1 rle with old method : 0.012676477432250977 length of segment : 161 time for calcul the mask position with numpy : 0.0007200241088867188 nb_pixel_total : 20806 time to create 1 rle with old method : 0.025182485580444336 length of segment : 120 time for calcul the mask position with numpy : 0.003564596176147461 nb_pixel_total : 69840 time to create 1 rle with old method : 0.10078835487365723 length of segment : 434 time for calcul the mask position with numpy : 0.0013127326965332031 nb_pixel_total : 29628 time to create 1 rle with old method : 0.03547954559326172 length of segment : 350 time for calcul the mask position with numpy : 0.0011038780212402344 nb_pixel_total : 29579 time to create 1 rle with old method : 0.03531670570373535 length of segment : 472 time for calcul the mask position with numpy : 0.0029065608978271484 nb_pixel_total : 59148 time to create 1 rle with old method : 0.07049155235290527 length of segment : 338 time for calcul the mask position with numpy : 0.003860950469970703 nb_pixel_total : 61776 time to create 1 rle with old method : 0.07787227630615234 length of segment : 364 time for calcul the mask position with numpy : 0.0024530887603759766 nb_pixel_total : 37801 time to create 1 rle with old method : 0.046770572662353516 length of segment : 241 time for calcul the mask position with numpy : 0.0014209747314453125 nb_pixel_total : 19088 time to create 1 rle with old method : 0.046278953552246094 length of segment : 167 time for calcul the mask position with numpy : 0.0044672489166259766 nb_pixel_total : 43095 time to create 1 rle with old method : 0.058975934982299805 length of segment : 414 time for calcul the mask position with numpy : 0.001135110855102539 nb_pixel_total : 22199 time to create 1 rle with old method : 0.027195453643798828 length of segment : 191 time for calcul the mask position with numpy : 0.0013840198516845703 nb_pixel_total : 12450 time to create 1 rle with old method : 0.015693187713623047 length of segment : 176 time for calcul the mask position with numpy : 0.001055002212524414 nb_pixel_total : 19249 time to create 1 rle with old method : 0.02315354347229004 length of segment : 260 time for calcul the mask position with numpy : 0.003968000411987305 nb_pixel_total : 63734 time to create 1 rle with old method : 0.07631802558898926 length of segment : 367 time for calcul the mask position with numpy : 0.002810239791870117 nb_pixel_total : 30497 time to create 1 rle with old method : 0.03641152381896973 length of segment : 305 time for calcul the mask position with numpy : 0.0041310787200927734 nb_pixel_total : 59755 time to create 1 rle with old method : 0.07071089744567871 length of segment : 368 time for calcul the mask position with numpy : 0.0008783340454101562 nb_pixel_total : 17397 time to create 1 rle with old method : 0.021218061447143555 length of segment : 173 time for calcul the mask position with numpy : 0.0007350444793701172 nb_pixel_total : 21413 time to create 1 rle with old method : 0.026238441467285156 length of segment : 165 time for calcul the mask position with numpy : 0.0010263919830322266 nb_pixel_total : 18761 time to create 1 rle with old method : 0.022439956665039062 length of segment : 141 time for calcul the mask position with numpy : 0.0023920536041259766 nb_pixel_total : 32759 time to create 1 rle with old method : 0.040785789489746094 length of segment : 203 time for calcul the mask position with numpy : 0.00255584716796875 nb_pixel_total : 59159 time to create 1 rle with old method : 0.07413721084594727 length of segment : 281 time for calcul the mask position with numpy : 0.0007371902465820312 nb_pixel_total : 10460 time to create 1 rle with old method : 0.016858816146850586 length of segment : 122 time for calcul the mask position with numpy : 0.0010504722595214844 nb_pixel_total : 15164 time to create 1 rle with old method : 0.019479990005493164 length of segment : 281 time for calcul the mask position with numpy : 0.0007476806640625 nb_pixel_total : 19731 time to create 1 rle with old method : 0.02398967742919922 length of segment : 193 time for calcul the mask position with numpy : 0.0007364749908447266 nb_pixel_total : 8497 time to create 1 rle with old method : 0.010684728622436523 length of segment : 144 time for calcul the mask position with numpy : 0.0019228458404541016 nb_pixel_total : 23619 time to create 1 rle with old method : 0.028540372848510742 length of segment : 306 time for calcul the mask position with numpy : 0.0011255741119384766 nb_pixel_total : 13024 time to create 1 rle with old method : 0.01599287986755371 length of segment : 170 time for calcul the mask position with numpy : 0.0003936290740966797 nb_pixel_total : 6286 time to create 1 rle with old method : 0.0077266693115234375 length of segment : 150 time for calcul the mask position with numpy : 0.0009293556213378906 nb_pixel_total : 13006 time to create 1 rle with old method : 0.016164064407348633 length of segment : 190 time for calcul the mask position with numpy : 0.0003058910369873047 nb_pixel_total : 11599 time to create 1 rle with old method : 0.014234781265258789 length of segment : 108 time for calcul the mask position with numpy : 0.009650707244873047 nb_pixel_total : 272659 time to create 1 rle with new method : 0.029987812042236328 length of segment : 797 time for calcul the mask position with numpy : 0.0005424022674560547 nb_pixel_total : 15565 time to create 1 rle with old method : 0.019290924072265625 length of segment : 136 time for calcul the mask position with numpy : 0.001483917236328125 nb_pixel_total : 49707 time to create 1 rle with old method : 0.061376094818115234 length of segment : 260 time for calcul the mask position with numpy : 0.0013141632080078125 nb_pixel_total : 40473 time to create 1 rle with old method : 0.04940676689147949 length of segment : 266 time for calcul the mask position with numpy : 0.0006639957427978516 nb_pixel_total : 19817 time to create 1 rle with old method : 0.024498701095581055 length of segment : 130 time for calcul the mask position with numpy : 0.00738525390625 nb_pixel_total : 311504 time to create 1 rle with new method : 0.01728653907775879 length of segment : 634 time for calcul the mask position with numpy : 0.0006783008575439453 nb_pixel_total : 12207 time to create 1 rle with old method : 0.014886617660522461 length of segment : 137 time for calcul the mask position with numpy : 0.0007445812225341797 nb_pixel_total : 20419 time to create 1 rle with old method : 0.024992704391479492 length of segment : 145 time for calcul the mask position with numpy : 0.0022742748260498047 nb_pixel_total : 84450 time to create 1 rle with old method : 0.10569429397583008 length of segment : 295 time for calcul the mask position with numpy : 0.0005505084991455078 nb_pixel_total : 8432 time to create 1 rle with old method : 0.011641263961791992 length of segment : 102 time for calcul the mask position with numpy : 0.03925800323486328 nb_pixel_total : 573507 time to create 1 rle with new method : 0.06216835975646973 length of segment : 1070 time for calcul the mask position with numpy : 0.06251811981201172 nb_pixel_total : 649695 time to create 1 rle with new method : 0.08239579200744629 length of segment : 1226 time for calcul the mask position with numpy : 0.0008268356323242188 nb_pixel_total : 13150 time to create 1 rle with old method : 0.022356271743774414 length of segment : 117 time for calcul the mask position with numpy : 0.00035381317138671875 nb_pixel_total : 5004 time to create 1 rle with old method : 0.008436441421508789 length of segment : 63 time for calcul the mask position with numpy : 0.00039958953857421875 nb_pixel_total : 14498 time to create 1 rle with old method : 0.02452874183654785 length of segment : 97 time for calcul the mask position with numpy : 0.0012412071228027344 nb_pixel_total : 35332 time to create 1 rle with old method : 0.04305529594421387 length of segment : 212 time for calcul the mask position with numpy : 0.0007140636444091797 nb_pixel_total : 30948 time to create 1 rle with old method : 0.03815340995788574 length of segment : 249 time for calcul the mask position with numpy : 0.00027370452880859375 nb_pixel_total : 6817 time to create 1 rle with old method : 0.008537769317626953 length of segment : 92 time for calcul the mask position with numpy : 0.0005850791931152344 nb_pixel_total : 14553 time to create 1 rle with old method : 0.01753377914428711 length of segment : 201 time for calcul the mask position with numpy : 0.00116729736328125 nb_pixel_total : 28113 time to create 1 rle with old method : 0.035515785217285156 length of segment : 294 time for calcul the mask position with numpy : 0.00014519691467285156 nb_pixel_total : 2491 time to create 1 rle with old method : 0.003195047378540039 length of segment : 52 time for calcul the mask position with numpy : 0.00030493736267089844 nb_pixel_total : 10198 time to create 1 rle with old method : 0.012712478637695312 length of segment : 112 time for calcul the mask position with numpy : 0.0005431175231933594 nb_pixel_total : 14033 time to create 1 rle with old method : 0.017128944396972656 length of segment : 169 time for calcul the mask position with numpy : 0.0006558895111083984 nb_pixel_total : 21062 time to create 1 rle with old method : 0.025249242782592773 length of segment : 189 time for calcul the mask position with numpy : 0.0026209354400634766 nb_pixel_total : 98197 time to create 1 rle with old method : 0.11863946914672852 length of segment : 513 time for calcul the mask position with numpy : 0.0006515979766845703 nb_pixel_total : 31180 time to create 1 rle with old method : 0.03806710243225098 length of segment : 157 time for calcul the mask position with numpy : 0.0004820823669433594 nb_pixel_total : 16238 time to create 1 rle with old method : 0.019577741622924805 length of segment : 155 time for calcul the mask position with numpy : 0.020731687545776367 nb_pixel_total : 533607 time to create 1 rle with new method : 0.05639934539794922 length of segment : 802 time for calcul the mask position with numpy : 0.008107662200927734 nb_pixel_total : 230885 time to create 1 rle with new method : 0.013170242309570312 length of segment : 879 time for calcul the mask position with numpy : 0.029228925704956055 nb_pixel_total : 573130 time to create 1 rle with new method : 0.2581350803375244 length of segment : 1258 time for calcul the mask position with numpy : 0.0008959770202636719 nb_pixel_total : 22179 time to create 1 rle with old method : 0.028402090072631836 length of segment : 140 time for calcul the mask position with numpy : 0.0017168521881103516 nb_pixel_total : 88856 time to create 1 rle with old method : 0.10584282875061035 length of segment : 405 time for calcul the mask position with numpy : 0.0037860870361328125 nb_pixel_total : 125521 time to create 1 rle with old method : 0.15881991386413574 length of segment : 480 time for calcul the mask position with numpy : 0.0016896724700927734 nb_pixel_total : 18924 time to create 1 rle with old method : 0.022851943969726562 length of segment : 135 time for calcul the mask position with numpy : 0.013881683349609375 nb_pixel_total : 454773 time to create 1 rle with new method : 0.26847410202026367 length of segment : 805 time for calcul the mask position with numpy : 0.007372379302978516 nb_pixel_total : 190644 time to create 1 rle with new method : 0.012087345123291016 length of segment : 404 time for calcul the mask position with numpy : 0.0034470558166503906 nb_pixel_total : 69525 time to create 1 rle with old method : 0.08682990074157715 length of segment : 471 time for calcul the mask position with numpy : 0.0019299983978271484 nb_pixel_total : 57293 time to create 1 rle with old method : 0.07093691825866699 length of segment : 291 time for calcul the mask position with numpy : 0.0023615360260009766 nb_pixel_total : 79034 time to create 1 rle with old method : 0.09466671943664551 length of segment : 223 time for calcul the mask position with numpy : 0.0019919872283935547 nb_pixel_total : 43243 time to create 1 rle with old method : 0.052205562591552734 length of segment : 222 time for calcul the mask position with numpy : 0.0045092105865478516 nb_pixel_total : 124991 time to create 1 rle with old method : 0.15597772598266602 length of segment : 362 time for calcul the mask position with numpy : 0.00033736228942871094 nb_pixel_total : 6140 time to create 1 rle with old method : 0.007662057876586914 length of segment : 106 time for calcul the mask position with numpy : 0.006144523620605469 nb_pixel_total : 240800 time to create 1 rle with new method : 0.009065389633178711 length of segment : 605 time for calcul the mask position with numpy : 0.0003018379211425781 nb_pixel_total : 5892 time to create 1 rle with old method : 0.007307767868041992 length of segment : 98 time for calcul the mask position with numpy : 0.0012290477752685547 nb_pixel_total : 28810 time to create 1 rle with old method : 0.034517765045166016 length of segment : 305 time spent for convertir_results : 12.76252794265747 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 108 chid ids of type : 3594 Number RLEs to save : 33128 save missing photos in datou_result : time spend for datou_step_exec : 69.18086194992065 time spend to save output : 2.135871171951294 total time spend for step 1 : 71.31673312187195 step2:crop_condition Thu May 1 11:11:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 108 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 67 About to insert : list_path_to_insert length 67 new photo from crops ! About to upload 67 photos upload in portfolio : 3736932 init cache_photo without model_param we have 67 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746090722_1845739 we have uploaded 67 photos in the portfolio 3736932 time of upload the photos Elapsed time : 20.965909957885742 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 18 About to insert : list_path_to_insert length 18 new photo from crops ! About to upload 18 photos upload in portfolio : 3736932 init cache_photo without model_param we have 18 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746090751_1845739 we have uploaded 18 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.4057536125183105 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 3736932 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746090767_1845739 we have uploaded 21 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.838876724243164 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746090775_1845739 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6529452800750732 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1354756117, 1354750857, 1354750602, 1354750551, 1354750506, 1354750472, 1354750460, 1354749931] Looping around the photos to save general results len do output : 108 /1355081044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355081179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354756117', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750857', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750602', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750551', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750506', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750472', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750460', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354749931', None, None, None, None, None, '2778688') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 332 time used for this insertion : 0.029141664505004883 save_final save missing photos in datou_result : time spend for datou_step_exec : 75.61968564987183 time spend to save output : 0.03338146209716797 total time spend for step 2 : 75.653067111969 step3:rle_unique_nms_with_priority Thu May 1 11:12:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 108 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 12 nb_hashtags : 2 time to prepare the origin masks : 8.219099044799805 time for calcul the mask position with numpy : 0.605266809463501 nb_pixel_total : 6722435 time to create 1 rle with new method : 1.3677890300750732 time for calcul the mask position with numpy : 0.03934335708618164 nb_pixel_total : 199 time to create 1 rle with old method : 0.0003750324249267578 time for calcul the mask position with numpy : 0.0374906063079834 nb_pixel_total : 7674 time to create 1 rle with old method : 0.009017705917358398 time for calcul the mask position with numpy : 0.03913116455078125 nb_pixel_total : 6927 time to create 1 rle with old method : 0.008514165878295898 time for calcul the mask position with numpy : 0.0410001277923584 nb_pixel_total : 143402 time to create 1 rle with old method : 0.1740550994873047 time for calcul the mask position with numpy : 0.03790545463562012 nb_pixel_total : 26547 time to create 1 rle with old method : 0.03317451477050781 time for calcul the mask position with numpy : 0.036171913146972656 nb_pixel_total : 15244 time to create 1 rle with old method : 0.018904924392700195 time for calcul the mask position with numpy : 0.04174017906188965 nb_pixel_total : 8841 time to create 1 rle with old method : 0.011321306228637695 time for calcul the mask position with numpy : 0.03647017478942871 nb_pixel_total : 10550 time to create 1 rle with old method : 0.013914346694946289 time for calcul the mask position with numpy : 0.038948774337768555 nb_pixel_total : 58449 time to create 1 rle with old method : 0.06809020042419434 time for calcul the mask position with numpy : 0.03820514678955078 nb_pixel_total : 7290 time to create 1 rle with old method : 0.008520126342773438 time for calcul the mask position with numpy : 0.03625893592834473 nb_pixel_total : 21995 time to create 1 rle with old method : 0.027051925659179688 time for calcul the mask position with numpy : 0.03568315505981445 nb_pixel_total : 20687 time to create 1 rle with old method : 0.02823352813720703 create new chi : 2.8730039596557617 time to delete rle : 0.031754493713378906 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 6425 TO DO : save crop sub photo not yet done ! save time : 0.44349002838134766 nb_obj : 6 nb_hashtags : 1 time to prepare the origin masks : 4.010294198989868 time for calcul the mask position with numpy : 0.7236425876617432 nb_pixel_total : 6730986 time to create 1 rle with new method : 0.7674884796142578 time for calcul the mask position with numpy : 0.04132843017578125 nb_pixel_total : 68353 time to create 1 rle with old method : 0.0756833553314209 time for calcul the mask position with numpy : 0.042865753173828125 nb_pixel_total : 126580 time to create 1 rle with old method : 0.14954686164855957 time for calcul the mask position with numpy : 0.0389552116394043 nb_pixel_total : 21081 time to create 1 rle with old method : 0.023797273635864258 time for calcul the mask position with numpy : 0.031200408935546875 nb_pixel_total : 50455 time to create 1 rle with old method : 0.07399964332580566 time for calcul the mask position with numpy : 0.04367971420288086 nb_pixel_total : 32880 time to create 1 rle with old method : 0.040676116943359375 time for calcul the mask position with numpy : 0.027799367904663086 nb_pixel_total : 19905 time to create 1 rle with old method : 0.03094339370727539 create new chi : 2.158132791519165 time to delete rle : 0.002405405044555664 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5668 TO DO : save crop sub photo not yet done ! save time : 0.4168274402618408 nb_obj : 20 nb_hashtags : 4 time to prepare the origin masks : 10.578186273574829 time for calcul the mask position with numpy : 0.5144925117492676 nb_pixel_total : 5622237 time to create 1 rle with new method : 0.9945502281188965 time for calcul the mask position with numpy : 0.04105782508850098 nb_pixel_total : 3261 time to create 1 rle with old method : 0.004586935043334961 time for calcul the mask position with numpy : 0.0445556640625 nb_pixel_total : 29628 time to create 1 rle with old method : 0.03512835502624512 time for calcul the mask position with numpy : 0.04453611373901367 nb_pixel_total : 69840 time to create 1 rle with old method : 0.08280515670776367 time for calcul the mask position with numpy : 0.04064369201660156 nb_pixel_total : 20806 time to create 1 rle with old method : 0.024763822555541992 time for calcul the mask position with numpy : 0.03754162788391113 nb_pixel_total : 10368 time to create 1 rle with old method : 0.012139320373535156 time for calcul the mask position with numpy : 0.042220354080200195 nb_pixel_total : 86464 time to create 1 rle with old method : 0.1429615020751953 time for calcul the mask position with numpy : 0.045192718505859375 nb_pixel_total : 40650 time to create 1 rle with old method : 0.049184560775756836 time for calcul the mask position with numpy : 0.03863096237182617 nb_pixel_total : 32956 time to create 1 rle with old method : 0.05305361747741699 time for calcul the mask position with numpy : 0.03593111038208008 nb_pixel_total : 54178 time to create 1 rle with old method : 0.06337642669677734 time for calcul the mask position with numpy : 0.035475969314575195 nb_pixel_total : 12446 time to create 1 rle with old method : 0.01781487464904785 time for calcul the mask position with numpy : 0.03787565231323242 nb_pixel_total : 44346 time to create 1 rle with old method : 0.05244708061218262 time for calcul the mask position with numpy : 0.04042863845825195 nb_pixel_total : 30509 time to create 1 rle with old method : 0.03579878807067871 time for calcul the mask position with numpy : 0.03522944450378418 nb_pixel_total : 74900 time to create 1 rle with old method : 0.0882108211517334 time for calcul the mask position with numpy : 0.03485560417175293 nb_pixel_total : 30157 time to create 1 rle with old method : 0.03567695617675781 time for calcul the mask position with numpy : 0.03645014762878418 nb_pixel_total : 79725 time to create 1 rle with old method : 0.09192705154418945 time for calcul the mask position with numpy : 0.03270912170410156 nb_pixel_total : 114710 time to create 1 rle with old method : 0.1427764892578125 time for calcul the mask position with numpy : 0.032117366790771484 nb_pixel_total : 274099 time to create 1 rle with new method : 0.5771584510803223 time for calcul the mask position with numpy : 0.0435943603515625 nb_pixel_total : 342711 time to create 1 rle with new method : 0.6072220802307129 time for calcul the mask position with numpy : 0.03617691993713379 nb_pixel_total : 29142 time to create 1 rle with old method : 0.0339963436126709 time for calcul the mask position with numpy : 0.04497075080871582 nb_pixel_total : 47107 time to create 1 rle with old method : 0.06304764747619629 create new chi : 4.61093282699585 time to delete rle : 0.0037810802459716797 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++Number RLEs to save : 16185 TO DO : save crop sub photo not yet done ! save time : 1.0516293048858643 nb_obj : 25 nb_hashtags : 3 time to prepare the origin masks : 11.852585792541504 time for calcul the mask position with numpy : 0.7945520877838135 nb_pixel_total : 6351357 time to create 1 rle with new method : 1.0221600532531738 time for calcul the mask position with numpy : 0.03812456130981445 nb_pixel_total : 11150 time to create 1 rle with old method : 0.01369476318359375 time for calcul the mask position with numpy : 0.03912639617919922 nb_pixel_total : 12749 time to create 1 rle with old method : 0.015445947647094727 time for calcul the mask position with numpy : 0.039259910583496094 nb_pixel_total : 6286 time to create 1 rle with old method : 0.007643699645996094 time for calcul the mask position with numpy : 0.0414578914642334 nb_pixel_total : 13024 time to create 1 rle with old method : 0.01555323600769043 time for calcul the mask position with numpy : 0.040125131607055664 nb_pixel_total : 23619 time to create 1 rle with old method : 0.028087854385375977 time for calcul the mask position with numpy : 0.04332780838012695 nb_pixel_total : 8497 time to create 1 rle with old method : 0.010816097259521484 time for calcul the mask position with numpy : 0.03911256790161133 nb_pixel_total : 19653 time to create 1 rle with old method : 0.03326892852783203 time for calcul the mask position with numpy : 0.04449629783630371 nb_pixel_total : 15164 time to create 1 rle with old method : 0.01808476448059082 time for calcul the mask position with numpy : 0.03857731819152832 nb_pixel_total : 10460 time to create 1 rle with old method : 0.012196063995361328 time for calcul the mask position with numpy : 0.04038286209106445 nb_pixel_total : 59159 time to create 1 rle with old method : 0.07308411598205566 time for calcul the mask position with numpy : 0.042743682861328125 nb_pixel_total : 32759 time to create 1 rle with old method : 0.04667997360229492 time for calcul the mask position with numpy : 0.04266166687011719 nb_pixel_total : 18761 time to create 1 rle with old method : 0.021973371505737305 time for calcul the mask position with numpy : 0.038971900939941406 nb_pixel_total : 21413 time to create 1 rle with old method : 0.02843928337097168 time for calcul the mask position with numpy : 0.03709745407104492 nb_pixel_total : 17397 time to create 1 rle with old method : 0.02297210693359375 time for calcul the mask position with numpy : 0.03740525245666504 nb_pixel_total : 59755 time to create 1 rle with old method : 0.07171773910522461 time for calcul the mask position with numpy : 0.03354001045227051 nb_pixel_total : 30497 time to create 1 rle with old method : 0.03660130500793457 time for calcul the mask position with numpy : 0.0398256778717041 nb_pixel_total : 63734 time to create 1 rle with old method : 0.0756845474243164 time for calcul the mask position with numpy : 0.04205751419067383 nb_pixel_total : 19249 time to create 1 rle with old method : 0.022597074508666992 time for calcul the mask position with numpy : 0.036887407302856445 nb_pixel_total : 12450 time to create 1 rle with old method : 0.01630711555480957 time for calcul the mask position with numpy : 0.039777278900146484 nb_pixel_total : 22199 time to create 1 rle with old method : 0.02639293670654297 time for calcul the mask position with numpy : 0.04227852821350098 nb_pixel_total : 43095 time to create 1 rle with old method : 0.05495333671569824 time for calcul the mask position with numpy : 0.03594064712524414 nb_pixel_total : 19088 time to create 1 rle with old method : 0.022526979446411133 time for calcul the mask position with numpy : 0.03890681266784668 nb_pixel_total : 37801 time to create 1 rle with old method : 0.05806851387023926 time for calcul the mask position with numpy : 0.0466005802154541 nb_pixel_total : 61776 time to create 1 rle with old method : 0.09665274620056152 time for calcul the mask position with numpy : 0.0465703010559082 nb_pixel_total : 59148 time to create 1 rle with old method : 0.0778651237487793 create new chi : 3.77811336517334 time to delete rle : 0.0029993057250976562 batch 1 Loaded 51 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 13659 TO DO : save crop sub photo not yet done ! save time : 0.8879439830780029 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 5.634155035018921 time for calcul the mask position with numpy : 0.6487061977386475 nb_pixel_total : 6223483 time to create 1 rle with new method : 0.923724889755249 time for calcul the mask position with numpy : 0.04441547393798828 nb_pixel_total : 84450 time to create 1 rle with old method : 0.11057543754577637 time for calcul the mask position with numpy : 0.036084651947021484 nb_pixel_total : 20419 time to create 1 rle with old method : 0.023687124252319336 time for calcul the mask position with numpy : 0.03475761413574219 nb_pixel_total : 12207 time to create 1 rle with old method : 0.014387369155883789 time for calcul the mask position with numpy : 0.03421974182128906 nb_pixel_total : 311460 time to create 1 rle with new method : 0.745112419128418 time for calcul the mask position with numpy : 0.02970743179321289 nb_pixel_total : 19817 time to create 1 rle with old method : 0.023262739181518555 time for calcul the mask position with numpy : 0.02414560317993164 nb_pixel_total : 40473 time to create 1 rle with old method : 0.05125594139099121 time for calcul the mask position with numpy : 0.02322673797607422 nb_pixel_total : 49707 time to create 1 rle with old method : 0.05843806266784668 time for calcul the mask position with numpy : 0.02297663688659668 nb_pixel_total : 15565 time to create 1 rle with old method : 0.01835918426513672 time for calcul the mask position with numpy : 0.023917436599731445 nb_pixel_total : 272659 time to create 1 rle with new method : 0.6049671173095703 create new chi : 3.5901262760162354 time to delete rle : 0.001861572265625 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++Number RLEs to save : 7737 TO DO : save crop sub photo not yet done ! save time : 0.5475189685821533 nb_obj : 13 nb_hashtags : 2 time to prepare the origin masks : 7.154917240142822 time for calcul the mask position with numpy : 1.460247278213501 nb_pixel_total : 5660464 time to create 1 rle with new method : 0.8740181922912598 time for calcul the mask position with numpy : 0.03445887565612793 nb_pixel_total : 10198 time to create 1 rle with old method : 0.016682147979736328 time for calcul the mask position with numpy : 0.03900289535522461 nb_pixel_total : 1810 time to create 1 rle with old method : 0.002780437469482422 time for calcul the mask position with numpy : 0.03849363327026367 nb_pixel_total : 28113 time to create 1 rle with old method : 0.03448152542114258 time for calcul the mask position with numpy : 0.037874460220336914 nb_pixel_total : 14553 time to create 1 rle with old method : 0.024538516998291016 time for calcul the mask position with numpy : 0.038433074951171875 nb_pixel_total : 6817 time to create 1 rle with old method : 0.008059978485107422 time for calcul the mask position with numpy : 0.03642082214355469 nb_pixel_total : 30948 time to create 1 rle with old method : 0.037323713302612305 time for calcul the mask position with numpy : 0.03719186782836914 nb_pixel_total : 35246 time to create 1 rle with old method : 0.04175376892089844 time for calcul the mask position with numpy : 0.03570151329040527 nb_pixel_total : 12303 time to create 1 rle with old method : 0.014594554901123047 time for calcul the mask position with numpy : 0.0388944149017334 nb_pixel_total : 5004 time to create 1 rle with old method : 0.006033658981323242 time for calcul the mask position with numpy : 0.036286115646362305 nb_pixel_total : 13150 time to create 1 rle with old method : 0.015686750411987305 time for calcul the mask position with numpy : 0.029754638671875 nb_pixel_total : 649695 time to create 1 rle with new method : 0.9792003631591797 time for calcul the mask position with numpy : 0.0326535701751709 nb_pixel_total : 573507 time to create 1 rle with new method : 0.8160560131072998 time for calcul the mask position with numpy : 0.0366673469543457 nb_pixel_total : 8432 time to create 1 rle with old method : 0.00985574722290039 create new chi : 4.90229058265686 time to delete rle : 0.0018086433410644531 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 9846 TO DO : save crop sub photo not yet done ! save time : 0.6874902248382568 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 3.235889196395874 time for calcul the mask position with numpy : 0.6735508441925049 nb_pixel_total : 6869530 time to create 1 rle with new method : 1.3086647987365723 time for calcul the mask position with numpy : 0.03618121147155762 nb_pixel_total : 16238 time to create 1 rle with old method : 0.0192718505859375 time for calcul the mask position with numpy : 0.03155922889709473 nb_pixel_total : 31180 time to create 1 rle with old method : 0.03670835494995117 time for calcul the mask position with numpy : 0.023922443389892578 nb_pixel_total : 98197 time to create 1 rle with old method : 0.11153554916381836 time for calcul the mask position with numpy : 0.021258831024169922 nb_pixel_total : 21062 time to create 1 rle with old method : 0.026999235153198242 time for calcul the mask position with numpy : 0.021808385848999023 nb_pixel_total : 14033 time to create 1 rle with old method : 0.018609046936035156 create new chi : 2.3690171241760254 time to delete rle : 0.0007843971252441406 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 4526 TO DO : save crop sub photo not yet done ! save time : 0.3598029613494873 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 8.896252155303955 time for calcul the mask position with numpy : 0.7497978210449219 nb_pixel_total : 4171368 time to create 1 rle with new method : 0.8516793251037598 time for calcul the mask position with numpy : 0.0230255126953125 nb_pixel_total : 28810 time to create 1 rle with old method : 0.03491806983947754 time for calcul the mask position with numpy : 0.02386021614074707 nb_pixel_total : 5892 time to create 1 rle with old method : 0.006975650787353516 time for calcul the mask position with numpy : 0.026754379272460938 nb_pixel_total : 240800 time to create 1 rle with new method : 0.8852622509002686 time for calcul the mask position with numpy : 0.03520059585571289 nb_pixel_total : 6140 time to create 1 rle with old method : 0.00901341438293457 time for calcul the mask position with numpy : 0.03670215606689453 nb_pixel_total : 110237 time to create 1 rle with old method : 0.13043594360351562 time for calcul the mask position with numpy : 0.03751373291015625 nb_pixel_total : 43243 time to create 1 rle with old method : 0.050272464752197266 time for calcul the mask position with numpy : 0.037670135498046875 nb_pixel_total : 79034 time to create 1 rle with old method : 0.09388208389282227 time for calcul the mask position with numpy : 0.037656307220458984 nb_pixel_total : 57293 time to create 1 rle with old method : 0.06687116622924805 time for calcul the mask position with numpy : 0.03558087348937988 nb_pixel_total : 68904 time to create 1 rle with old method : 0.08334469795227051 time for calcul the mask position with numpy : 0.03691220283508301 nb_pixel_total : 190644 time to create 1 rle with new method : 0.8746073246002197 time for calcul the mask position with numpy : 0.07814526557922363 nb_pixel_total : 454773 time to create 1 rle with new method : 0.6418344974517822 time for calcul the mask position with numpy : 0.023247718811035156 nb_pixel_total : 18924 time to create 1 rle with old method : 0.0223691463470459 time for calcul the mask position with numpy : 0.02498650550842285 nb_pixel_total : 125521 time to create 1 rle with old method : 0.17338776588439941 time for calcul the mask position with numpy : 0.025241374969482422 nb_pixel_total : 88856 time to create 1 rle with old method : 0.10287141799926758 time for calcul the mask position with numpy : 0.02276158332824707 nb_pixel_total : 22179 time to create 1 rle with old method : 0.025806427001953125 time for calcul the mask position with numpy : 0.027526140213012695 nb_pixel_total : 573130 time to create 1 rle with new method : 0.9246108531951904 time for calcul the mask position with numpy : 0.023172378540039062 nb_pixel_total : 230885 time to create 1 rle with new method : 0.659353494644165 time for calcul the mask position with numpy : 0.025773286819458008 nb_pixel_total : 533607 time to create 1 rle with new method : 1.1050410270690918 create new chi : 8.31177568435669 time to delete rle : 0.009468793869018555 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 17880 TO DO : save crop sub photo not yet done ! save time : 1.1904683113098145 map_output_result : {1354756117: (0.0, 'Should be the crop_list due to order', 0), 1354750857: (0.0, 'Should be the crop_list due to order', 0), 1354750602: (0.0, 'Should be the crop_list due to order', 0), 1354750551: (0.0, 'Should be the crop_list due to order', 0), 1354750506: (0.0, 'Should be the crop_list due to order', 0), 1354750472: (0.0, 'Should be the crop_list due to order', 0), 1354750460: (0.0, 'Should be the crop_list due to order', 0), 1354749931: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1354756117, 1354750857, 1354750602, 1354750551, 1354750506, 1354750472, 1354750460, 1354749931] Looping around the photos to save general results len do output : 8 /1354756117.Didn't retrieve data . /1354750857.Didn't retrieve data . /1354750602.Didn't retrieve data . /1354750551.Didn't retrieve data . /1354750506.Didn't retrieve data . /1354750472.Didn't retrieve data . /1354750460.Didn't retrieve data . /1354749931.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354756117', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750857', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750602', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750551', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750506', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750472', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750460', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354749931', None, None, None, None, None, '2778688') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.014897346496582031 save_final save missing photos in datou_result : time spend for datou_step_exec : 98.99668502807617 time spend to save output : 0.015471935272216797 total time spend for step 3 : 99.01215696334839 step4:ventilate_hashtags_in_portfolio Thu May 1 11:14:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22582550 get user id for portfolio 22582550 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582550 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','carton','flou','metal','autre','pehd','pet_clair','pet_fonce','background','environnement','papier')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582550 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','carton','flou','metal','autre','pehd','pet_clair','pet_fonce','background','environnement','papier')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582550 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','carton','flou','metal','autre','pehd','pet_clair','pet_fonce','background','environnement','papier')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22583794,22583795,22583796,22583797,22583798,22583799,22583800,22583801,22583802,22583803,22583804?tags=mal_croppe,carton,flou,metal,autre,pehd,pet_clair,pet_fonce,background,environnement,papier Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1354756117, 1354750857, 1354750602, 1354750551, 1354750506, 1354750472, 1354750460, 1354749931] Looping around the photos to save general results len do output : 1 /22582550. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354756117', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750857', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750602', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750551', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750506', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750472', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750460', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354749931', None, None, None, None, None, '2778688') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.016826629638671875 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6024651527404785 time spend to save output : 0.01706671714782715 total time spend for step 4 : 1.6195318698883057 step5:final Thu May 1 11:14:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1354756117: ('0.14272670150236025',), 1354750857: ('0.14272670150236025',), 1354750602: ('0.14272670150236025',), 1354750551: ('0.14272670150236025',), 1354750506: ('0.14272670150236025',), 1354750472: ('0.14272670150236025',), 1354750460: ('0.14272670150236025',), 1354749931: ('0.14272670150236025',)} new output for save of step final : {1354756117: ('0.14272670150236025',), 1354750857: ('0.14272670150236025',), 1354750602: ('0.14272670150236025',), 1354750551: ('0.14272670150236025',), 1354750506: ('0.14272670150236025',), 1354750472: ('0.14272670150236025',), 1354750460: ('0.14272670150236025',), 1354749931: ('0.14272670150236025',)} [1354756117, 1354750857, 1354750602, 1354750551, 1354750506, 1354750472, 1354750460, 1354749931] Looping around the photos to save general results len do output : 8 /1354756117.Didn't retrieve data . /1354750857.Didn't retrieve data . /1354750602.Didn't retrieve data . /1354750551.Didn't retrieve data . /1354750506.Didn't retrieve data . /1354750472.Didn't retrieve data . /1354750460.Didn't retrieve data . /1354749931.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354756117', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750857', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750602', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750551', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750506', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750472', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750460', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354749931', None, None, None, None, None, '2778688') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.020712852478027344 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11882162094116211 time spend to save output : 0.021202802658081055 total time spend for step 5 : 0.14002442359924316 step6:blur_detection Thu May 1 11:14:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df.jpg resize: (2160, 3264) 1354756117 -3.972866023284751 treat image : temp/1746090627_1845739_1354750857_7049435d169a0635dfc4602632ee1c37.jpg resize: (2160, 3264) 1354750857 -4.28018017733621 treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0.jpg resize: (2160, 3264) 1354750602 2.465552913751048 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1.jpg resize: (2160, 3264) 1354750551 -4.144307931982418 treat image : temp/1746090627_1845739_1354750506_e611d00802c9c15c2eff2c930bb7c90d.jpg resize: (2160, 3264) 1354750506 -3.788223785208786 treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f.jpg resize: (2160, 3264) 1354750472 -4.8109961154531256 treat image : temp/1746090627_1845739_1354750460_68445bb1e9ba5a7696016603a380f279.jpg resize: (2160, 3264) 1354750460 1.2533211219681117 treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2.jpg resize: (2160, 3264) 1354749931 -4.981147067669402 treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265728_0.png resize: (176, 176) 1355081044 -0.3702812523103245 treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265729_0.png resize: (164, 216) 1355081045 -2.943234571500083 treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265730_0.png resize: (67, 144) 1355081046 -3.1146007092529633 treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265731_0.png resize: (319, 305) 1355081047 -3.6844859060492396 treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265732_0.png resize: (91, 146) 1355081048 -2.5737260130135073 treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265733_0.png resize: (133, 130) 1355081049 -2.4246298543267377 treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265734_0.png resize: (123, 164) 1355081050 -4.396112467568674 treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265735_0.png resize: (221, 170) 1355081051 -1.8621222181035928 treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265736_0.png resize: (359, 527) 1355081052 -2.799499541648048 treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265737_0.png resize: (124, 127) 1355081053 -2.035520351549413 treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265738_0.png resize: (103, 88) 1355081054 -4.331088405774909 treat image : temp/1746090627_1845739_1354750857_7049435d169a0635dfc4602632ee1c37_rle_crop_3778265740_0.png resize: (191, 201) 1355081055 -0.8614896351154036 treat image : temp/1746090627_1845739_1354750857_7049435d169a0635dfc4602632ee1c37_rle_crop_3778265741_0.png resize: (223, 313) 1355081056 -2.884270193403984 treat image : temp/1746090627_1845739_1354750857_7049435d169a0635dfc4602632ee1c37_rle_crop_3778265742_0.png resize: (233, 283) 1355081057 -5.2053902937375085 treat image : temp/1746090627_1845739_1354750857_7049435d169a0635dfc4602632ee1c37_rle_crop_3778265743_0.png resize: (169, 175) 1355081058 -4.319158184104585 treat image : temp/1746090627_1845739_1354750857_7049435d169a0635dfc4602632ee1c37_rle_crop_3778265744_0.png resize: (357, 492) 1355081059 -4.043281082122096 treat image : temp/1746090627_1845739_1354750857_7049435d169a0635dfc4602632ee1c37_rle_crop_3778265745_0.png resize: (429, 282) 1355081060 -4.085126314753442 treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265746_0.png resize: (410, 207) 1355081061 -0.6258745656717897 treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265748_0.png resize: (984, 733) 1355081062 0.011757343197847782 treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265749_0.png resize: (879, 615) 1355081063 0.7865702550075054 treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265752_0.png resize: (206, 192) 1355081064 -0.7029011108072666 treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265753_0.png resize: (212, 408) 1355081065 0.14919515442490663 treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265754_0.png resize: (154, 396) 1355081066 0.4199461069349368 treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265755_0.png resize: (436, 313) 1355081067 -1.0172293995230035 treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265756_0.png resize: (154, 111) 1355081068 -0.951881254833831 treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265757_0.png resize: (327, 261) 1355081069 -0.5605464985928454 treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265760_0.png resize: (349, 437) 1355081070 -1.1259093779677896 treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265762_0.png resize: (113, 230) 1355081071 0.40992187138424524 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265766_0.png resize: (335, 242) 1355081072 -0.980079815557592 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265767_0.png resize: (351, 223) 1355081073 -1.247257889161155 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265770_0.png resize: (370, 208) 1355081074 -1.232984100906283 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265771_0.png resize: (180, 173) 1355081075 -0.9290745068283084 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265772_0.png resize: (175, 116) 1355081076 -0.9453815630294665 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265773_0.png resize: (187, 165) 1355081077 -2.264111513872925 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265774_0.png resize: (352, 337) 1355081078 -2.1805918529897843 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265776_0.png resize: (336, 358) 1355081079 -1.7663933038333568 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265777_0.png resize: (151, 177) 1355081080 -2.19522655228021 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265778_0.png resize: (165, 192) 1355081081 -1.578831048922769 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265781_0.png resize: (262, 336) 1355081082 -2.629129639472528 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265782_0.png resize: (121, 102) 1355081083 -0.10675015845649334 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265784_0.png resize: (181, 162) 1355081084 -1.7999865894609415 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265785_0.png resize: (144, 117) 1355081085 0.23643655018866253 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265787_0.png resize: (136, 184) 1355081086 -2.721896127808602 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265788_0.png resize: (150, 62) 1355081087 -1.7967198472987536 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265789_0.png resize: (160, 121) 1355081088 -2.0126114069810175 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265790_0.png resize: (108, 138) 1355081089 -0.5467042142945028 treat image : temp/1746090627_1845739_1354750506_e611d00802c9c15c2eff2c930bb7c90d_rle_crop_3778265791_0.png resize: (797, 635) 1355081090 -0.4994333755151099 treat image : temp/1746090627_1845739_1354750506_e611d00802c9c15c2eff2c930bb7c90d_rle_crop_3778265795_0.png resize: (130, 217) 1355081091 -2.188495109710808 treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265800_0.png resize: (102, 119) 1355081092 -2.653268414957136 treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265801_0.png resize: (887, 1008) 1355081093 -4.827819320632968 treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265804_0.png resize: (62, 106) 1355081094 -1.420761007490505 treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265806_0.png resize: (223, 277) 1355081095 -2.4346734608588707 treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265807_0.png resize: (245, 203) 1355081096 -2.5825827463407425 treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265808_0.png resize: (86, 102) 1355081097 -2.2820395257781168 treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265809_0.png resize: (201, 151) 1355081098 -2.083256677256735 treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265810_0.png resize: (293, 142) 1355081099 -3.4089630122368173 treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265811_0.png resize: (45, 71) 1355081100 -0.14905345462212424 treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265812_0.png resize: (112, 123) 1355081101 -1.7853968709128802 treat image : temp/1746090627_1845739_1354750460_68445bb1e9ba5a7696016603a380f279_rle_crop_3778265813_0.png resize: (168, 161) 1355081102 -0.2496079484051124 treat image : temp/1746090627_1845739_1354750460_68445bb1e9ba5a7696016603a380f279_rle_crop_3778265814_0.png resize: (189, 193) 1355081103 -0.0718385741749678 treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265818_0.png resize: (758, 1104) 1355081104 -0.9699915579563825 treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265819_0.png resize: (811, 414) 1355081105 -3.5156593470409017 treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265820_0.png resize: (1251, 1060) 1355081106 -3.7489815281428838 treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265828_0.png resize: (244, 288) 1355081107 -0.8152589666947984 treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265829_0.png resize: (216, 472) 1355081108 -1.1796651466579875 treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265834_0.png resize: (93, 95) 1355081109 -3.609295888558369 treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265835_0.png resize: (287, 142) 1355081110 -2.2416763833199567 treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265739_0.png resize: (226, 149) 1355081114 -1.4984665365866447 treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265747_0.png resize: (178, 222) 1355081115 -0.6512568523923237 treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265759_0.png resize: (166, 333) 1355081116 -2.0165568803769527 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265768_0.png resize: (239, 247) 1355081117 -0.4633933602250154 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265769_0.png resize: (167, 140) 1355081118 0.9945446323243448 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265775_0.png resize: (305, 259) 1355081119 -1.0963980691932749 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265779_0.png resize: (129, 209) 1355081120 -2.4353895723203505 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265783_0.png resize: (208, 119) 1355081121 -2.295365048922333 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265786_0.png resize: (231, 238) 1355081122 -3.201792389260428 treat image : temp/1746090627_1845739_1354750506_e611d00802c9c15c2eff2c930bb7c90d_rle_crop_3778265797_0.png resize: (137, 152) 1355081123 -0.7843614028871743 treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265802_0.png resize: (1217, 832) 1355081124 -1.5383539998575493 treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265803_0.png resize: (112, 179) 1355081125 -1.3058069394111094 treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265805_0.png resize: (95, 196) 1355081126 -0.9018130200596851 treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265821_0.png resize: (140, 234) 1355081127 -2.0919491518625843 treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265824_0.png resize: (134, 217) 1355081128 -1.671402724515464 treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265830_0.png resize: (222, 262) 1355081129 -1.036006262206233 treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265831_0.png resize: (351, 522) 1355081130 -2.220820951204121 treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265832_0.png resize: (106, 97) 1355081131 -2.630191935578485 treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265750_0.png resize: (448, 409) 1355081145 -0.814326128855616 treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265751_0.png resize: (400, 276) 1355081146 -1.7734153125509102 treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265758_0.png resize: (229, 163) 1355081147 0.9959291153181641 treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265763_0.png resize: (425, 200) 1355081148 -1.4185036424279607 treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265764_0.png resize: (311, 138) 1355081149 -2.5824371249571634 treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265765_0.png resize: (323, 134) 1355081150 -1.8836563126921149 treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265780_0.png resize: (202, 310) 1355081151 -2.2474117157567033 treat image : temp/1746090627_1845739_1354750506_e611d00802c9c15c2eff2c930bb7c90d_rle_crop_3778265792_0.png resize: (133, 147) 1355081152 -2.3078762455626953 treat image : temp/1746090627_1845739_1354750506_e611d00802c9c15c2eff2c930bb7c90d_rle_crop_3778265793_0.png resize: (260, 265) 1355081153 -1.5046101911957994 treat image : temp/1746090627_1845739_1354750506_e611d00802c9c15c2eff2c930bb7c90d_rle_crop_3778265794_0.png resize: (230, 291) 1355081154 -2.3560812707867855 treat image : temp/1746090627_1845739_1354750506_e611d00802c9c15c2eff2c930bb7c90d_rle_crop_3778265796_0.png resize: (623, 647) 1355081155 -1.0479552296164643 treat image : temp/1746090627_1845739_1354750506_e611d00802c9c15c2eff2c930bb7c90d_rle_crop_3778265798_0.png resize: (141, 198) 1355081156 -1.6742585913580545 treat image : temp/1746090627_1845739_1354750506_e611d00802c9c15c2eff2c930bb7c90d_rle_crop_3778265799_0.png resize: (217, 584) 1355081157 -3.4780595717013223 treat image : temp/1746090627_1845739_1354750460_68445bb1e9ba5a7696016603a380f279_rle_crop_3778265815_0.png resize: (513, 282) 1355081158 0.3519017579535851 treat image : temp/1746090627_1845739_1354750460_68445bb1e9ba5a7696016603a380f279_rle_crop_3778265816_0.png resize: (119, 338) 1355081160 -0.6282580125669811 treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265822_0.png resize: (405, 309) 1355081162 -3.7353637215290703 treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265823_0.png resize: (430, 460) 1355081163 -3.5324132863954087 treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265825_0.png resize: (767, 796) 1355081165 -2.3009692898215017 treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265826_0.png resize: (404, 693) 1355081166 -2.2711446476283683 treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265827_0.png resize: (347, 363) 1355081167 -3.726170780977191 treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265833_0.png resize: (488, 598) 1355081169 -1.9025381217224893 treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265761_0.png resize: (147, 115) 1355081178 -2.018952517827149 treat image : temp/1746090627_1845739_1354750460_68445bb1e9ba5a7696016603a380f279_rle_crop_3778265817_0.png resize: (155, 126) 1355081179 0.1486282818867827 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 116 time used for this insertion : 0.017439603805541992 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 116 time used for this insertion : 0.030916452407836914 save missing photos in datou_result : time spend for datou_step_exec : 31.95954966545105 time spend to save output : 0.0782933235168457 total time spend for step 6 : 32.037842988967896 step7:brightness Thu May 1 11:15:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df.jpg treat image : temp/1746090627_1845739_1354750857_7049435d169a0635dfc4602632ee1c37.jpg treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0.jpg treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1.jpg treat image : temp/1746090627_1845739_1354750506_e611d00802c9c15c2eff2c930bb7c90d.jpg treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f.jpg treat image : temp/1746090627_1845739_1354750460_68445bb1e9ba5a7696016603a380f279.jpg treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2.jpg treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265728_0.png treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265729_0.png treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265730_0.png treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265731_0.png treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265732_0.png treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265733_0.png treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265734_0.png treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265735_0.png treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265736_0.png treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265737_0.png treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265738_0.png treat image : temp/1746090627_1845739_1354750857_7049435d169a0635dfc4602632ee1c37_rle_crop_3778265740_0.png treat image : temp/1746090627_1845739_1354750857_7049435d169a0635dfc4602632ee1c37_rle_crop_3778265741_0.png treat image : temp/1746090627_1845739_1354750857_7049435d169a0635dfc4602632ee1c37_rle_crop_3778265742_0.png treat image : temp/1746090627_1845739_1354750857_7049435d169a0635dfc4602632ee1c37_rle_crop_3778265743_0.png treat image : temp/1746090627_1845739_1354750857_7049435d169a0635dfc4602632ee1c37_rle_crop_3778265744_0.png treat image : temp/1746090627_1845739_1354750857_7049435d169a0635dfc4602632ee1c37_rle_crop_3778265745_0.png treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265746_0.png treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265748_0.png treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265749_0.png treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265752_0.png treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265753_0.png treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265754_0.png treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265755_0.png treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265756_0.png treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265757_0.png treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265760_0.png treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265762_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265766_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265767_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265770_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265771_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265772_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265773_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265774_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265776_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265777_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265778_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265781_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265782_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265784_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265785_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265787_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265788_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265789_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265790_0.png treat image : temp/1746090627_1845739_1354750506_e611d00802c9c15c2eff2c930bb7c90d_rle_crop_3778265791_0.png treat image : temp/1746090627_1845739_1354750506_e611d00802c9c15c2eff2c930bb7c90d_rle_crop_3778265795_0.png treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265800_0.png treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265801_0.png treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265804_0.png treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265806_0.png treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265807_0.png treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265808_0.png treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265809_0.png treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265810_0.png treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265811_0.png treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265812_0.png treat image : temp/1746090627_1845739_1354750460_68445bb1e9ba5a7696016603a380f279_rle_crop_3778265813_0.png treat image : temp/1746090627_1845739_1354750460_68445bb1e9ba5a7696016603a380f279_rle_crop_3778265814_0.png treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265818_0.png treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265819_0.png treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265820_0.png treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265828_0.png treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265829_0.png treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265834_0.png treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265835_0.png treat image : temp/1746090627_1845739_1354756117_3e34323a5ea2a519a3a36e4b2e8a83df_rle_crop_3778265739_0.png treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265747_0.png treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265759_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265768_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265769_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265775_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265779_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265783_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265786_0.png treat image : temp/1746090627_1845739_1354750506_e611d00802c9c15c2eff2c930bb7c90d_rle_crop_3778265797_0.png treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265802_0.png treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265803_0.png treat image : temp/1746090627_1845739_1354750472_e423c2c844cb73ff43780d720b9fb87f_rle_crop_3778265805_0.png treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265821_0.png treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265824_0.png treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265830_0.png treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265831_0.png treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265832_0.png treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265750_0.png treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265751_0.png treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265758_0.png treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265763_0.png treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265764_0.png treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265765_0.png treat image : temp/1746090627_1845739_1354750551_f7e720c92f29ea75a4c608915dc51eb1_rle_crop_3778265780_0.png treat image : temp/1746090627_1845739_1354750506_e611d00802c9c15c2eff2c930bb7c90d_rle_crop_3778265792_0.png treat image : temp/1746090627_1845739_1354750506_e611d00802c9c15c2eff2c930bb7c90d_rle_crop_3778265793_0.png treat image : temp/1746090627_1845739_1354750506_e611d00802c9c15c2eff2c930bb7c90d_rle_crop_3778265794_0.png treat image : temp/1746090627_1845739_1354750506_e611d00802c9c15c2eff2c930bb7c90d_rle_crop_3778265796_0.png treat image : temp/1746090627_1845739_1354750506_e611d00802c9c15c2eff2c930bb7c90d_rle_crop_3778265798_0.png treat image : temp/1746090627_1845739_1354750506_e611d00802c9c15c2eff2c930bb7c90d_rle_crop_3778265799_0.png treat image : temp/1746090627_1845739_1354750460_68445bb1e9ba5a7696016603a380f279_rle_crop_3778265815_0.png treat image : temp/1746090627_1845739_1354750460_68445bb1e9ba5a7696016603a380f279_rle_crop_3778265816_0.png treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265822_0.png treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265823_0.png treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265825_0.png treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265826_0.png treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265827_0.png treat image : temp/1746090627_1845739_1354749931_c30dd655fe282e75f23aea895dc9f5a2_rle_crop_3778265833_0.png treat image : temp/1746090627_1845739_1354750602_c82fef10a74d6eeb68131a66a547aac0_rle_crop_3778265761_0.png treat image : temp/1746090627_1845739_1354750460_68445bb1e9ba5a7696016603a380f279_rle_crop_3778265817_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 116 time used for this insertion : 0.0169219970703125 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 116 time used for this insertion : 0.032305240631103516 save missing photos in datou_result : time spend for datou_step_exec : 7.729843378067017 time spend to save output : 0.054078102111816406 total time spend for step 7 : 7.783921480178833 step8:velours_tree Thu May 1 11:15:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.23050498962402344 time spend to save output : 4.363059997558594e-05 total time spend for step 8 : 0.23054862022399902 step9:send_mail_cod Thu May 1 11:15:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22582550_01-05-2025_11_15_16.pdf 22583794 imagette225837941746090916 22583795 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette225837951746090916 22583796 imagette225837961746090917 22583797 imagette225837971746090917 22583798 imagette225837981746090917 22583799 change filename to text .change filename to text .imagette225837991746090917 22583800 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette225838001746090917 22583801 imagette225838011746090919 22583802 imagette225838021746090919 22583804 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette225838041746090919 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22582550 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22583794,22583795,22583796,22583797,22583798,22583799,22583800,22583801,22583802,22583803,22583804?tags=mal_croppe,carton,flou,metal,autre,pehd,pet_clair,pet_fonce,background,environnement,papier args[1354756117] : ((1354756117, -3.972866023284751, 492609224), (1354756117, 0.2737649276869348, 2107752395), '0.14272670150236025') We are sending mail with results at report@fotonower.com args[1354750857] : ((1354750857, -4.28018017733621, 492609224), (1354750857, 0.5961641941680241, 2107752395), '0.14272670150236025') We are sending mail with results at report@fotonower.com args[1354750602] : ((1354750602, 2.465552913751048, 492688767), (1354750602, -0.11497605781925317, 496442774), '0.14272670150236025') We are sending mail with results at report@fotonower.com args[1354750551] : ((1354750551, -4.144307931982418, 492609224), (1354750551, 0.49187984935362683, 2107752395), '0.14272670150236025') We are sending mail with results at report@fotonower.com args[1354750506] : ((1354750506, -3.788223785208786, 492609224), (1354750506, 0.0446345505500997, 2107752395), '0.14272670150236025') We are sending mail with results at report@fotonower.com args[1354750472] : ((1354750472, -4.8109961154531256, 492609224), (1354750472, -0.000733625420377964, 2107752395), '0.14272670150236025') We are sending mail with results at report@fotonower.com args[1354750460] : ((1354750460, 1.2533211219681117, 492688767), (1354750460, 0.5494690165165532, 2107752395), '0.14272670150236025') We are sending mail with results at report@fotonower.com args[1354749931] : ((1354749931, -4.981147067669402, 492609224), (1354749931, -0.17229347920158153, 496442774), '0.14272670150236025') We are sending mail with results at report@fotonower.com refus_total : 0.14272670150236025 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22582550 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582550_01-05-2025_11_15_16.pdf results_Auto_P22582550_01-05-2025_11_15_16.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582550_01-05-2025_11_15_16.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22582550','results_Auto_P22582550_01-05-2025_11_15_16.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582550_01-05-2025_11_15_16.pdf','pdf','','0.72','0.14272670150236025') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22582550

https://www.fotonower.com/image?json=false&list_photos_id=1354756117
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1354750857
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1354750602
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.465552913751048)
https://www.fotonower.com/image?json=false&list_photos_id=1354750551
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1354750506
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1354750472
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1354750460
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.2533211219681117)
https://www.fotonower.com/image?json=false&list_photos_id=1354749931
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 14.27%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/22583795?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/22583799?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22583800?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22583804?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582550_01-05-2025_11_15_16.pdf.

Lien vers velours :https://www.fotonower.com/velours/22583794,22583795,22583796,22583797,22583798,22583799,22583800,22583801,22583802,22583803,22583804?tags=mal_croppe,carton,flou,metal,autre,pehd,pet_clair,pet_fonce,background,environnement,papier.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 01 May 2025 09:15:23 GMT Content-Length: 0 Connection: close X-Message-Id: 8JWddFMnRFy5b_I1Gf9Keg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1354756117, 1354750857, 1354750602, 1354750551, 1354750506, 1354750472, 1354750460, 1354749931] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354756117', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750857', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750602', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750551', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750506', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750472', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750460', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354749931', None, None, None, None, None, '2778688') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.015805959701538086 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.575055837631226 time spend to save output : 0.01601552963256836 total time spend for step 9 : 7.591071367263794 step10:split_time_score Thu May 1 11:15:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('15', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 30042025 22582550 Nombre de photos uploadées : 8 / 23040 (0%) 30042025 22582550 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 30042025 22582550 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 5.7220458984375e-06 elapsed_time : order_list_meta_photo_and_scores 1.33514404296875e-05 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.00038909912109375 elapsed_time : insert_dashboard_record_day_entry 0.028278589248657227 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582513 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582515 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582516 order by id desc limit 1 Qualite : 0.038301612895888265 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582519_01-05-2025_11_11_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582519 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582519 AND mptpi.`type`=3726 To do Qualite : 0.176817061369542 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582521_01-05-2025_10_55_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582521 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582521 AND mptpi.`type`=3594 To do Qualite : 0.12953026486267905 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582523_01-05-2025_10_53_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582523 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582523 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582535 order by id desc limit 1 Qualite : 0.03250910773056836 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582540_01-05-2025_10_53_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582540 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582540 AND mptpi.`type`=3726 To do Qualite : 0.13705221534710457 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582544_01-05-2025_10_42_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582544 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582544 AND mptpi.`type`=3726 To do Qualite : 0.14272670150236025 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582550_01-05-2025_11_15_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582550 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582550 AND mptpi.`type`=3594 To do Qualite : 0.12889933534177564 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582553_01-05-2025_11_05_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582553 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582553 AND mptpi.`type`=3594 To do Qualite : 0.16734336348833515 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582554_01-05-2025_10_46_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582554 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582554 AND mptpi.`type`=3594 To do Qualite : 0.15751766370128306 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582555_01-05-2025_10_59_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582555 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582555 AND mptpi.`type`=3594 To do Qualite : 0.07161995459001567 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582556_01-05-2025_10_31_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582556 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582556 AND mptpi.`type`=3726 To do Qualite : 0.15599883371222897 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582560_01-05-2025_10_46_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582560 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582560 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582571 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'30042025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1354756117, 1354750857, 1354750602, 1354750551, 1354750506, 1354750472, 1354750460, 1354749931] Looping around the photos to save general results len do output : 1 /22582550Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354756117', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750857', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750602', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750551', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750506', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750472', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354750460', None, None, None, None, None, '2778688') ('3318', None, None, None, None, None, None, None, '2778688') ('3318', '22582550', '1354749931', None, None, None, None, None, '2778688') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014466285705566406 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.211674928665161 time spend to save output : 0.014774322509765625 total time spend for step 10 : 5.226449251174927 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 125.02user 130.05system 5:04.42elapsed 83%CPU (0avgtext+0avgdata 4898448maxresident)k 1085024inputs+96184outputs (15369major+11642579minor)pagefaults 0swaps