python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3639957 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3594370'] with mtr_portfolio_ids : ['26218744'] and first list_photo_ids : [] new path : /proc/3639957/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 15 ; length of list_pids : 15 ; length of list_args : 15 time to download the photos : 2.464974880218506 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Aug 26 02:20:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10609 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-26 02:20:35.464627: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-26 02:20:35.492500: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-26 02:20:35.494774: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fbb98000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-26 02:20:35.494835: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-26 02:20:35.498877: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-26 02:20:35.642643: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3b7a7940 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-26 02:20:35.642694: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-26 02:20:35.644284: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-26 02:20:35.644754: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-26 02:20:35.647869: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-26 02:20:35.650533: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-26 02:20:35.650945: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-26 02:20:35.653569: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-26 02:20:35.654900: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-26 02:20:35.659743: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-26 02:20:35.661258: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-26 02:20:35.661337: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-26 02:20:35.662118: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-26 02:20:35.662135: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-26 02:20:35.662145: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-26 02:20:35.663459: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9683 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-26 02:20:35.916084: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-26 02:20:35.916183: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-26 02:20:35.916205: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-26 02:20:35.916223: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-26 02:20:35.916241: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-26 02:20:35.916258: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-26 02:20:35.916276: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-26 02:20:35.916294: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-26 02:20:35.917938: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-26 02:20:35.919430: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-26 02:20:35.919505: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-26 02:20:35.919529: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-26 02:20:35.919549: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-26 02:20:35.919569: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-26 02:20:35.919588: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-26 02:20:35.919609: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-26 02:20:35.919628: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-26 02:20:35.921278: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-26 02:20:35.921314: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-26 02:20:35.921326: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-26 02:20:35.921336: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-26 02:20:35.923484: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9683 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-26 02:20:44.181165: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-26 02:20:44.367861: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 47.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 56.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 Detection mask done ! Trying to reset tf kernel 3640510 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 347 tf kernel not reseted sub process len(results) : 15 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 15 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5636 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0023207664489746094 nb_pixel_total : 96829 time to create 1 rle with old method : 0.11351418495178223 length of segment : 490 time for calcul the mask position with numpy : 0.00034332275390625 nb_pixel_total : 16245 time to create 1 rle with old method : 0.01928424835205078 length of segment : 185 time for calcul the mask position with numpy : 0.0002028942108154297 nb_pixel_total : 6971 time to create 1 rle with old method : 0.009678840637207031 length of segment : 190 time for calcul the mask position with numpy : 0.00022935867309570312 nb_pixel_total : 7663 time to create 1 rle with old method : 0.01071476936340332 length of segment : 96 time for calcul the mask position with numpy : 0.0001850128173828125 nb_pixel_total : 7749 time to create 1 rle with old method : 0.010170936584472656 length of segment : 111 time for calcul the mask position with numpy : 0.0001614093780517578 nb_pixel_total : 5034 time to create 1 rle with old method : 0.006384134292602539 length of segment : 96 time for calcul the mask position with numpy : 0.0002446174621582031 nb_pixel_total : 7181 time to create 1 rle with old method : 0.008510112762451172 length of segment : 124 time for calcul the mask position with numpy : 0.00013303756713867188 nb_pixel_total : 5143 time to create 1 rle with old method : 0.0062313079833984375 length of segment : 98 time for calcul the mask position with numpy : 0.00040340423583984375 nb_pixel_total : 16500 time to create 1 rle with old method : 0.023448944091796875 length of segment : 173 time for calcul the mask position with numpy : 0.00024080276489257812 nb_pixel_total : 8976 time to create 1 rle with old method : 0.010236740112304688 length of segment : 170 time for calcul the mask position with numpy : 0.000278472900390625 nb_pixel_total : 11620 time to create 1 rle with old method : 0.015570640563964844 length of segment : 210 time for calcul the mask position with numpy : 0.0001354217529296875 nb_pixel_total : 3623 time to create 1 rle with old method : 0.00453639030456543 length of segment : 66 time for calcul the mask position with numpy : 0.00023937225341796875 nb_pixel_total : 10997 time to create 1 rle with old method : 0.013508319854736328 length of segment : 180 time for calcul the mask position with numpy : 0.0002276897430419922 nb_pixel_total : 13673 time to create 1 rle with old method : 0.015538930892944336 length of segment : 157 time for calcul the mask position with numpy : 0.00015473365783691406 nb_pixel_total : 6871 time to create 1 rle with old method : 0.008104085922241211 length of segment : 105 time for calcul the mask position with numpy : 9.512901306152344e-05 nb_pixel_total : 2568 time to create 1 rle with old method : 0.003075122833251953 length of segment : 70 time for calcul the mask position with numpy : 0.0003077983856201172 nb_pixel_total : 12202 time to create 1 rle with old method : 0.013597249984741211 length of segment : 183 time for calcul the mask position with numpy : 0.00020766258239746094 nb_pixel_total : 9769 time to create 1 rle with old method : 0.011375665664672852 length of segment : 122 time for calcul the mask position with numpy : 0.0002682209014892578 nb_pixel_total : 13759 time to create 1 rle with old method : 0.016508817672729492 length of segment : 121 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 1212 time to create 1 rle with old method : 0.001478433609008789 length of segment : 40 time for calcul the mask position with numpy : 0.0002307891845703125 nb_pixel_total : 12538 time to create 1 rle with old method : 0.015371084213256836 length of segment : 125 time for calcul the mask position with numpy : 0.00016832351684570312 nb_pixel_total : 7027 time to create 1 rle with old method : 0.008650541305541992 length of segment : 107 time for calcul the mask position with numpy : 0.00021958351135253906 nb_pixel_total : 9483 time to create 1 rle with old method : 0.011718988418579102 length of segment : 109 time for calcul the mask position with numpy : 0.00012087821960449219 nb_pixel_total : 5051 time to create 1 rle with old method : 0.007010221481323242 length of segment : 76 time for calcul the mask position with numpy : 8.606910705566406e-05 nb_pixel_total : 1415 time to create 1 rle with old method : 0.0020530223846435547 length of segment : 37 time for calcul the mask position with numpy : 0.0014951229095458984 nb_pixel_total : 71860 time to create 1 rle with old method : 0.0897209644317627 length of segment : 491 time for calcul the mask position with numpy : 0.00024056434631347656 nb_pixel_total : 13318 time to create 1 rle with old method : 0.014976024627685547 length of segment : 159 time for calcul the mask position with numpy : 0.0006418228149414062 nb_pixel_total : 43051 time to create 1 rle with old method : 0.05376386642456055 length of segment : 231 time for calcul the mask position with numpy : 0.0030252933502197266 nb_pixel_total : 113728 time to create 1 rle with old method : 0.1315302848815918 length of segment : 542 time for calcul the mask position with numpy : 0.0002124309539794922 nb_pixel_total : 3482 time to create 1 rle with old method : 0.0042934417724609375 length of segment : 71 time for calcul the mask position with numpy : 0.0003552436828613281 nb_pixel_total : 11704 time to create 1 rle with old method : 0.013461112976074219 length of segment : 152 time for calcul the mask position with numpy : 0.0003552436828613281 nb_pixel_total : 10756 time to create 1 rle with old method : 0.01238703727722168 length of segment : 96 time for calcul the mask position with numpy : 0.0004138946533203125 nb_pixel_total : 11910 time to create 1 rle with old method : 0.014740228652954102 length of segment : 100 time for calcul the mask position with numpy : 0.0002808570861816406 nb_pixel_total : 6610 time to create 1 rle with old method : 0.008008718490600586 length of segment : 119 time for calcul the mask position with numpy : 0.0012857913970947266 nb_pixel_total : 58264 time to create 1 rle with old method : 0.06674671173095703 length of segment : 241 time for calcul the mask position with numpy : 0.0004112720489501953 nb_pixel_total : 10272 time to create 1 rle with old method : 0.012487649917602539 length of segment : 112 time for calcul the mask position with numpy : 0.00026297569274902344 nb_pixel_total : 5338 time to create 1 rle with old method : 0.006185054779052734 length of segment : 104 time for calcul the mask position with numpy : 0.0002856254577636719 nb_pixel_total : 3907 time to create 1 rle with old method : 0.004827022552490234 length of segment : 102 time for calcul the mask position with numpy : 0.0002613067626953125 nb_pixel_total : 7926 time to create 1 rle with old method : 0.009672164916992188 length of segment : 115 time for calcul the mask position with numpy : 0.00031757354736328125 nb_pixel_total : 6855 time to create 1 rle with old method : 0.008438348770141602 length of segment : 96 time for calcul the mask position with numpy : 0.0005407333374023438 nb_pixel_total : 12734 time to create 1 rle with old method : 0.014731645584106445 length of segment : 174 time for calcul the mask position with numpy : 0.00025725364685058594 nb_pixel_total : 8957 time to create 1 rle with old method : 0.010362863540649414 length of segment : 93 time for calcul the mask position with numpy : 0.00039768218994140625 nb_pixel_total : 13182 time to create 1 rle with old method : 0.015074968338012695 length of segment : 155 time for calcul the mask position with numpy : 0.0004127025604248047 nb_pixel_total : 11301 time to create 1 rle with old method : 0.012893438339233398 length of segment : 185 time for calcul the mask position with numpy : 0.00211334228515625 nb_pixel_total : 83770 time to create 1 rle with old method : 0.10861086845397949 length of segment : 522 time for calcul the mask position with numpy : 0.0005354881286621094 nb_pixel_total : 12679 time to create 1 rle with old method : 0.016089439392089844 length of segment : 186 time for calcul the mask position with numpy : 0.00022411346435546875 nb_pixel_total : 12406 time to create 1 rle with old method : 0.015229940414428711 length of segment : 67 time for calcul the mask position with numpy : 0.015383005142211914 nb_pixel_total : 716824 time to create 1 rle with new method : 0.048941850662231445 length of segment : 958 time spent for convertir_results : 2.576756238937378 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 48 chid ids of type : 3594 Number RLEs to save : 8512 save missing photos in datou_result : time spend for datou_step_exec : 32.256330490112305 time spend to save output : 0.5940308570861816 total time spend for step 1 : 32.850361347198486 step2:crop_condition Tue Aug 26 02:21:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 15 ! batch 1 Loaded 48 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 25 About to insert : list_path_to_insert length 25 new photo from crops ! About to upload 25 photos upload in portfolio : 3736932 init cache_photo without model_param we have 25 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756167667_3639957 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 25 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.089620590209961 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756167674_3639957 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.353541612625122 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 17 About to insert : list_path_to_insert length 17 new photo from crops ! About to upload 17 photos upload in portfolio : 3736932 init cache_photo without model_param we have 17 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756167682_3639957 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 17 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.441982269287109 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1379209983, 1379209922, 1379209919, 1379209916, 1379209914, 1379209912, 1379209911, 1379209875, 1379209857, 1379209828, 1379209801, 1379209775, 1379209745, 1379209579, 1379209576] Looping around the photos to save general results len do output : 48 /1379355527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379355579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209983', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209922', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209919', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209916', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209914', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209912', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209911', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209875', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209857', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209828', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209801', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209775', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209745', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209579', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209576', None, None, None, None, None, '3594370') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 159 time used for this insertion : 0.021652698516845703 save_final save missing photos in datou_result : time spend for datou_step_exec : 21.373630046844482 time spend to save output : 0.023817062377929688 total time spend for step 2 : 21.397447109222412 step3:rle_unique_nms_with_priority Tue Aug 26 02:21:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 48 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.448016881942749 time for calcul the mask position with numpy : 0.06660079956054688 nb_pixel_total : 1976771 time to create 1 rle with new method : 0.19991493225097656 time for calcul the mask position with numpy : 0.007223844528198242 nb_pixel_total : 96829 time to create 1 rle with old method : 0.11454105377197266 create new chi : 0.39992475509643555 time to delete rle : 0.02898716926574707 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2060 TO DO : save crop sub photo not yet done ! save time : 0.17316937446594238 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.07352662086486816 time for calcul the mask position with numpy : 0.2333981990814209 nb_pixel_total : 2050384 time to create 1 rle with new method : 0.37433743476867676 time for calcul the mask position with numpy : 0.006246328353881836 nb_pixel_total : 6971 time to create 1 rle with old method : 0.007863759994506836 time for calcul the mask position with numpy : 0.006991147994995117 nb_pixel_total : 16245 time to create 1 rle with old method : 0.018320798873901367 create new chi : 0.6581361293792725 time to delete rle : 0.0003478527069091797 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1830 TO DO : save crop sub photo not yet done ! save time : 0.1567366123199463 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.11527514457702637 time for calcul the mask position with numpy : 0.23749017715454102 nb_pixel_total : 2045973 time to create 1 rle with new method : 0.12205171585083008 time for calcul the mask position with numpy : 0.006529331207275391 nb_pixel_total : 7181 time to create 1 rle with old method : 0.008696794509887695 time for calcul the mask position with numpy : 0.006184816360473633 nb_pixel_total : 5034 time to create 1 rle with old method : 0.005940675735473633 time for calcul the mask position with numpy : 0.006295204162597656 nb_pixel_total : 7749 time to create 1 rle with old method : 0.009283065795898438 time for calcul the mask position with numpy : 0.007561206817626953 nb_pixel_total : 7663 time to create 1 rle with old method : 0.01006770133972168 create new chi : 0.4317350387573242 time to delete rle : 0.00032520294189453125 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 1934 TO DO : save crop sub photo not yet done ! save time : 0.16421794891357422 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.06194424629211426 time for calcul the mask position with numpy : 0.02015519142150879 nb_pixel_total : 2042981 time to create 1 rle with new method : 0.18897533416748047 time for calcul the mask position with numpy : 0.012357711791992188 nb_pixel_total : 8976 time to create 1 rle with old method : 0.010527849197387695 time for calcul the mask position with numpy : 0.010855913162231445 nb_pixel_total : 16500 time to create 1 rle with old method : 0.01904773712158203 time for calcul the mask position with numpy : 0.010504484176635742 nb_pixel_total : 5143 time to create 1 rle with old method : 0.006155729293823242 create new chi : 0.28655576705932617 time to delete rle : 0.00033855438232421875 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1962 TO DO : save crop sub photo not yet done ! save time : 0.17470860481262207 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.09801626205444336 time for calcul the mask position with numpy : 0.0331568717956543 nb_pixel_total : 2047360 time to create 1 rle with new method : 0.1349499225616455 time for calcul the mask position with numpy : 0.0062520503997802734 nb_pixel_total : 10997 time to create 1 rle with old method : 0.012980222702026367 time for calcul the mask position with numpy : 0.006520986557006836 nb_pixel_total : 3623 time to create 1 rle with old method : 0.0045888423919677734 time for calcul the mask position with numpy : 0.006157398223876953 nb_pixel_total : 11620 time to create 1 rle with old method : 0.013935089111328125 create new chi : 0.22929739952087402 time to delete rle : 0.00031447410583496094 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1992 TO DO : save crop sub photo not yet done ! save time : 0.16362452507019043 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.16964292526245117 time for calcul the mask position with numpy : 0.09283208847045898 nb_pixel_total : 2014758 time to create 1 rle with new method : 0.08414030075073242 time for calcul the mask position with numpy : 0.006850719451904297 nb_pixel_total : 13759 time to create 1 rle with old method : 0.016948699951171875 time for calcul the mask position with numpy : 0.006886959075927734 nb_pixel_total : 9769 time to create 1 rle with old method : 0.011487245559692383 time for calcul the mask position with numpy : 0.006861448287963867 nb_pixel_total : 12202 time to create 1 rle with old method : 0.014129161834716797 time for calcul the mask position with numpy : 0.006285667419433594 nb_pixel_total : 2568 time to create 1 rle with old method : 0.003129243850708008 time for calcul the mask position with numpy : 0.00627899169921875 nb_pixel_total : 6871 time to create 1 rle with old method : 0.007976293563842773 time for calcul the mask position with numpy : 0.006529092788696289 nb_pixel_total : 13673 time to create 1 rle with old method : 0.017198562622070312 create new chi : 0.3013765811920166 time to delete rle : 0.0005125999450683594 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 2596 TO DO : save crop sub photo not yet done ! save time : 0.1954209804534912 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.07499814033508301 time for calcul the mask position with numpy : 0.024799823760986328 nb_pixel_total : 2043340 time to create 1 rle with new method : 0.1880495548248291 time for calcul the mask position with numpy : 0.005959987640380859 nb_pixel_total : 9483 time to create 1 rle with old method : 0.01044321060180664 time for calcul the mask position with numpy : 0.0059146881103515625 nb_pixel_total : 7027 time to create 1 rle with old method : 0.007861852645874023 time for calcul the mask position with numpy : 0.006135702133178711 nb_pixel_total : 12538 time to create 1 rle with old method : 0.014628887176513672 time for calcul the mask position with numpy : 0.006243705749511719 nb_pixel_total : 1212 time to create 1 rle with old method : 0.0013499259948730469 create new chi : 0.2781381607055664 time to delete rle : 0.00031256675720214844 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 1842 TO DO : save crop sub photo not yet done ! save time : 0.1589353084564209 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.24878334999084473 time for calcul the mask position with numpy : 0.07702970504760742 nb_pixel_total : 1995274 time to create 1 rle with new method : 0.09077858924865723 time for calcul the mask position with numpy : 0.006573915481567383 nb_pixel_total : 71860 time to create 1 rle with old method : 0.07992005348205566 time for calcul the mask position with numpy : 0.006119489669799805 nb_pixel_total : 1415 time to create 1 rle with old method : 0.0016837120056152344 time for calcul the mask position with numpy : 0.005904674530029297 nb_pixel_total : 5051 time to create 1 rle with old method : 0.0058345794677734375 create new chi : 0.2846872806549072 time to delete rle : 0.00036454200744628906 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2288 TO DO : save crop sub photo not yet done ! save time : 0.21622586250305176 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.058361053466796875 time for calcul the mask position with numpy : 0.035674095153808594 nb_pixel_total : 1903503 time to create 1 rle with new method : 0.18750905990600586 time for calcul the mask position with numpy : 0.006738424301147461 nb_pixel_total : 113728 time to create 1 rle with old method : 0.12925505638122559 time for calcul the mask position with numpy : 0.006777286529541016 nb_pixel_total : 43051 time to create 1 rle with old method : 0.05023837089538574 time for calcul the mask position with numpy : 0.0066525936126708984 nb_pixel_total : 13318 time to create 1 rle with old method : 0.015579700469970703 create new chi : 0.4491086006164551 time to delete rle : 0.0004754066467285156 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2944 TO DO : save crop sub photo not yet done ! save time : 0.249006986618042 No data in photo_id : 1379209828 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.23286104202270508 time for calcul the mask position with numpy : 0.12346696853637695 nb_pixel_total : 2029138 time to create 1 rle with new method : 0.08093380928039551 time for calcul the mask position with numpy : 0.0060977935791015625 nb_pixel_total : 6610 time to create 1 rle with old method : 0.0076291561126708984 time for calcul the mask position with numpy : 0.0060825347900390625 nb_pixel_total : 11910 time to create 1 rle with old method : 0.013780593872070312 time for calcul the mask position with numpy : 0.0059871673583984375 nb_pixel_total : 10756 time to create 1 rle with old method : 0.013051271438598633 time for calcul the mask position with numpy : 0.006459236145019531 nb_pixel_total : 11704 time to create 1 rle with old method : 0.014391183853149414 time for calcul the mask position with numpy : 0.006167888641357422 nb_pixel_total : 3482 time to create 1 rle with old method : 0.005043983459472656 create new chi : 0.3004765510559082 time to delete rle : 0.0005640983581542969 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2156 TO DO : save crop sub photo not yet done ! save time : 0.20911955833435059 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.20795464515686035 time for calcul the mask position with numpy : 0.05980277061462402 nb_pixel_total : 1991419 time to create 1 rle with new method : 0.2067584991455078 time for calcul the mask position with numpy : 0.006315708160400391 nb_pixel_total : 4400 time to create 1 rle with old method : 0.005065202713012695 time for calcul the mask position with numpy : 0.0060193538665771484 nb_pixel_total : 3907 time to create 1 rle with old method : 0.004454135894775391 time for calcul the mask position with numpy : 0.00616908073425293 nb_pixel_total : 5338 time to create 1 rle with old method : 0.006231069564819336 time for calcul the mask position with numpy : 0.006152629852294922 nb_pixel_total : 10272 time to create 1 rle with old method : 0.011609315872192383 time for calcul the mask position with numpy : 0.006378650665283203 nb_pixel_total : 58264 time to create 1 rle with old method : 0.0644526481628418 create new chi : 0.3994300365447998 time to delete rle : 0.0003597736358642578 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 2370 TO DO : save crop sub photo not yet done ! save time : 0.40916919708251953 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.07843422889709473 time for calcul the mask position with numpy : 0.15253901481628418 nb_pixel_total : 1936801 time to create 1 rle with new method : 0.1216287612915039 time for calcul the mask position with numpy : 0.0069310665130615234 nb_pixel_total : 83770 time to create 1 rle with old method : 0.09640836715698242 time for calcul the mask position with numpy : 0.010660648345947266 nb_pixel_total : 11301 time to create 1 rle with old method : 0.012992620468139648 time for calcul the mask position with numpy : 0.0062007904052734375 nb_pixel_total : 13182 time to create 1 rle with old method : 0.015161752700805664 time for calcul the mask position with numpy : 0.006212472915649414 nb_pixel_total : 8957 time to create 1 rle with old method : 0.010545969009399414 time for calcul the mask position with numpy : 0.007737874984741211 nb_pixel_total : 12734 time to create 1 rle with old method : 0.015301227569580078 time for calcul the mask position with numpy : 0.006623983383178711 nb_pixel_total : 6855 time to create 1 rle with old method : 0.008056402206420898 create new chi : 0.4883403778076172 time to delete rle : 0.0006477832794189453 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 3530 TO DO : save crop sub photo not yet done ! save time : 0.3071267604827881 No data in photo_id : 1379209579 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.07856631278991699 time for calcul the mask position with numpy : 0.015094280242919922 nb_pixel_total : 1333424 time to create 1 rle with new method : 0.07196927070617676 time for calcul the mask position with numpy : 0.010930061340332031 nb_pixel_total : 715091 time to create 1 rle with new method : 0.028922080993652344 time for calcul the mask position with numpy : 0.006021022796630859 nb_pixel_total : 12406 time to create 1 rle with old method : 0.014525651931762695 time for calcul the mask position with numpy : 0.006631612777709961 nb_pixel_total : 12679 time to create 1 rle with old method : 0.014784812927246094 create new chi : 0.16941571235656738 time to delete rle : 0.00045371055603027344 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3426 TO DO : save crop sub photo not yet done ! save time : 0.24730491638183594 map_output_result : {1379209983: (0.0, 'Should be the crop_list due to order', 0), 1379209922: (0.0, 'Should be the crop_list due to order', 0), 1379209919: (0.0, 'Should be the crop_list due to order', 0), 1379209916: (0.0, 'Should be the crop_list due to order', 0), 1379209914: (0.0, 'Should be the crop_list due to order', 0), 1379209912: (0.0, 'Should be the crop_list due to order', 0), 1379209911: (0.0, 'Should be the crop_list due to order', 0), 1379209875: (0.0, 'Should be the crop_list due to order', 0), 1379209857: (0.0, 'Should be the crop_list due to order', 0), 1379209828: (0.0, 'Should be the crop_list due to order', 0.0), 1379209801: (0.0, 'Should be the crop_list due to order', 0), 1379209775: (0.0, 'Should be the crop_list due to order', 0), 1379209745: (0.0, 'Should be the crop_list due to order', 0), 1379209579: (0.0, 'Should be the crop_list due to order', 0.0), 1379209576: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1379209983, 1379209922, 1379209919, 1379209916, 1379209914, 1379209912, 1379209911, 1379209875, 1379209857, 1379209828, 1379209801, 1379209775, 1379209745, 1379209579, 1379209576] Looping around the photos to save general results len do output : 15 /1379209983.Didn't retrieve data . /1379209922.Didn't retrieve data . /1379209919.Didn't retrieve data . /1379209916.Didn't retrieve data . /1379209914.Didn't retrieve data . /1379209912.Didn't retrieve data . /1379209911.Didn't retrieve data . /1379209875.Didn't retrieve data . /1379209857.Didn't retrieve data . /1379209828.Didn't retrieve data . /1379209801.Didn't retrieve data . /1379209775.Didn't retrieve data . /1379209745.Didn't retrieve data . /1379209579.Didn't retrieve data . /1379209576.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209983', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209922', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209919', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209916', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209914', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209912', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209911', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209875', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209857', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209828', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209801', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209775', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209745', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209579', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209576', None, None, None, None, None, '3594370') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 45 time used for this insertion : 0.018578052520751953 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.908745527267456 time spend to save output : 0.019059181213378906 total time spend for step 3 : 9.927804708480835 step4:ventilate_hashtags_in_portfolio Tue Aug 26 02:21:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26218744 get user id for portfolio 26218744 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26218744 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','mal_croppe','pet_clair','environnement','pehd','pet_fonce','carton','metal','background','flou','papier')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26218744 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','mal_croppe','pet_clair','environnement','pehd','pet_fonce','carton','metal','background','flou','papier')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26218744 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','mal_croppe','pet_clair','environnement','pehd','pet_fonce','carton','metal','background','flou','papier')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/26220655,26220656,26220657,26220658,26220659,26220660,26220661,26220662,26220663,26220664,26220665?tags=autre,mal_croppe,pet_clair,environnement,pehd,pet_fonce,carton,metal,background,flou,papier Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1379209983, 1379209922, 1379209919, 1379209916, 1379209914, 1379209912, 1379209911, 1379209875, 1379209857, 1379209828, 1379209801, 1379209775, 1379209745, 1379209579, 1379209576] Looping around the photos to save general results len do output : 1 /26218744. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209983', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209922', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209919', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209916', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209914', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209912', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209911', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209875', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209857', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209828', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209801', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209775', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209745', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209579', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209576', None, None, None, None, None, '3594370') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 16 time used for this insertion : 0.015462636947631836 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7209746837615967 time spend to save output : 0.015719175338745117 total time spend for step 4 : 1.7366938591003418 step5:final Tue Aug 26 02:21:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1379209983: ('0.0496937371399177',), 1379209922: ('0.0496937371399177',), 1379209919: ('0.0496937371399177',), 1379209916: ('0.0496937371399177',), 1379209914: ('0.0496937371399177',), 1379209912: ('0.0496937371399177',), 1379209911: ('0.0496937371399177',), 1379209875: ('0.0496937371399177',), 1379209857: ('0.0496937371399177',), 1379209828: ('0.0496937371399177',), 1379209801: ('0.0496937371399177',), 1379209775: ('0.0496937371399177',), 1379209745: ('0.0496937371399177',), 1379209579: ('0.0496937371399177',), 1379209576: ('0.0496937371399177',)} new output for save of step final : {1379209983: ('0.0496937371399177',), 1379209922: ('0.0496937371399177',), 1379209919: ('0.0496937371399177',), 1379209916: ('0.0496937371399177',), 1379209914: ('0.0496937371399177',), 1379209912: ('0.0496937371399177',), 1379209911: ('0.0496937371399177',), 1379209875: ('0.0496937371399177',), 1379209857: ('0.0496937371399177',), 1379209828: ('0.0496937371399177',), 1379209801: ('0.0496937371399177',), 1379209775: ('0.0496937371399177',), 1379209745: ('0.0496937371399177',), 1379209579: ('0.0496937371399177',), 1379209576: ('0.0496937371399177',)} [1379209983, 1379209922, 1379209919, 1379209916, 1379209914, 1379209912, 1379209911, 1379209875, 1379209857, 1379209828, 1379209801, 1379209775, 1379209745, 1379209579, 1379209576] Looping around the photos to save general results len do output : 15 /1379209983.Didn't retrieve data . /1379209922.Didn't retrieve data . /1379209919.Didn't retrieve data . /1379209916.Didn't retrieve data . /1379209914.Didn't retrieve data . /1379209912.Didn't retrieve data . /1379209911.Didn't retrieve data . /1379209875.Didn't retrieve data . /1379209857.Didn't retrieve data . /1379209828.Didn't retrieve data . /1379209801.Didn't retrieve data . /1379209775.Didn't retrieve data . /1379209745.Didn't retrieve data . /1379209579.Didn't retrieve data . /1379209576.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209983', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209922', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209919', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209916', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209914', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209912', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209911', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209875', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209857', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209828', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209801', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209775', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209745', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209579', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209576', None, None, None, None, None, '3594370') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 45 time used for this insertion : 0.014081954956054688 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13077139854431152 time spend to save output : 0.014808893203735352 total time spend for step 5 : 0.14558029174804688 step6:blur_detection Tue Aug 26 02:21:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1756167630_3639957_1379209983_1073c2233c36d96f8ee1bc4c0b39a489.jpg resize: (1080, 1920) 1379209983 0.8101674455665288 treat image : temp/1756167630_3639957_1379209922_da0aaed916914d1435b019e49a467a54.jpg resize: (1080, 1920) 1379209922 1.8177023417268388 treat image : temp/1756167630_3639957_1379209919_a1abe8b0a008f56f01febed6f03f2c66.jpg resize: (1080, 1920) 1379209919 0.8946141629800505 treat image : temp/1756167630_3639957_1379209916_ac42b35e1ab62018bca1253c03ccecaf.jpg resize: (1080, 1920) 1379209916 0.6443251909053509 treat image : temp/1756167630_3639957_1379209914_4955d7755b0368255c4d5ea0a5a68615.jpg resize: (1080, 1920) 1379209914 0.188092988511148 treat image : temp/1756167630_3639957_1379209912_0adcbff21f76c80fd965503bebe279c0.jpg resize: (1080, 1920) 1379209912 0.359547600380199 treat image : temp/1756167630_3639957_1379209911_a7403a32264a4e6e0f11b6129e1df643.jpg resize: (1080, 1920) 1379209911 0.08016447120946553 treat image : temp/1756167630_3639957_1379209875_8e2f44eb08ffaf916d77fa1aeb4557f7.jpg resize: (1080, 1920) 1379209875 1.1825263211390815 treat image : temp/1756167630_3639957_1379209857_cb88f614b4436238b68532cdb6323ff5.jpg resize: (1080, 1920) 1379209857 1.5331739402884774 treat image : temp/1756167630_3639957_1379209828_0c90d7f091c05c0ab3c732061b6219fc.jpg resize: (1080, 1920) 1379209828 1.5011774372842779 treat image : temp/1756167630_3639957_1379209801_ec17ce467c259cc98bfe7bbb962a67d4.jpg resize: (1080, 1920) 1379209801 0.27798714698392324 treat image : temp/1756167630_3639957_1379209775_2edea8dc1df4027ae993620697d1874c.jpg resize: (1080, 1920) 1379209775 -0.7306345603552001 treat image : temp/1756167630_3639957_1379209745_fcdfe2eff01987528308120f6c6eec4d.jpg resize: (1080, 1920) 1379209745 -0.06093701495256454 treat image : temp/1756167630_3639957_1379209579_bef6a973ab2cb2dea46662e91f4dcccd.jpg resize: (1080, 1920) 1379209579 -0.552722058838688 treat image : temp/1756167630_3639957_1379209576_6460e3a2f0d8e94d7ed0041917c79bf2.jpg resize: (1080, 1920) 1379209576 0.8335109206015165 treat image : temp/1756167630_3639957_1379209922_da0aaed916914d1435b019e49a467a54_rle_crop_3930535291_0.png resize: (187, 78) 1379355527 -1.8272949003038832 treat image : temp/1756167630_3639957_1379209919_a1abe8b0a008f56f01febed6f03f2c66_rle_crop_3930535292_0.png resize: (96, 101) 1379355528 1.9423656505126763 treat image : temp/1756167630_3639957_1379209919_a1abe8b0a008f56f01febed6f03f2c66_rle_crop_3930535293_0.png resize: (111, 122) 1379355529 -1.6611816711180418 treat image : temp/1756167630_3639957_1379209919_a1abe8b0a008f56f01febed6f03f2c66_rle_crop_3930535295_0.png resize: (124, 163) 1379355530 -1.7433792120649605 treat image : temp/1756167630_3639957_1379209916_ac42b35e1ab62018bca1253c03ccecaf_rle_crop_3930535298_0.png resize: (173, 109) 1379355531 -1.3757805795831057 treat image : temp/1756167630_3639957_1379209916_ac42b35e1ab62018bca1253c03ccecaf_rle_crop_3930535297_0.png resize: (153, 174) 1379355532 -1.12225875443384 treat image : temp/1756167630_3639957_1379209916_ac42b35e1ab62018bca1253c03ccecaf_rle_crop_3930535296_0.png resize: (98, 111) 1379355533 -0.06200093227785631 treat image : temp/1756167630_3639957_1379209914_4955d7755b0368255c4d5ea0a5a68615_rle_crop_3930535301_0.png resize: (180, 109) 1379355534 -0.5420599564551112 treat image : temp/1756167630_3639957_1379209912_0adcbff21f76c80fd965503bebe279c0_rle_crop_3930535305_0.png resize: (183, 124) 1379355535 -0.5561305704489573 treat image : temp/1756167630_3639957_1379209912_0adcbff21f76c80fd965503bebe279c0_rle_crop_3930535304_0.png resize: (70, 69) 1379355536 -2.359497213604785 treat image : temp/1756167630_3639957_1379209912_0adcbff21f76c80fd965503bebe279c0_rle_crop_3930535303_0.png resize: (105, 93) 1379355537 -0.9147224340980922 treat image : temp/1756167630_3639957_1379209911_a7403a32264a4e6e0f11b6129e1df643_rle_crop_3930535311_0.png resize: (109, 130) 1379355538 -1.0244417413240847 treat image : temp/1756167630_3639957_1379209911_a7403a32264a4e6e0f11b6129e1df643_rle_crop_3930535308_0.png resize: (40, 39) 1379355539 4.073922995559223 treat image : temp/1756167630_3639957_1379209911_a7403a32264a4e6e0f11b6129e1df643_rle_crop_3930535309_0.png resize: (125, 159) 1379355540 -1.4576211392879563 treat image : temp/1756167630_3639957_1379209875_8e2f44eb08ffaf916d77fa1aeb4557f7_rle_crop_3930535312_0.png resize: (76, 94) 1379355541 -0.5693150848049666 treat image : temp/1756167630_3639957_1379209801_ec17ce467c259cc98bfe7bbb962a67d4_rle_crop_3930535318_0.png resize: (71, 76) 1379355542 -1.570745479872176 treat image : temp/1756167630_3639957_1379209801_ec17ce467c259cc98bfe7bbb962a67d4_rle_crop_3930535322_0.png resize: (110, 77) 1379355543 -0.5438539820855649 treat image : temp/1756167630_3639957_1379209801_ec17ce467c259cc98bfe7bbb962a67d4_rle_crop_3930535321_0.png resize: (100, 172) 1379355544 1.3801230538267983 treat image : temp/1756167630_3639957_1379209775_2edea8dc1df4027ae993620697d1874c_rle_crop_3930535326_0.png resize: (93, 114) 1379355545 -1.9750220798423412 treat image : temp/1756167630_3639957_1379209745_fcdfe2eff01987528308120f6c6eec4d_rle_crop_3930535329_0.png resize: (174, 128) 1379355546 -0.3443116824469054 treat image : temp/1756167630_3639957_1379209745_fcdfe2eff01987528308120f6c6eec4d_rle_crop_3930535328_0.png resize: (96, 141) 1379355547 -0.6391935304580652 treat image : temp/1756167630_3639957_1379209745_fcdfe2eff01987528308120f6c6eec4d_rle_crop_3930535330_0.png resize: (92, 134) 1379355548 1.254844892242091 treat image : temp/1756167630_3639957_1379209745_fcdfe2eff01987528308120f6c6eec4d_rle_crop_3930535332_0.png resize: (173, 102) 1379355549 -1.4578162757092226 treat image : temp/1756167630_3639957_1379209576_6460e3a2f0d8e94d7ed0041917c79bf2_rle_crop_3930535334_0.png resize: (185, 128) 1379355550 -0.3962351655674104 treat image : temp/1756167630_3639957_1379209576_6460e3a2f0d8e94d7ed0041917c79bf2_rle_crop_3930535335_0.png resize: (66, 216) 1379355551 3.8220119646601236 treat image : temp/1756167630_3639957_1379209914_4955d7755b0368255c4d5ea0a5a68615_rle_crop_3930535300_0.png resize: (66, 72) 1379355552 0.6008983576329258 treat image : temp/1756167630_3639957_1379209914_4955d7755b0368255c4d5ea0a5a68615_rle_crop_3930535299_0.png resize: (206, 89) 1379355553 -1.654803447807851 treat image : temp/1756167630_3639957_1379209912_0adcbff21f76c80fd965503bebe279c0_rle_crop_3930535306_0.png resize: (104, 132) 1379355554 -1.6834526149057645 treat image : temp/1756167630_3639957_1379209911_a7403a32264a4e6e0f11b6129e1df643_rle_crop_3930535310_0.png resize: (101, 106) 1379355555 -2.1410916314763155 treat image : temp/1756167630_3639957_1379209775_2edea8dc1df4027ae993620697d1874c_rle_crop_3930535327_0.png resize: (104, 123) 1379355556 -2.535389920672699 treat image : temp/1756167630_3639957_1379209775_2edea8dc1df4027ae993620697d1874c_rle_crop_3930535325_0.png resize: (104, 68) 1379355557 -1.49765798343213 treat image : temp/1756167630_3639957_1379209983_1073c2233c36d96f8ee1bc4c0b39a489_rle_crop_3930535289_0.png resize: (488, 334) 1379355563 -0.3710930190251596 treat image : temp/1756167630_3639957_1379209922_da0aaed916914d1435b019e49a467a54_rle_crop_3930535290_0.png resize: (185, 100) 1379355564 0.9457426531929751 treat image : temp/1756167630_3639957_1379209919_a1abe8b0a008f56f01febed6f03f2c66_rle_crop_3930535294_0.png resize: (96, 68) 1379355565 -2.8790394516446485 treat image : temp/1756167630_3639957_1379209912_0adcbff21f76c80fd965503bebe279c0_rle_crop_3930535307_0.png resize: (121, 167) 1379355566 -2.9336153811584778 treat image : temp/1756167630_3639957_1379209912_0adcbff21f76c80fd965503bebe279c0_rle_crop_3930535302_0.png resize: (136, 122) 1379355567 -1.424435220658829 treat image : temp/1756167630_3639957_1379209875_8e2f44eb08ffaf916d77fa1aeb4557f7_rle_crop_3930535313_0.png resize: (37, 51) 1379355568 3.9182825051400494 treat image : temp/1756167630_3639957_1379209875_8e2f44eb08ffaf916d77fa1aeb4557f7_rle_crop_3930535314_0.png resize: (450, 305) 1379355569 -0.5970470709665636 treat image : temp/1756167630_3639957_1379209857_cb88f614b4436238b68532cdb6323ff5_rle_crop_3930535315_0.png resize: (135, 128) 1379355570 -1.9761603272410588 treat image : temp/1756167630_3639957_1379209857_cb88f614b4436238b68532cdb6323ff5_rle_crop_3930535316_0.png resize: (224, 295) 1379355571 -1.441895781129438 treat image : temp/1756167630_3639957_1379209857_cb88f614b4436238b68532cdb6323ff5_rle_crop_3930535317_0.png resize: (536, 372) 1379355572 0.17911448733033516 treat image : temp/1756167630_3639957_1379209801_ec17ce467c259cc98bfe7bbb962a67d4_rle_crop_3930535320_0.png resize: (96, 135) 1379355573 -2.487742586415803 treat image : temp/1756167630_3639957_1379209801_ec17ce467c259cc98bfe7bbb962a67d4_rle_crop_3930535319_0.png resize: (128, 116) 1379355574 -2.970535887142653 treat image : temp/1756167630_3639957_1379209775_2edea8dc1df4027ae993620697d1874c_rle_crop_3930535324_0.png resize: (111, 193) 1379355575 -3.2966628810033076 treat image : temp/1756167630_3639957_1379209775_2edea8dc1df4027ae993620697d1874c_rle_crop_3930535323_0.png resize: (229, 322) 1379355576 -0.0949432407755302 treat image : temp/1756167630_3639957_1379209745_fcdfe2eff01987528308120f6c6eec4d_rle_crop_3930535331_0.png resize: (138, 127) 1379355577 -2.5422513473423782 treat image : temp/1756167630_3639957_1379209745_fcdfe2eff01987528308120f6c6eec4d_rle_crop_3930535333_0.png resize: (517, 341) 1379355578 -0.5692644752424789 treat image : temp/1756167630_3639957_1379209576_6460e3a2f0d8e94d7ed0041917c79bf2_rle_crop_3930535336_0.png resize: (954, 971) 1379355579 0.725602211892344 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 63 time used for this insertion : 0.014641046524047852 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 63 time used for this insertion : 0.016210079193115234 save missing photos in datou_result : time spend for datou_step_exec : 12.304426670074463 time spend to save output : 0.03618788719177246 total time spend for step 6 : 12.340614557266235 step7:brightness Tue Aug 26 02:21:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1756167630_3639957_1379209983_1073c2233c36d96f8ee1bc4c0b39a489.jpg treat image : temp/1756167630_3639957_1379209922_da0aaed916914d1435b019e49a467a54.jpg treat image : temp/1756167630_3639957_1379209919_a1abe8b0a008f56f01febed6f03f2c66.jpg treat image : temp/1756167630_3639957_1379209916_ac42b35e1ab62018bca1253c03ccecaf.jpg treat image : temp/1756167630_3639957_1379209914_4955d7755b0368255c4d5ea0a5a68615.jpg treat image : temp/1756167630_3639957_1379209912_0adcbff21f76c80fd965503bebe279c0.jpg treat image : temp/1756167630_3639957_1379209911_a7403a32264a4e6e0f11b6129e1df643.jpg treat image : temp/1756167630_3639957_1379209875_8e2f44eb08ffaf916d77fa1aeb4557f7.jpg treat image : temp/1756167630_3639957_1379209857_cb88f614b4436238b68532cdb6323ff5.jpg treat image : temp/1756167630_3639957_1379209828_0c90d7f091c05c0ab3c732061b6219fc.jpg treat image : temp/1756167630_3639957_1379209801_ec17ce467c259cc98bfe7bbb962a67d4.jpg treat image : temp/1756167630_3639957_1379209775_2edea8dc1df4027ae993620697d1874c.jpg treat image : temp/1756167630_3639957_1379209745_fcdfe2eff01987528308120f6c6eec4d.jpg treat image : temp/1756167630_3639957_1379209579_bef6a973ab2cb2dea46662e91f4dcccd.jpg treat image : temp/1756167630_3639957_1379209576_6460e3a2f0d8e94d7ed0041917c79bf2.jpg treat image : temp/1756167630_3639957_1379209922_da0aaed916914d1435b019e49a467a54_rle_crop_3930535291_0.png treat image : temp/1756167630_3639957_1379209919_a1abe8b0a008f56f01febed6f03f2c66_rle_crop_3930535292_0.png treat image : temp/1756167630_3639957_1379209919_a1abe8b0a008f56f01febed6f03f2c66_rle_crop_3930535293_0.png treat image : temp/1756167630_3639957_1379209919_a1abe8b0a008f56f01febed6f03f2c66_rle_crop_3930535295_0.png treat image : temp/1756167630_3639957_1379209916_ac42b35e1ab62018bca1253c03ccecaf_rle_crop_3930535298_0.png treat image : temp/1756167630_3639957_1379209916_ac42b35e1ab62018bca1253c03ccecaf_rle_crop_3930535297_0.png treat image : temp/1756167630_3639957_1379209916_ac42b35e1ab62018bca1253c03ccecaf_rle_crop_3930535296_0.png treat image : temp/1756167630_3639957_1379209914_4955d7755b0368255c4d5ea0a5a68615_rle_crop_3930535301_0.png treat image : temp/1756167630_3639957_1379209912_0adcbff21f76c80fd965503bebe279c0_rle_crop_3930535305_0.png treat image : temp/1756167630_3639957_1379209912_0adcbff21f76c80fd965503bebe279c0_rle_crop_3930535304_0.png treat image : temp/1756167630_3639957_1379209912_0adcbff21f76c80fd965503bebe279c0_rle_crop_3930535303_0.png treat image : temp/1756167630_3639957_1379209911_a7403a32264a4e6e0f11b6129e1df643_rle_crop_3930535311_0.png treat image : temp/1756167630_3639957_1379209911_a7403a32264a4e6e0f11b6129e1df643_rle_crop_3930535308_0.png treat image : temp/1756167630_3639957_1379209911_a7403a32264a4e6e0f11b6129e1df643_rle_crop_3930535309_0.png treat image : temp/1756167630_3639957_1379209875_8e2f44eb08ffaf916d77fa1aeb4557f7_rle_crop_3930535312_0.png treat image : temp/1756167630_3639957_1379209801_ec17ce467c259cc98bfe7bbb962a67d4_rle_crop_3930535318_0.png treat image : temp/1756167630_3639957_1379209801_ec17ce467c259cc98bfe7bbb962a67d4_rle_crop_3930535322_0.png treat image : temp/1756167630_3639957_1379209801_ec17ce467c259cc98bfe7bbb962a67d4_rle_crop_3930535321_0.png treat image : temp/1756167630_3639957_1379209775_2edea8dc1df4027ae993620697d1874c_rle_crop_3930535326_0.png treat image : temp/1756167630_3639957_1379209745_fcdfe2eff01987528308120f6c6eec4d_rle_crop_3930535329_0.png treat image : temp/1756167630_3639957_1379209745_fcdfe2eff01987528308120f6c6eec4d_rle_crop_3930535328_0.png treat image : temp/1756167630_3639957_1379209745_fcdfe2eff01987528308120f6c6eec4d_rle_crop_3930535330_0.png treat image : temp/1756167630_3639957_1379209745_fcdfe2eff01987528308120f6c6eec4d_rle_crop_3930535332_0.png treat image : temp/1756167630_3639957_1379209576_6460e3a2f0d8e94d7ed0041917c79bf2_rle_crop_3930535334_0.png treat image : temp/1756167630_3639957_1379209576_6460e3a2f0d8e94d7ed0041917c79bf2_rle_crop_3930535335_0.png treat image : temp/1756167630_3639957_1379209914_4955d7755b0368255c4d5ea0a5a68615_rle_crop_3930535300_0.png treat image : temp/1756167630_3639957_1379209914_4955d7755b0368255c4d5ea0a5a68615_rle_crop_3930535299_0.png treat image : temp/1756167630_3639957_1379209912_0adcbff21f76c80fd965503bebe279c0_rle_crop_3930535306_0.png treat image : temp/1756167630_3639957_1379209911_a7403a32264a4e6e0f11b6129e1df643_rle_crop_3930535310_0.png treat image : temp/1756167630_3639957_1379209775_2edea8dc1df4027ae993620697d1874c_rle_crop_3930535327_0.png treat image : temp/1756167630_3639957_1379209775_2edea8dc1df4027ae993620697d1874c_rle_crop_3930535325_0.png treat image : temp/1756167630_3639957_1379209983_1073c2233c36d96f8ee1bc4c0b39a489_rle_crop_3930535289_0.png treat image : temp/1756167630_3639957_1379209922_da0aaed916914d1435b019e49a467a54_rle_crop_3930535290_0.png treat image : temp/1756167630_3639957_1379209919_a1abe8b0a008f56f01febed6f03f2c66_rle_crop_3930535294_0.png treat image : temp/1756167630_3639957_1379209912_0adcbff21f76c80fd965503bebe279c0_rle_crop_3930535307_0.png treat image : temp/1756167630_3639957_1379209912_0adcbff21f76c80fd965503bebe279c0_rle_crop_3930535302_0.png treat image : temp/1756167630_3639957_1379209875_8e2f44eb08ffaf916d77fa1aeb4557f7_rle_crop_3930535313_0.png treat image : temp/1756167630_3639957_1379209875_8e2f44eb08ffaf916d77fa1aeb4557f7_rle_crop_3930535314_0.png treat image : temp/1756167630_3639957_1379209857_cb88f614b4436238b68532cdb6323ff5_rle_crop_3930535315_0.png treat image : temp/1756167630_3639957_1379209857_cb88f614b4436238b68532cdb6323ff5_rle_crop_3930535316_0.png treat image : temp/1756167630_3639957_1379209857_cb88f614b4436238b68532cdb6323ff5_rle_crop_3930535317_0.png treat image : temp/1756167630_3639957_1379209801_ec17ce467c259cc98bfe7bbb962a67d4_rle_crop_3930535320_0.png treat image : temp/1756167630_3639957_1379209801_ec17ce467c259cc98bfe7bbb962a67d4_rle_crop_3930535319_0.png treat image : temp/1756167630_3639957_1379209775_2edea8dc1df4027ae993620697d1874c_rle_crop_3930535324_0.png treat image : temp/1756167630_3639957_1379209775_2edea8dc1df4027ae993620697d1874c_rle_crop_3930535323_0.png treat image : temp/1756167630_3639957_1379209745_fcdfe2eff01987528308120f6c6eec4d_rle_crop_3930535331_0.png treat image : temp/1756167630_3639957_1379209745_fcdfe2eff01987528308120f6c6eec4d_rle_crop_3930535333_0.png treat image : temp/1756167630_3639957_1379209576_6460e3a2f0d8e94d7ed0041917c79bf2_rle_crop_3930535336_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 63 time used for this insertion : 0.04574418067932129 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 63 time used for this insertion : 0.05025362968444824 save missing photos in datou_result : time spend for datou_step_exec : 3.5340240001678467 time spend to save output : 0.1007378101348877 total time spend for step 7 : 3.6347618103027344 step8:velours_tree Tue Aug 26 02:21:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.13716340065002441 time spend to save output : 4.100799560546875e-05 total time spend for step 8 : 0.13720440864562988 step9:send_mail_cod Tue Aug 26 02:21:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26218744_26-08-2025_02_21_54.pdf 26220655 imagette262206551756167714 26220656 imagette262206561756167714 26220657 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262206571756167714 26220659 imagette262206591756167715 26220660 imagette262206601756167716 26220661 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262206611756167716 26220662 imagette262206621756167716 26220663 imagette262206631756167716 26220664 imagette262206641756167716 26220665 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262206651756167716 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26218744 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/26220655,26220656,26220657,26220658,26220659,26220660,26220661,26220662,26220663,26220664,26220665?tags=autre,mal_croppe,pet_clair,environnement,pehd,pet_fonce,carton,metal,background,flou,papier args[1379209983] : ((1379209983, 0.8101674455665288, 492688767), (1379209983, 0.807302595481028, 2107752395), '0.0496937371399177') We are sending mail with results at report@fotonower.com args[1379209922] : ((1379209922, 1.8177023417268388, 492688767), (1379209922, 0.7911875649971966, 2107752395), '0.0496937371399177') We are sending mail with results at report@fotonower.com args[1379209919] : ((1379209919, 0.8946141629800505, 492688767), (1379209919, 0.43653979248438984, 2107752395), '0.0496937371399177') We are sending mail with results at report@fotonower.com args[1379209916] : ((1379209916, 0.6443251909053509, 492688767), (1379209916, 0.7645001368696178, 2107752395), '0.0496937371399177') We are sending mail with results at report@fotonower.com args[1379209914] : ((1379209914, 0.188092988511148, 492688767), (1379209914, 0.5330407382256528, 2107752395), '0.0496937371399177') We are sending mail with results at report@fotonower.com args[1379209912] : ((1379209912, 0.359547600380199, 492688767), (1379209912, 0.3785299671346835, 2107752395), '0.0496937371399177') We are sending mail with results at report@fotonower.com args[1379209911] : ((1379209911, 0.08016447120946553, 492688767), (1379209911, 0.6729424588667828, 2107752395), '0.0496937371399177') We are sending mail with results at report@fotonower.com args[1379209875] : ((1379209875, 1.1825263211390815, 492688767), (1379209875, 0.7606903431239814, 2107752395), '0.0496937371399177') We are sending mail with results at report@fotonower.com args[1379209857] : ((1379209857, 1.5331739402884774, 492688767), (1379209857, 0.640363243548769, 2107752395), '0.0496937371399177') We are sending mail with results at report@fotonower.com args[1379209828] : ((1379209828, 1.5011774372842779, 492688767), (1379209828, 0.8448759524045708, 2107752395), '0.0496937371399177') We are sending mail with results at report@fotonower.com args[1379209801] : ((1379209801, 0.27798714698392324, 492688767), (1379209801, 0.6876525688281264, 2107752395), '0.0496937371399177') We are sending mail with results at report@fotonower.com args[1379209775] : ((1379209775, -0.7306345603552001, 492688767), (1379209775, 0.5480042873277436, 2107752395), '0.0496937371399177') We are sending mail with results at report@fotonower.com args[1379209745] : ((1379209745, -0.06093701495256454, 492688767), (1379209745, 0.7063139472445734, 2107752395), '0.0496937371399177') We are sending mail with results at report@fotonower.com args[1379209579] : ((1379209579, -0.552722058838688, 492688767), (1379209579, 0.6324555196065537, 2107752395), '0.0496937371399177') We are sending mail with results at report@fotonower.com args[1379209576] : ((1379209576, 0.8335109206015165, 492688767), (1379209576, 0.5785481680329717, 2107752395), '0.0496937371399177') We are sending mail with results at report@fotonower.com refus_total : 0.0496937371399177 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26218744 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26218744_26-08-2025_02_21_54.pdf results_Auto_P26218744_26-08-2025_02_21_54.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26218744_26-08-2025_02_21_54.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26218744','results_Auto_P26218744_26-08-2025_02_21_54.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26218744_26-08-2025_02_21_54.pdf','pdf','','0.28','0.0496937371399177') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26218744

https://www.fotonower.com/image?json=false&list_photos_id=1379209983
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379209922
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.8177023417268388)
https://www.fotonower.com/image?json=false&list_photos_id=1379209919
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379209916
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379209914
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379209912
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379209911
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379209875
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.1825263211390815)
https://www.fotonower.com/image?json=false&list_photos_id=1379209857
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.5331739402884774)
https://www.fotonower.com/image?json=false&list_photos_id=1379209828
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.5011774372842779)
https://www.fotonower.com/image?json=false&list_photos_id=1379209801
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379209775
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379209745
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379209579
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379209576
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 4.97%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/26220657?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26220661?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26220665?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26218744_26-08-2025_02_21_54.pdf.

Lien vers velours :https://www.fotonower.com/velours/26220655,26220656,26220657,26220658,26220659,26220660,26220661,26220662,26220663,26220664,26220665?tags=autre,mal_croppe,pet_clair,environnement,pehd,pet_fonce,carton,metal,background,flou,papier.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 26 Aug 2025 00:21:58 GMT Content-Length: 0 Connection: close X-Message-Id: Q1KVBdZRSR2Ttiw8eEW76w Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1379209983, 1379209922, 1379209919, 1379209916, 1379209914, 1379209912, 1379209911, 1379209875, 1379209857, 1379209828, 1379209801, 1379209775, 1379209745, 1379209579, 1379209576] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209983', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209922', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209919', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209916', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209914', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209912', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209911', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209875', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209857', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209828', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209801', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209775', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209745', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209579', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209576', None, None, None, None, None, '3594370') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.014827966690063477 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.091002464294434 time spend to save output : 0.015063762664794922 total time spend for step 9 : 4.1060662269592285 step10:split_time_score Tue Aug 26 02:21:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('12', 15),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 25082025 26218744 Nombre de photos uploadées : 15 / 23040 (0%) 25082025 26218744 Nombre de photos taguées (types de déchets): 0 / 15 (0%) 25082025 26218744 Nombre de photos taguées (volume) : 0 / 15 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ??????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0007052421569824219 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.22089004516601562 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.1956718898385565 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26196500_25-08-2025_11_02_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26196500 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26196500 AND mptpi.`type`=3594 To do Qualite : 0.08125333867521368 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26218736_26-08-2025_02_02_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26218736 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26218736 AND mptpi.`type`=3594 To do Qualite : 0.056601562500000015 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26218739_26-08-2025_02_17_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26218739 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26218739 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26218741 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26218742 order by id desc limit 1 Qualite : 0.0496937371399177 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26218744_26-08-2025_02_21_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26218744 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26218744 AND mptpi.`type`=3594 To do Qualite : 0.10733896072796938 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26218745_26-08-2025_02_13_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26218745 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26218745 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26218748 order by id desc limit 1 Qualite : 0.08477493248456791 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26218754_26-08-2025_01_32_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26218754 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26218754 AND mptpi.`type`=3594 To do Qualite : 0.08418696513748596 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26218755_26-08-2025_01_41_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26218755 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26218755 AND mptpi.`type`=3594 To do Qualite : 0.07988266411443495 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26218757_26-08-2025_01_11_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26218757 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26218757 AND mptpi.`type`=3594 To do Qualite : 0.019049177758487655 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26218778_26-08-2025_01_01_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26218778 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26218778 AND mptpi.`type`=3594 To do Qualite : 0.14097331175697297 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26218787_26-08-2025_00_53_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26218787 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26218787 AND mptpi.`type`=3594 To do Qualite : 0.1506583558384774 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26218819_26-08-2025_01_52_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26218819 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26218819 AND mptpi.`type`=3594 To do Qualite : 0.30717133403784214 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26218840_26-08-2025_00_33_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26218840 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26218840 AND mptpi.`type`=3594 To do Qualite : 0.14214023919753085 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26218845_26-08-2025_00_21_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26218845 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26218845 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'25082025': {'nb_upload': 15, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1379209983, 1379209922, 1379209919, 1379209916, 1379209914, 1379209912, 1379209911, 1379209875, 1379209857, 1379209828, 1379209801, 1379209775, 1379209745, 1379209579, 1379209576] Looping around the photos to save general results len do output : 1 /26218744Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209983', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209922', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209919', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209916', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209914', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209912', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209911', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209875', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209857', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209828', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209801', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209775', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209745', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209579', None, None, None, None, None, '3594370') ('3318', None, None, None, None, None, None, None, '3594370') ('3318', '26218744', '1379209576', None, None, None, None, None, '3594370') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 16 time used for this insertion : 0.018309831619262695 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.085495710372925 time spend to save output : 0.018550872802734375 total time spend for step 10 : 4.104046583175659 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 15 set_done_treatment 45.96user 27.13system 1:36.97elapsed 75%CPU (0avgtext+0avgdata 2934260maxresident)k 21480inputs+18104outputs (1293major+1821830minor)pagefaults 0swaps