python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3370944 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3729393'] with mtr_portfolio_ids : ['26902187'] and first list_photo_ids : [] new path : /proc/3370944/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 34 ; length of list_pids : 34 ; length of list_args : 34 time to download the photos : 4.7848241329193115 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Sep 16 18:20:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10433 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-16 18:20:35.748092: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-16 18:20:35.772562: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-16 18:20:35.774745: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f7c44000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-16 18:20:35.774805: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-16 18:20:35.778913: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-16 18:20:35.895919: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x34fb7740 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-16 18:20:35.895966: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-16 18:20:35.897368: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-16 18:20:35.897763: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-16 18:20:35.900930: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-16 18:20:35.903427: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-16 18:20:35.903829: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-16 18:20:35.906501: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-16 18:20:35.907871: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-16 18:20:35.913391: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-16 18:20:35.914881: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-16 18:20:35.914956: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-16 18:20:35.915695: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-16 18:20:35.915710: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-16 18:20:35.915719: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-16 18:20:35.917021: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9664 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-16 18:20:36.176126: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-16 18:20:36.176219: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-16 18:20:36.176240: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-16 18:20:36.176259: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-16 18:20:36.176277: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-16 18:20:36.176294: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-16 18:20:36.176312: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-16 18:20:36.176329: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-16 18:20:36.177924: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-16 18:20:36.179344: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-16 18:20:36.179388: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-16 18:20:36.179407: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-16 18:20:36.179424: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-16 18:20:36.179441: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-16 18:20:36.179458: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-16 18:20:36.179475: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-16 18:20:36.179492: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-16 18:20:36.181100: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-16 18:20:36.181137: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-16 18:20:36.181149: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-16 18:20:36.181159: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-16 18:20:36.182527: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9664 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-16 18:20:45.895442: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-16 18:20:46.073866: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 34 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 Detection mask done ! Trying to reset tf kernel 3371649 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1520 tf kernel not reseted sub process len(results) : 34 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 34 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6809 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00047850608825683594 nb_pixel_total : 7660 time to create 1 rle with old method : 0.011260509490966797 length of segment : 175 time for calcul the mask position with numpy : 0.0004172325134277344 nb_pixel_total : 19264 time to create 1 rle with old method : 0.02635502815246582 length of segment : 250 time for calcul the mask position with numpy : 0.00039505958557128906 nb_pixel_total : 18606 time to create 1 rle with old method : 0.025308609008789062 length of segment : 194 time for calcul the mask position with numpy : 9.655952453613281e-05 nb_pixel_total : 2192 time to create 1 rle with old method : 0.0032494068145751953 length of segment : 54 time for calcul the mask position with numpy : 0.00035190582275390625 nb_pixel_total : 13393 time to create 1 rle with old method : 0.01852726936340332 length of segment : 174 time for calcul the mask position with numpy : 0.00018024444580078125 nb_pixel_total : 6290 time to create 1 rle with old method : 0.008983135223388672 length of segment : 92 time for calcul the mask position with numpy : 0.0032024383544921875 nb_pixel_total : 129246 time to create 1 rle with old method : 0.15473270416259766 length of segment : 620 time for calcul the mask position with numpy : 0.0002911090850830078 nb_pixel_total : 10856 time to create 1 rle with old method : 0.01248931884765625 length of segment : 170 time for calcul the mask position with numpy : 0.0016369819641113281 nb_pixel_total : 113004 time to create 1 rle with old method : 0.12565159797668457 length of segment : 509 time for calcul the mask position with numpy : 0.00038123130798339844 nb_pixel_total : 20569 time to create 1 rle with old method : 0.02343583106994629 length of segment : 218 time for calcul the mask position with numpy : 0.00011658668518066406 nb_pixel_total : 5046 time to create 1 rle with old method : 0.005801200866699219 length of segment : 95 time for calcul the mask position with numpy : 0.0002460479736328125 nb_pixel_total : 12497 time to create 1 rle with old method : 0.01449728012084961 length of segment : 173 time for calcul the mask position with numpy : 0.00025391578674316406 nb_pixel_total : 13703 time to create 1 rle with old method : 0.016102313995361328 length of segment : 167 time for calcul the mask position with numpy : 0.00019359588623046875 nb_pixel_total : 7789 time to create 1 rle with old method : 0.008823871612548828 length of segment : 195 time for calcul the mask position with numpy : 0.0017936229705810547 nb_pixel_total : 118324 time to create 1 rle with old method : 0.12839245796203613 length of segment : 537 time for calcul the mask position with numpy : 0.0518491268157959 nb_pixel_total : 1227294 time to create 1 rle with new method : 0.07099175453186035 length of segment : 1416 time for calcul the mask position with numpy : 0.00011920928955078125 nb_pixel_total : 4020 time to create 1 rle with old method : 0.00455164909362793 length of segment : 58 time for calcul the mask position with numpy : 0.0002377033233642578 nb_pixel_total : 14892 time to create 1 rle with old method : 0.015803098678588867 length of segment : 179 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 1580 time to create 1 rle with old method : 0.0017919540405273438 length of segment : 43 time for calcul the mask position with numpy : 0.00014829635620117188 nb_pixel_total : 7603 time to create 1 rle with old method : 0.00823521614074707 length of segment : 118 time for calcul the mask position with numpy : 0.0001366138458251953 nb_pixel_total : 6521 time to create 1 rle with old method : 0.0072367191314697266 length of segment : 81 time for calcul the mask position with numpy : 0.0001595020294189453 nb_pixel_total : 8000 time to create 1 rle with old method : 0.008739948272705078 length of segment : 111 time for calcul the mask position with numpy : 0.001634359359741211 nb_pixel_total : 100762 time to create 1 rle with old method : 0.1109764575958252 length of segment : 564 time for calcul the mask position with numpy : 0.0002110004425048828 nb_pixel_total : 2757 time to create 1 rle with old method : 0.0031328201293945312 length of segment : 114 time for calcul the mask position with numpy : 0.0031347274780273438 nb_pixel_total : 133096 time to create 1 rle with old method : 0.14171099662780762 length of segment : 568 time for calcul the mask position with numpy : 0.00017309188842773438 nb_pixel_total : 3447 time to create 1 rle with old method : 0.003842592239379883 length of segment : 54 time for calcul the mask position with numpy : 0.00013017654418945312 nb_pixel_total : 7564 time to create 1 rle with old method : 0.008259296417236328 length of segment : 98 time for calcul the mask position with numpy : 0.00012683868408203125 nb_pixel_total : 5055 time to create 1 rle with old method : 0.0054514408111572266 length of segment : 105 time for calcul the mask position with numpy : 0.0004551410675048828 nb_pixel_total : 13212 time to create 1 rle with old method : 0.013998746871948242 length of segment : 155 time for calcul the mask position with numpy : 0.002225637435913086 nb_pixel_total : 99858 time to create 1 rle with old method : 0.11082077026367188 length of segment : 490 time for calcul the mask position with numpy : 0.0021200180053710938 nb_pixel_total : 78804 time to create 1 rle with old method : 0.08574199676513672 length of segment : 504 time for calcul the mask position with numpy : 0.0003998279571533203 nb_pixel_total : 16284 time to create 1 rle with old method : 0.018278837203979492 length of segment : 110 time for calcul the mask position with numpy : 0.0021729469299316406 nb_pixel_total : 80180 time to create 1 rle with old method : 0.08520913124084473 length of segment : 553 time for calcul the mask position with numpy : 0.0003554821014404297 nb_pixel_total : 10484 time to create 1 rle with old method : 0.012310504913330078 length of segment : 141 time for calcul the mask position with numpy : 0.0003170967102050781 nb_pixel_total : 7608 time to create 1 rle with old method : 0.01317143440246582 length of segment : 105 time for calcul the mask position with numpy : 0.00013828277587890625 nb_pixel_total : 4250 time to create 1 rle with old method : 0.004686832427978516 length of segment : 83 time for calcul the mask position with numpy : 0.0002791881561279297 nb_pixel_total : 8498 time to create 1 rle with old method : 0.009657859802246094 length of segment : 145 time for calcul the mask position with numpy : 0.00023031234741210938 nb_pixel_total : 5724 time to create 1 rle with old method : 0.006750345230102539 length of segment : 74 time for calcul the mask position with numpy : 0.0028142929077148438 nb_pixel_total : 109871 time to create 1 rle with old method : 0.11863541603088379 length of segment : 562 time for calcul the mask position with numpy : 0.0003674030303955078 nb_pixel_total : 8173 time to create 1 rle with old method : 0.009032249450683594 length of segment : 120 time for calcul the mask position with numpy : 0.0007796287536621094 nb_pixel_total : 26187 time to create 1 rle with old method : 0.028366565704345703 length of segment : 235 time for calcul the mask position with numpy : 0.002588987350463867 nb_pixel_total : 110574 time to create 1 rle with old method : 0.11550688743591309 length of segment : 558 time for calcul the mask position with numpy : 0.00036525726318359375 nb_pixel_total : 10332 time to create 1 rle with old method : 0.010994434356689453 length of segment : 126 time for calcul the mask position with numpy : 0.002611875534057617 nb_pixel_total : 117425 time to create 1 rle with old method : 0.1204078197479248 length of segment : 547 time for calcul the mask position with numpy : 0.0022430419921875 nb_pixel_total : 119815 time to create 1 rle with old method : 0.12186431884765625 length of segment : 531 time for calcul the mask position with numpy : 0.0004296302795410156 nb_pixel_total : 14215 time to create 1 rle with old method : 0.014729976654052734 length of segment : 213 time for calcul the mask position with numpy : 0.021136999130249023 nb_pixel_total : 1058500 time to create 1 rle with new method : 0.05895590782165527 length of segment : 1539 time for calcul the mask position with numpy : 0.00031256675720214844 nb_pixel_total : 6978 time to create 1 rle with old method : 0.0077168941497802734 length of segment : 111 time for calcul the mask position with numpy : 0.002420186996459961 nb_pixel_total : 102309 time to create 1 rle with old method : 0.11478042602539062 length of segment : 911 time for calcul the mask position with numpy : 0.0007596015930175781 nb_pixel_total : 22852 time to create 1 rle with old method : 0.02616739273071289 length of segment : 214 time for calcul the mask position with numpy : 0.0001742839813232422 nb_pixel_total : 2522 time to create 1 rle with old method : 0.003073453903198242 length of segment : 72 time for calcul the mask position with numpy : 0.002200603485107422 nb_pixel_total : 108487 time to create 1 rle with old method : 0.122039794921875 length of segment : 667 time for calcul the mask position with numpy : 0.017891407012939453 nb_pixel_total : 872445 time to create 1 rle with new method : 0.049544572830200195 length of segment : 1598 time for calcul the mask position with numpy : 0.00022101402282714844 nb_pixel_total : 13554 time to create 1 rle with old method : 0.015810728073120117 length of segment : 180 time for calcul the mask position with numpy : 0.0003662109375 nb_pixel_total : 14645 time to create 1 rle with old method : 0.01702117919921875 length of segment : 130 time for calcul the mask position with numpy : 0.0002689361572265625 nb_pixel_total : 5382 time to create 1 rle with old method : 0.006412506103515625 length of segment : 132 time for calcul the mask position with numpy : 0.0003380775451660156 nb_pixel_total : 14255 time to create 1 rle with old method : 0.01630401611328125 length of segment : 160 time for calcul the mask position with numpy : 0.0002765655517578125 nb_pixel_total : 7742 time to create 1 rle with old method : 0.008940696716308594 length of segment : 120 time for calcul the mask position with numpy : 0.0019376277923583984 nb_pixel_total : 110760 time to create 1 rle with old method : 0.1261157989501953 length of segment : 505 time for calcul the mask position with numpy : 0.0005152225494384766 nb_pixel_total : 21611 time to create 1 rle with old method : 0.02431941032409668 length of segment : 186 time for calcul the mask position with numpy : 0.0005195140838623047 nb_pixel_total : 22352 time to create 1 rle with old method : 0.02506732940673828 length of segment : 213 time spent for convertir_results : 5.899024248123169 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 61 chid ids of type : 3594 Number RLEs to save : 19122 save missing photos in datou_result : time spend for datou_step_exec : 41.735103368759155 time spend to save output : 1.1976590156555176 total time spend for step 1 : 42.93276238441467 step2:crop_condition Tue Sep 16 18:21:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 34 ! batch 1 Loaded 61 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3736932 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758039677_3370944 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 14 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.356817007064819 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3736932 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758039683_3370944 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 14 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.600980758666992 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 32 About to insert : list_path_to_insert length 32 new photo from crops ! About to upload 32 photos upload in portfolio : 3736932 init cache_photo without model_param we have 32 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758039707_3370944 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 32 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.01168966293335 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758039716_3370944 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5795321464538574 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1383938001, 1383937999, 1383937997, 1383937994, 1383937954, 1383937952, 1383937950, 1383937946, 1383937925, 1383937924, 1383937922, 1383937921, 1383937920, 1383937919, 1383937863, 1383937861, 1383937857, 1383937855, 1383937851, 1383937848, 1383937834, 1383937833, 1383937831, 1383937827, 1383937825, 1383937818, 1383937809, 1383937797, 1383937784, 1383937773, 1383937755, 1383937692, 1383937689, 1383937687] Looping around the photos to save general results len do output : 61 /1383960587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383960663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383938001', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937999', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937997', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937994', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937954', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937952', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937950', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937946', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937925', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937924', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937922', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937921', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937920', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937919', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937863', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937861', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937857', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937855', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937851', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937848', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937834', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937833', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937831', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937827', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937825', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937818', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937809', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937797', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937784', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937773', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937755', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937692', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937689', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937687', None, None, None, None, None, '3729393') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 217 time used for this insertion : 0.025915145874023438 save_final save missing photos in datou_result : time spend for datou_step_exec : 41.221099615097046 time spend to save output : 0.028189420700073242 total time spend for step 2 : 41.24928903579712 step3:rle_unique_nms_with_priority Tue Sep 16 18:21:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 61 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.14898037910461426 time for calcul the mask position with numpy : 0.03252100944519043 nb_pixel_total : 2065970 time to create 1 rle with new method : 0.0756223201751709 time for calcul the mask position with numpy : 0.005812406539916992 nb_pixel_total : 7630 time to create 1 rle with old method : 0.008213996887207031 create new chi : 0.12736892700195312 time to delete rle : 0.02540135383605957 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1434 TO DO : save crop sub photo not yet done ! save time : 0.11692595481872559 No data in photo_id : 1383937999 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.07549262046813965 time for calcul the mask position with numpy : 0.018685579299926758 nb_pixel_total : 2054372 time to create 1 rle with new method : 0.18617701530456543 time for calcul the mask position with numpy : 0.006526947021484375 nb_pixel_total : 19228 time to create 1 rle with old method : 0.021280527114868164 create new chi : 0.24025464057922363 time to delete rle : 0.0002543926239013672 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1588 TO DO : save crop sub photo not yet done ! save time : 0.13097882270812988 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.2709026336669922 time for calcul the mask position with numpy : 0.15454864501953125 nb_pixel_total : 2033200 time to create 1 rle with new method : 0.15603923797607422 time for calcul the mask position with numpy : 0.00604701042175293 nb_pixel_total : 6267 time to create 1 rle with old method : 0.006741046905517578 time for calcul the mask position with numpy : 0.00587773323059082 nb_pixel_total : 13372 time to create 1 rle with old method : 0.014321327209472656 time for calcul the mask position with numpy : 0.005747079849243164 nb_pixel_total : 2190 time to create 1 rle with old method : 0.0022864341735839844 time for calcul the mask position with numpy : 0.005945682525634766 nb_pixel_total : 18571 time to create 1 rle with old method : 0.01987433433532715 create new chi : 0.38751888275146484 time to delete rle : 0.0003170967102050781 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2134 TO DO : save crop sub photo not yet done ! save time : 0.15992116928100586 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.20648884773254395 time for calcul the mask position with numpy : 0.01871967315673828 nb_pixel_total : 1943971 time to create 1 rle with new method : 0.06809258460998535 time for calcul the mask position with numpy : 0.006795406341552734 nb_pixel_total : 129629 time to create 1 rle with old method : 0.13799333572387695 create new chi : 0.23896336555480957 time to delete rle : 0.0003209114074707031 batch 1 Loaded 3 chid ids of type : 3594 ++++Number RLEs to save : 2252 TO DO : save crop sub photo not yet done ! save time : 0.1658313274383545 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.16039443016052246 time for calcul the mask position with numpy : 0.05973458290100098 nb_pixel_total : 1949994 time to create 1 rle with new method : 0.12075424194335938 time for calcul the mask position with numpy : 0.0065305233001708984 nb_pixel_total : 112760 time to create 1 rle with old method : 0.11917805671691895 time for calcul the mask position with numpy : 0.005944252014160156 nb_pixel_total : 10846 time to create 1 rle with old method : 0.011425495147705078 create new chi : 0.33408641815185547 time to delete rle : 0.0003960132598876953 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2442 TO DO : save crop sub photo not yet done ! save time : 0.17130160331726074 No data in photo_id : 1383937950 No data in photo_id : 1383937946 No data in photo_id : 1383937925 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.08088850975036621 time for calcul the mask position with numpy : 0.019817829132080078 nb_pixel_total : 2053049 time to create 1 rle with new method : 0.13724136352539062 time for calcul the mask position with numpy : 0.005929470062255859 nb_pixel_total : 20551 time to create 1 rle with old method : 0.02250194549560547 create new chi : 0.19275283813476562 time to delete rle : 0.0002262592315673828 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1522 TO DO : save crop sub photo not yet done ! save time : 0.12937140464782715 No data in photo_id : 1383937922 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.12443685531616211 time for calcul the mask position with numpy : 0.05872082710266113 nb_pixel_total : 2056113 time to create 1 rle with new method : 0.1466209888458252 time for calcul the mask position with numpy : 0.005880117416381836 nb_pixel_total : 12460 time to create 1 rle with old method : 0.013895273208618164 time for calcul the mask position with numpy : 0.006137371063232422 nb_pixel_total : 5027 time to create 1 rle with old method : 0.005669116973876953 create new chi : 0.2471611499786377 time to delete rle : 0.00026345252990722656 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1620 TO DO : save crop sub photo not yet done ! save time : 0.13279461860656738 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.45072031021118164 time for calcul the mask position with numpy : 0.01105046272277832 nb_pixel_total : 711426 time to create 1 rle with new method : 0.08531379699707031 time for calcul the mask position with numpy : 0.10430502891540527 nb_pixel_total : 1222403 time to create 1 rle with new method : 0.11177611351013184 time for calcul the mask position with numpy : 0.008014440536499023 nb_pixel_total : 118336 time to create 1 rle with old method : 0.1309680938720703 time for calcul the mask position with numpy : 0.006259918212890625 nb_pixel_total : 7773 time to create 1 rle with old method : 0.008619546890258789 time for calcul the mask position with numpy : 0.0065457820892333984 nb_pixel_total : 13662 time to create 1 rle with old method : 0.015338897705078125 create new chi : 0.5058276653289795 time to delete rle : 0.0007205009460449219 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 5428 TO DO : save crop sub photo not yet done ! save time : 0.3181765079498291 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.17843198776245117 time for calcul the mask position with numpy : 0.19056105613708496 nb_pixel_total : 2053130 time to create 1 rle with new method : 0.07348489761352539 time for calcul the mask position with numpy : 0.005995750427246094 nb_pixel_total : 1578 time to create 1 rle with old method : 0.0018384456634521484 time for calcul the mask position with numpy : 0.006014585494995117 nb_pixel_total : 14883 time to create 1 rle with old method : 0.01624274253845215 time for calcul the mask position with numpy : 0.006092071533203125 nb_pixel_total : 4009 time to create 1 rle with old method : 0.004411458969116211 create new chi : 0.31356382369995117 time to delete rle : 0.00027060508728027344 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1646 TO DO : save crop sub photo not yet done ! save time : 0.13569331169128418 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.12665843963623047 time for calcul the mask position with numpy : 0.01956939697265625 nb_pixel_total : 2059518 time to create 1 rle with new method : 0.08313608169555664 time for calcul the mask position with numpy : 0.006200075149536133 nb_pixel_total : 6505 time to create 1 rle with old method : 0.006962776184082031 time for calcul the mask position with numpy : 0.00597691535949707 nb_pixel_total : 7577 time to create 1 rle with old method : 0.00833749771118164 create new chi : 0.14094161987304688 time to delete rle : 0.00022983551025390625 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1476 TO DO : save crop sub photo not yet done ! save time : 0.11763787269592285 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.44370555877685547 time for calcul the mask position with numpy : 0.14400625228881836 nb_pixel_total : 1962073 time to create 1 rle with new method : 0.1634061336517334 time for calcul the mask position with numpy : 0.006040811538696289 nb_pixel_total : 2748 time to create 1 rle with old method : 0.002968311309814453 time for calcul the mask position with numpy : 0.006474733352661133 nb_pixel_total : 100796 time to create 1 rle with old method : 0.10769271850585938 time for calcul the mask position with numpy : 0.006998777389526367 nb_pixel_total : 7983 time to create 1 rle with old method : 0.00921773910522461 create new chi : 0.4571199417114258 time to delete rle : 0.0006382465362548828 batch 1 Loaded 7 chid ids of type : 3594 ++++++Number RLEs to save : 2620 TO DO : save crop sub photo not yet done ! save time : 0.18057823181152344 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.26686549186706543 time for calcul the mask position with numpy : 0.10811090469360352 nb_pixel_total : 1924730 time to create 1 rle with new method : 0.08223581314086914 time for calcul the mask position with numpy : 0.0060198307037353516 nb_pixel_total : 5037 time to create 1 rle with old method : 0.005470752716064453 time for calcul the mask position with numpy : 0.0060443878173828125 nb_pixel_total : 7541 time to create 1 rle with old method : 0.008466958999633789 time for calcul the mask position with numpy : 0.00617218017578125 nb_pixel_total : 3433 time to create 1 rle with old method : 0.003989458084106445 time for calcul the mask position with numpy : 0.0070726871490478516 nb_pixel_total : 132859 time to create 1 rle with old method : 0.14626550674438477 create new chi : 0.390639066696167 time to delete rle : 0.0003097057342529297 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2736 TO DO : save crop sub photo not yet done ! save time : 0.18598508834838867 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.20099616050720215 time for calcul the mask position with numpy : 0.03672003746032715 nb_pixel_total : 1960743 time to create 1 rle with new method : 0.17399191856384277 time for calcul the mask position with numpy : 0.0063059329986572266 nb_pixel_total : 99683 time to create 1 rle with old method : 0.10880041122436523 time for calcul the mask position with numpy : 0.006636619567871094 nb_pixel_total : 13174 time to create 1 rle with old method : 0.014549732208251953 create new chi : 0.34750914573669434 time to delete rle : 0.00048422813415527344 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2374 TO DO : save crop sub photo not yet done ! save time : 0.1984860897064209 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.040918827056884766 time for calcul the mask position with numpy : 0.018765926361083984 nb_pixel_total : 2006484 time to create 1 rle with new method : 0.07469367980957031 time for calcul the mask position with numpy : 0.006415843963623047 nb_pixel_total : 67116 time to create 1 rle with old method : 0.0728304386138916 create new chi : 0.17996788024902344 time to delete rle : 0.00026702880859375 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 1642 TO DO : save crop sub photo not yet done ! save time : 0.13552141189575195 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04300642013549805 time for calcul the mask position with numpy : 0.15718293190002441 nb_pixel_total : 1977136 time to create 1 rle with new method : 0.16322803497314453 time for calcul the mask position with numpy : 0.006474733352661133 nb_pixel_total : 80180 time to create 1 rle with old method : 0.0905299186706543 time for calcul the mask position with numpy : 0.0067713260650634766 nb_pixel_total : 16284 time to create 1 rle with old method : 0.018413066864013672 create new chi : 0.45146918296813965 time to delete rle : 0.0004329681396484375 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2406 TO DO : save crop sub photo not yet done ! save time : 0.16283082962036133 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 0.2778019905090332 time for calcul the mask position with numpy : 0.16416287422180176 nb_pixel_total : 1918992 time to create 1 rle with new method : 0.13702106475830078 time for calcul the mask position with numpy : 0.006105661392211914 nb_pixel_total : 8173 time to create 1 rle with old method : 0.00918269157409668 time for calcul the mask position with numpy : 0.007112979888916016 nb_pixel_total : 109871 time to create 1 rle with old method : 0.11951255798339844 time for calcul the mask position with numpy : 0.006234645843505859 nb_pixel_total : 5724 time to create 1 rle with old method : 0.00643610954284668 time for calcul the mask position with numpy : 0.006181240081787109 nb_pixel_total : 8498 time to create 1 rle with old method : 0.009448051452636719 time for calcul the mask position with numpy : 0.006644248962402344 nb_pixel_total : 4250 time to create 1 rle with old method : 0.004884481430053711 time for calcul the mask position with numpy : 0.006765604019165039 nb_pixel_total : 7608 time to create 1 rle with old method : 0.008537054061889648 time for calcul the mask position with numpy : 0.006616353988647461 nb_pixel_total : 10484 time to create 1 rle with old method : 0.011502981185913086 create new chi : 0.5277907848358154 time to delete rle : 0.0005693435668945312 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 3540 TO DO : save crop sub photo not yet done ! save time : 0.2611715793609619 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.05497241020202637 time for calcul the mask position with numpy : 0.024223804473876953 nb_pixel_total : 1936839 time to create 1 rle with new method : 0.031267404556274414 time for calcul the mask position with numpy : 0.006774187088012695 nb_pixel_total : 110574 time to create 1 rle with old method : 0.12048482894897461 time for calcul the mask position with numpy : 0.006059885025024414 nb_pixel_total : 26187 time to create 1 rle with old method : 0.028797388076782227 create new chi : 0.22477149963378906 time to delete rle : 0.00041365623474121094 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2666 TO DO : save crop sub photo not yet done ! save time : 0.19822120666503906 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.038800716400146484 time for calcul the mask position with numpy : 0.018126487731933594 nb_pixel_total : 1945843 time to create 1 rle with new method : 0.21298599243164062 time for calcul the mask position with numpy : 0.006556272506713867 nb_pixel_total : 117425 time to create 1 rle with old method : 0.12877964973449707 time for calcul the mask position with numpy : 0.006699323654174805 nb_pixel_total : 10332 time to create 1 rle with old method : 0.011340856552124023 create new chi : 0.39452695846557617 time to delete rle : 0.0003972053527832031 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2426 TO DO : save crop sub photo not yet done ! save time : 0.18389391899108887 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.07473206520080566 time for calcul the mask position with numpy : 0.061240196228027344 nb_pixel_total : 892818 time to create 1 rle with new method : 0.08387565612792969 time for calcul the mask position with numpy : 0.03449273109436035 nb_pixel_total : 1046752 time to create 1 rle with new method : 0.16010141372680664 time for calcul the mask position with numpy : 0.006109952926635742 nb_pixel_total : 14215 time to create 1 rle with old method : 0.01578211784362793 time for calcul the mask position with numpy : 0.006905794143676758 nb_pixel_total : 119815 time to create 1 rle with old method : 0.13349509239196777 create new chi : 0.5187170505523682 time to delete rle : 0.00093841552734375 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 5555 TO DO : save crop sub photo not yet done ! save time : 0.34050703048706055 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04014754295349121 time for calcul the mask position with numpy : 0.1663365364074707 nb_pixel_total : 1964313 time to create 1 rle with new method : 0.07437276840209961 time for calcul the mask position with numpy : 0.0063245296478271484 nb_pixel_total : 102309 time to create 1 rle with old method : 0.10794997215270996 time for calcul the mask position with numpy : 0.0059583187103271484 nb_pixel_total : 6978 time to create 1 rle with old method : 0.007502555847167969 create new chi : 0.3774383068084717 time to delete rle : 0.0005123615264892578 batch 1 Loaded 5 chid ids of type : 3594 +++++Number RLEs to save : 3124 TO DO : save crop sub photo not yet done ! save time : 0.22595548629760742 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03282666206359863 time for calcul the mask position with numpy : 0.018876075744628906 nb_pixel_total : 2050748 time to create 1 rle with new method : 0.10604310035705566 time for calcul the mask position with numpy : 0.00609278678894043 nb_pixel_total : 22852 time to create 1 rle with old method : 0.025150299072265625 create new chi : 0.1633319854736328 time to delete rle : 0.0002536773681640625 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1508 TO DO : save crop sub photo not yet done ! save time : 0.13465213775634766 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03279542922973633 time for calcul the mask position with numpy : 0.01916337013244629 nb_pixel_total : 2071078 time to create 1 rle with new method : 0.20597100257873535 time for calcul the mask position with numpy : 0.006280183792114258 nb_pixel_total : 2522 time to create 1 rle with old method : 0.0027399063110351562 create new chi : 0.24131321907043457 time to delete rle : 0.0002548694610595703 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1224 TO DO : save crop sub photo not yet done ! save time : 0.1139223575592041 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.040131568908691406 time for calcul the mask position with numpy : 0.02374553680419922 nb_pixel_total : 1965113 time to create 1 rle with new method : 0.08424830436706543 time for calcul the mask position with numpy : 0.0075151920318603516 nb_pixel_total : 108487 time to create 1 rle with old method : 0.12337088584899902 create new chi : 0.24887323379516602 time to delete rle : 0.0004119873046875 batch 1 Loaded 3 chid ids of type : 3594 ++++Number RLEs to save : 2414 TO DO : save crop sub photo not yet done ! save time : 0.1846921443939209 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.040932655334472656 time for calcul the mask position with numpy : 0.04143834114074707 nb_pixel_total : 1200409 time to create 1 rle with new method : 0.17086172103881836 time for calcul the mask position with numpy : 0.0062639713287353516 nb_pixel_total : 746 time to create 1 rle with old method : 0.0011293888092041016 time for calcul the mask position with numpy : 0.016083478927612305 nb_pixel_total : 872445 time to create 1 rle with new method : 0.08150243759155273 create new chi : 0.32674503326416016 time to delete rle : 0.0005922317504882812 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 4330 TO DO : save crop sub photo not yet done ! save time : 0.2894120216369629 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03332352638244629 time for calcul the mask position with numpy : 0.019452333450317383 nb_pixel_total : 2058955 time to create 1 rle with new method : 0.05130910873413086 time for calcul the mask position with numpy : 0.006321430206298828 nb_pixel_total : 14645 time to create 1 rle with old method : 0.016629934310913086 create new chi : 0.10053467750549316 time to delete rle : 0.00032258033752441406 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1340 TO DO : save crop sub photo not yet done ! save time : 0.11534953117370605 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03188276290893555 time for calcul the mask position with numpy : 0.019043445587158203 nb_pixel_total : 2068218 time to create 1 rle with new method : 0.08881926536560059 time for calcul the mask position with numpy : 0.0058820247650146484 nb_pixel_total : 5382 time to create 1 rle with old method : 0.0059053897857666016 create new chi : 0.1266624927520752 time to delete rle : 0.0002315044403076172 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 1344 TO DO : save crop sub photo not yet done ! save time : 0.10674142837524414 No data in photo_id : 1383937692 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.05816245079040527 time for calcul the mask position with numpy : 0.13234829902648926 nb_pixel_total : 2051603 time to create 1 rle with new method : 0.19997930526733398 time for calcul the mask position with numpy : 0.005950450897216797 nb_pixel_total : 7742 time to create 1 rle with old method : 0.008265018463134766 time for calcul the mask position with numpy : 0.005910158157348633 nb_pixel_total : 14255 time to create 1 rle with old method : 0.015223979949951172 create new chi : 0.37715959548950195 time to delete rle : 0.00037217140197753906 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1640 TO DO : save crop sub photo not yet done ! save time : 0.12675118446350098 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.07104039192199707 time for calcul the mask position with numpy : 0.1203913688659668 nb_pixel_total : 1918877 time to create 1 rle with new method : 0.0761265754699707 time for calcul the mask position with numpy : 0.006094694137573242 nb_pixel_total : 22352 time to create 1 rle with old method : 0.02338862419128418 time for calcul the mask position with numpy : 0.005696535110473633 nb_pixel_total : 21611 time to create 1 rle with old method : 0.02272629737854004 time for calcul the mask position with numpy : 0.006421327590942383 nb_pixel_total : 110760 time to create 1 rle with old method : 0.11740899085998535 create new chi : 0.3886075019836426 time to delete rle : 0.00031495094299316406 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2888 TO DO : save crop sub photo not yet done ! save time : 0.19946646690368652 map_output_result : {1383938001: (0.0, 'Should be the crop_list due to order', 0), 1383937999: (0.0, 'Should be the crop_list due to order', 0.0), 1383937997: (0.0, 'Should be the crop_list due to order', 0), 1383937994: (0.0, 'Should be the crop_list due to order', 0), 1383937954: (0.0, 'Should be the crop_list due to order', 0), 1383937952: (0.0, 'Should be the crop_list due to order', 0), 1383937950: (0.0, 'Should be the crop_list due to order', 0.0), 1383937946: (0.0, 'Should be the crop_list due to order', 0.0), 1383937925: (0.0, 'Should be the crop_list due to order', 0.0), 1383937924: (0.0, 'Should be the crop_list due to order', 0), 1383937922: (0.0, 'Should be the crop_list due to order', 0.0), 1383937921: (0.0, 'Should be the crop_list due to order', 0), 1383937920: (0.0, 'Should be the crop_list due to order', 0), 1383937919: (0.0, 'Should be the crop_list due to order', 0), 1383937863: (0.0, 'Should be the crop_list due to order', 0), 1383937861: (0.0, 'Should be the crop_list due to order', 0), 1383937857: (0.0, 'Should be the crop_list due to order', 0), 1383937855: (0.0, 'Should be the crop_list due to order', 0), 1383937851: (0.0, 'Should be the crop_list due to order', 0), 1383937848: (0.0, 'Should be the crop_list due to order', 0), 1383937834: (0.0, 'Should be the crop_list due to order', 0), 1383937833: (0.0, 'Should be the crop_list due to order', 0), 1383937831: (0.0, 'Should be the crop_list due to order', 0), 1383937827: (0.0, 'Should be the crop_list due to order', 0), 1383937825: (0.0, 'Should be the crop_list due to order', 0), 1383937818: (0.0, 'Should be the crop_list due to order', 0), 1383937809: (0.0, 'Should be the crop_list due to order', 0), 1383937797: (0.0, 'Should be the crop_list due to order', 0), 1383937784: (0.0, 'Should be the crop_list due to order', 0), 1383937773: (0.0, 'Should be the crop_list due to order', 0), 1383937755: (0.0, 'Should be the crop_list due to order', 0), 1383937692: (0.0, 'Should be the crop_list due to order', 0.0), 1383937689: (0.0, 'Should be the crop_list due to order', 0), 1383937687: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1383938001, 1383937999, 1383937997, 1383937994, 1383937954, 1383937952, 1383937950, 1383937946, 1383937925, 1383937924, 1383937922, 1383937921, 1383937920, 1383937919, 1383937863, 1383937861, 1383937857, 1383937855, 1383937851, 1383937848, 1383937834, 1383937833, 1383937831, 1383937827, 1383937825, 1383937818, 1383937809, 1383937797, 1383937784, 1383937773, 1383937755, 1383937692, 1383937689, 1383937687] Looping around the photos to save general results len do output : 34 /1383938001.Didn't retrieve data . /1383937999.Didn't retrieve data . /1383937997.Didn't retrieve data . /1383937994.Didn't retrieve data . /1383937954.Didn't retrieve data . /1383937952.Didn't retrieve data . /1383937950.Didn't retrieve data . /1383937946.Didn't retrieve data . /1383937925.Didn't retrieve data . /1383937924.Didn't retrieve data . /1383937922.Didn't retrieve data . /1383937921.Didn't retrieve data . /1383937920.Didn't retrieve data . /1383937919.Didn't retrieve data . /1383937863.Didn't retrieve data . /1383937861.Didn't retrieve data . /1383937857.Didn't retrieve data . /1383937855.Didn't retrieve data . /1383937851.Didn't retrieve data . /1383937848.Didn't retrieve data . /1383937834.Didn't retrieve data . /1383937833.Didn't retrieve data . /1383937831.Didn't retrieve data . /1383937827.Didn't retrieve data . /1383937825.Didn't retrieve data . /1383937818.Didn't retrieve data . /1383937809.Didn't retrieve data . /1383937797.Didn't retrieve data . /1383937784.Didn't retrieve data . /1383937773.Didn't retrieve data . /1383937755.Didn't retrieve data . /1383937692.Didn't retrieve data . /1383937689.Didn't retrieve data . /1383937687.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383938001', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937999', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937997', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937994', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937954', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937952', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937950', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937946', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937925', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937924', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937922', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937921', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937920', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937919', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937863', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937861', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937857', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937855', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937851', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937848', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937834', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937833', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937831', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937827', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937825', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937818', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937809', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937797', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937784', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937773', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937755', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937692', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937689', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937687', None, None, None, None, None, '3729393') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 102 time used for this insertion : 0.01705169677734375 save_final save missing photos in datou_result : time spend for datou_step_exec : 17.97875452041626 time spend to save output : 0.018518447875976562 total time spend for step 3 : 17.997272968292236 step4:ventilate_hashtags_in_portfolio Tue Sep 16 18:22:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26902187 get user id for portfolio 26902187 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26902187 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','autre','mal_croppe','carton','background','papier','pet_fonce','flou','pet_clair','metal','pehd')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26902187 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','autre','mal_croppe','carton','background','papier','pet_fonce','flou','pet_clair','metal','pehd')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26902187 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','autre','mal_croppe','carton','background','papier','pet_fonce','flou','pet_clair','metal','pehd')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26903359,26903360,26903361,26903362,26903363,26903364,26903365,26903366,26903367,26903368,26903369?tags=environnement,autre,mal_croppe,carton,background,papier,pet_fonce,flou,pet_clair,metal,pehd Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1383938001, 1383937999, 1383937997, 1383937994, 1383937954, 1383937952, 1383937950, 1383937946, 1383937925, 1383937924, 1383937922, 1383937921, 1383937920, 1383937919, 1383937863, 1383937861, 1383937857, 1383937855, 1383937851, 1383937848, 1383937834, 1383937833, 1383937831, 1383937827, 1383937825, 1383937818, 1383937809, 1383937797, 1383937784, 1383937773, 1383937755, 1383937692, 1383937689, 1383937687] Looping around the photos to save general results len do output : 1 /26902187. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383938001', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937999', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937997', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937994', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937954', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937952', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937950', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937946', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937925', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937924', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937922', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937921', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937920', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937919', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937863', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937861', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937857', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937855', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937851', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937848', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937834', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937833', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937831', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937827', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937825', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937818', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937809', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937797', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937784', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937773', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937755', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937692', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937689', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937687', None, None, None, None, None, '3729393') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 35 time used for this insertion : 0.019216537475585938 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7077288627624512 time spend to save output : 0.019617795944213867 total time spend for step 4 : 1.727346658706665 step5:final Tue Sep 16 18:22:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1383938001: ('0.07382847959785767',), 1383937999: ('0.07382847959785767',), 1383937997: ('0.07382847959785767',), 1383937994: ('0.07382847959785767',), 1383937954: ('0.07382847959785767',), 1383937952: ('0.07382847959785767',), 1383937950: ('0.07382847959785767',), 1383937946: ('0.07382847959785767',), 1383937925: ('0.07382847959785767',), 1383937924: ('0.07382847959785767',), 1383937922: ('0.07382847959785767',), 1383937921: ('0.07382847959785767',), 1383937920: ('0.07382847959785767',), 1383937919: ('0.07382847959785767',), 1383937863: ('0.07382847959785767',), 1383937861: ('0.07382847959785767',), 1383937857: ('0.07382847959785767',), 1383937855: ('0.07382847959785767',), 1383937851: ('0.07382847959785767',), 1383937848: ('0.07382847959785767',), 1383937834: ('0.07382847959785767',), 1383937833: ('0.07382847959785767',), 1383937831: ('0.07382847959785767',), 1383937827: ('0.07382847959785767',), 1383937825: ('0.07382847959785767',), 1383937818: ('0.07382847959785767',), 1383937809: ('0.07382847959785767',), 1383937797: ('0.07382847959785767',), 1383937784: ('0.07382847959785767',), 1383937773: ('0.07382847959785767',), 1383937755: ('0.07382847959785767',), 1383937692: ('0.07382847959785767',), 1383937689: ('0.07382847959785767',), 1383937687: ('0.07382847959785767',)} new output for save of step final : {1383938001: ('0.07382847959785767',), 1383937999: ('0.07382847959785767',), 1383937997: ('0.07382847959785767',), 1383937994: ('0.07382847959785767',), 1383937954: ('0.07382847959785767',), 1383937952: ('0.07382847959785767',), 1383937950: ('0.07382847959785767',), 1383937946: ('0.07382847959785767',), 1383937925: ('0.07382847959785767',), 1383937924: ('0.07382847959785767',), 1383937922: ('0.07382847959785767',), 1383937921: ('0.07382847959785767',), 1383937920: ('0.07382847959785767',), 1383937919: ('0.07382847959785767',), 1383937863: ('0.07382847959785767',), 1383937861: ('0.07382847959785767',), 1383937857: ('0.07382847959785767',), 1383937855: ('0.07382847959785767',), 1383937851: ('0.07382847959785767',), 1383937848: ('0.07382847959785767',), 1383937834: ('0.07382847959785767',), 1383937833: ('0.07382847959785767',), 1383937831: ('0.07382847959785767',), 1383937827: ('0.07382847959785767',), 1383937825: ('0.07382847959785767',), 1383937818: ('0.07382847959785767',), 1383937809: ('0.07382847959785767',), 1383937797: ('0.07382847959785767',), 1383937784: ('0.07382847959785767',), 1383937773: ('0.07382847959785767',), 1383937755: ('0.07382847959785767',), 1383937692: ('0.07382847959785767',), 1383937689: ('0.07382847959785767',), 1383937687: ('0.07382847959785767',)} [1383938001, 1383937999, 1383937997, 1383937994, 1383937954, 1383937952, 1383937950, 1383937946, 1383937925, 1383937924, 1383937922, 1383937921, 1383937920, 1383937919, 1383937863, 1383937861, 1383937857, 1383937855, 1383937851, 1383937848, 1383937834, 1383937833, 1383937831, 1383937827, 1383937825, 1383937818, 1383937809, 1383937797, 1383937784, 1383937773, 1383937755, 1383937692, 1383937689, 1383937687] Looping around the photos to save general results len do output : 34 /1383938001.Didn't retrieve data . /1383937999.Didn't retrieve data . /1383937997.Didn't retrieve data . /1383937994.Didn't retrieve data . /1383937954.Didn't retrieve data . /1383937952.Didn't retrieve data . /1383937950.Didn't retrieve data . /1383937946.Didn't retrieve data . /1383937925.Didn't retrieve data . /1383937924.Didn't retrieve data . /1383937922.Didn't retrieve data . /1383937921.Didn't retrieve data . /1383937920.Didn't retrieve data . /1383937919.Didn't retrieve data . /1383937863.Didn't retrieve data . /1383937861.Didn't retrieve data . /1383937857.Didn't retrieve data . /1383937855.Didn't retrieve data . /1383937851.Didn't retrieve data . /1383937848.Didn't retrieve data . /1383937834.Didn't retrieve data . /1383937833.Didn't retrieve data . /1383937831.Didn't retrieve data . /1383937827.Didn't retrieve data . /1383937825.Didn't retrieve data . /1383937818.Didn't retrieve data . /1383937809.Didn't retrieve data . /1383937797.Didn't retrieve data . /1383937784.Didn't retrieve data . /1383937773.Didn't retrieve data . /1383937755.Didn't retrieve data . /1383937692.Didn't retrieve data . /1383937689.Didn't retrieve data . /1383937687.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383938001', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937999', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937997', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937994', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937954', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937952', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937950', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937946', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937925', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937924', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937922', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937921', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937920', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937919', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937863', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937861', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937857', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937855', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937851', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937848', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937834', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937833', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937831', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937827', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937825', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937818', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937809', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937797', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937784', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937773', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937755', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937692', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937689', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937687', None, None, None, None, None, '3729393') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 102 time used for this insertion : 0.016259431838989258 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11622858047485352 time spend to save output : 0.017175674438476562 total time spend for step 5 : 0.13340425491333008 step6:blur_detection Tue Sep 16 18:22:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1758039628_3370944_1383938001_f2d55f5d3be4338e55cc2c350b5ffe95.jpg resize: (1080, 1920) 1383938001 -1.571702335256608 treat image : temp/1758039628_3370944_1383937999_36dddd745b6cb24254b28e3ef5e41a1c.jpg resize: (1080, 1920) 1383937999 -2.304024964884308 treat image : temp/1758039628_3370944_1383937997_3d13c50103a0842393c4620f8c6b6efc.jpg resize: (1080, 1920) 1383937997 -1.7951127141455787 treat image : temp/1758039628_3370944_1383937994_0b653ca7408c043bd5da282efe1d41e7.jpg resize: (1080, 1920) 1383937994 -2.1989768260189932 treat image : temp/1758039628_3370944_1383937954_5a12aac56ec9ccaa002e500c35de5f1d.jpg resize: (1080, 1920) 1383937954 -2.56498405309684 treat image : temp/1758039628_3370944_1383937952_b0ef7eadff24ce8495d82b3a8ccf775c.jpg resize: (1080, 1920) 1383937952 -2.6977782221779356 treat image : temp/1758039628_3370944_1383937950_36ed37e25416bbda52a894b02103532f.jpg resize: (1080, 1920) 1383937950 -2.4189932226341115 treat image : temp/1758039628_3370944_1383937946_58817a248127e4b3d61e82f5c03f6016.jpg resize: (1080, 1920) 1383937946 -2.3811960839514863 treat image : temp/1758039628_3370944_1383937925_ae9d149dcf42d9fbc45c0d57b86b4407.jpg resize: (1080, 1920) 1383937925 0.5337169209156096 treat image : temp/1758039628_3370944_1383937924_1efbf02938b17c3851f6268df7c1db98.jpg resize: (1080, 1920) 1383937924 -2.493162215845162 treat image : temp/1758039628_3370944_1383937922_f1f476cf7ec7727477ac99a11036191e.jpg resize: (1080, 1920) 1383937922 -2.1112945778871106 treat image : temp/1758039628_3370944_1383937921_1ddb06950f7dbe0ac744a3a32ccabe32.jpg resize: (1080, 1920) 1383937921 -1.9201380280333626 treat image : temp/1758039628_3370944_1383937920_2fc0156b5bf43f88cb97bb2fd02a8d8a.jpg resize: (1080, 1920) 1383937920 -2.9821410734404803 treat image : temp/1758039628_3370944_1383937919_951438ee56d91f5d1e400d3cd7ce2e87.jpg resize: (1080, 1920) 1383937919 -4.710761856457114 treat image : temp/1758039628_3370944_1383937863_da202b8122cacc4a214fbfb62d79b66c.jpg resize: (1080, 1920) 1383937863 -2.5746992223483613 treat image : temp/1758039628_3370944_1383937861_c4735f5423aff62eed61f167b775a733.jpg resize: (1080, 1920) 1383937861 -2.7675883430206154 treat image : temp/1758039628_3370944_1383937857_01e5f419404fed85e72a2557b16f5331.jpg resize: (1080, 1920) 1383937857 -0.7518085734851087 treat image : temp/1758039628_3370944_1383937855_982cd709ebdc4767976b303589887ff0.jpg resize: (1080, 1920) 1383937855 -2.2766778734450335 treat image : temp/1758039628_3370944_1383937851_4b2562b185b8ee602782c8a30eb41b4d.jpg resize: (1080, 1920) 1383937851 -1.7229648391284726 treat image : temp/1758039628_3370944_1383937848_73ff5450d51f2eb5623ed2644149b5f9.jpg resize: (1080, 1920) 1383937848 -2.7185397562892826 treat image : temp/1758039628_3370944_1383937834_f4981aeb5de7c06f5c1a68867a11dc0c.jpg resize: (1080, 1920) 1383937834 -2.6800150062834964 treat image : temp/1758039628_3370944_1383937833_2e8c829a00f9c3d66cbddf5206d3fe62.jpg resize: (1080, 1920) 1383937833 -2.1203689378765045 treat image : temp/1758039628_3370944_1383937831_06f7bf912518636410da24eed5b117bf.jpg resize: (1080, 1920) 1383937831 -4.535732658950807 treat image : temp/1758039628_3370944_1383937827_85630d0399cd527df1c483b53f0fa554.jpg resize: (1080, 1920) 1383937827 -3.1135266287889003 treat image : temp/1758039628_3370944_1383937825_01e695d02825b45c17efe11604a92977.jpg resize: (1080, 1920) 1383937825 -1.6794911431452593 treat image : temp/1758039628_3370944_1383937818_079c5fa03dd6ae8afaf18241cccb84b6.jpg resize: (1080, 1920) 1383937818 -1.4208738912737502 treat image : temp/1758039628_3370944_1383937809_04b2ddc726a6fead0317ae46acb9bb56.jpg resize: (1080, 1920) 1383937809 -2.6339540358229967 treat image : temp/1758039628_3370944_1383937797_2f314c053695766aa77e6c1e03b27662.jpg resize: (1080, 1920) 1383937797 -2.710395887400717 treat image : temp/1758039628_3370944_1383937784_aedbdf1fc1fb4cb27d1dce63d9d5d223.jpg resize: (1080, 1920) 1383937784 -3.847122143199717 treat image : temp/1758039628_3370944_1383937773_c437480d47fab97e23965286b44c63b6.jpg resize: (1080, 1920) 1383937773 -0.0944079009752769 treat image : temp/1758039628_3370944_1383937755_eab635a08472ae66fe97cc8607031e6c.jpg resize: (1080, 1920) 1383937755 -2.515723805164391 treat image : temp/1758039628_3370944_1383937692_0853dfdab33aba730f8a1448a6618ee9.jpg resize: (1080, 1920) 1383937692 -2.2734718227913207 treat image : temp/1758039628_3370944_1383937689_69b02b85e842a1323b5ce3638de312a2.jpg resize: (1080, 1920) 1383937689 -1.4627973715609928 treat image : temp/1758039628_3370944_1383937687_255aa1891e4a72ee82663d840a062e3a.jpg resize: (1080, 1920) 1383937687 -2.8477820783964742 treat image : temp/1758039628_3370944_1383938001_f2d55f5d3be4338e55cc2c350b5ffe95_rle_crop_3959753621_0.png resize: (145, 122) 1383960587 -2.0109317771590502 treat image : temp/1758039628_3370944_1383937994_0b653ca7408c043bd5da282efe1d41e7_rle_crop_3959753623_0.png resize: (194, 155) 1383960588 -0.29661171695105343 treat image : temp/1758039628_3370944_1383937921_1ddb06950f7dbe0ac744a3a32ccabe32_rle_crop_3959753631_0.png resize: (94, 69) 1383960589 0.6796662542139382 treat image : temp/1758039628_3370944_1383937920_2fc0156b5bf43f88cb97bb2fd02a8d8a_rle_crop_3959753634_0.png resize: (194, 64) 1383960590 -2.0885364555406416 treat image : temp/1758039628_3370944_1383937919_951438ee56d91f5d1e400d3cd7ce2e87_rle_crop_3959753637_0.png resize: (58, 103) 1383960591 -1.301489320502951 treat image : temp/1758039628_3370944_1383937919_951438ee56d91f5d1e400d3cd7ce2e87_rle_crop_3959753639_0.png resize: (41, 46) 1383960592 -4.968639745303806 treat image : temp/1758039628_3370944_1383937861_c4735f5423aff62eed61f167b775a733_rle_crop_3959753644_0.png resize: (68, 66) 1383960593 -2.4038479064204474 treat image : temp/1758039628_3370944_1383937857_01e5f419404fed85e72a2557b16f5331_rle_crop_3959753648_0.png resize: (105, 68) 1383960594 -1.3187992432460238 treat image : temp/1758039628_3370944_1383937834_f4981aeb5de7c06f5c1a68867a11dc0c_rle_crop_3959753655_0.png resize: (105, 113) 1383960595 -1.5791547055833717 treat image : temp/1758039628_3370944_1383937834_f4981aeb5de7c06f5c1a68867a11dc0c_rle_crop_3959753656_0.png resize: (83, 65) 1383960596 1.0438093709941987 treat image : temp/1758039628_3370944_1383937834_f4981aeb5de7c06f5c1a68867a11dc0c_rle_crop_3959753658_0.png resize: (74, 111) 1383960597 2.032549477541531 treat image : temp/1758039628_3370944_1383937825_01e695d02825b45c17efe11604a92977_rle_crop_3959753668_0.png resize: (111, 92) 1383960598 -0.7794271825091637 treat image : temp/1758039628_3370944_1383937809_04b2ddc726a6fead0317ae46acb9bb56_rle_crop_3959753671_0.png resize: (72, 55) 1383960599 -1.6841620106872133 treat image : temp/1758039628_3370944_1383937755_eab635a08472ae66fe97cc8607031e6c_rle_crop_3959753676_0.png resize: (134, 92) 1383960600 -2.559984589389023 treat image : temp/1758039628_3370944_1383937952_b0ef7eadff24ce8495d82b3a8ccf775c_rle_crop_3959753628_0.png resize: (170, 96) 1383960604 -1.7564260127157005 treat image : temp/1758039628_3370944_1383937921_1ddb06950f7dbe0ac744a3a32ccabe32_rle_crop_3959753632_0.png resize: (166, 95) 1383960606 0.35143897480562497 treat image : temp/1758039628_3370944_1383937920_2fc0156b5bf43f88cb97bb2fd02a8d8a_rle_crop_3959753633_0.png resize: (164, 103) 1383960607 -0.7656190617171567 treat image : temp/1758039628_3370944_1383937919_951438ee56d91f5d1e400d3cd7ce2e87_rle_crop_3959753638_0.png resize: (178, 104) 1383960608 -0.16793970168251762 treat image : temp/1758039628_3370944_1383937863_da202b8122cacc4a214fbfb62d79b66c_rle_crop_3959753640_0.png resize: (118, 92) 1383960609 -1.2875963417183003 treat image : temp/1758039628_3370944_1383937861_c4735f5423aff62eed61f167b775a733_rle_crop_3959753642_0.png resize: (110, 94) 1383960610 -0.2623958023417769 treat image : temp/1758039628_3370944_1383937855_982cd709ebdc4767976b303589887ff0_rle_crop_3959753649_0.png resize: (155, 101) 1383960611 0.5775612624214794 treat image : temp/1758039628_3370944_1383937834_f4981aeb5de7c06f5c1a68867a11dc0c_rle_crop_3959753654_0.png resize: (140, 98) 1383960612 -0.4783199043098138 treat image : temp/1758039628_3370944_1383937834_f4981aeb5de7c06f5c1a68867a11dc0c_rle_crop_3959753660_0.png resize: (115, 84) 1383960613 2.3002542876854974 treat image : temp/1758039628_3370944_1383937831_06f7bf912518636410da24eed5b117bf_rle_crop_3959753663_0.png resize: (122, 103) 1383960614 0.20761744066703966 treat image : temp/1758039628_3370944_1383937827_85630d0399cd527df1c483b53f0fa554_rle_crop_3959753666_0.png resize: (175, 111) 1383960615 -1.528986629881075 treat image : temp/1758039628_3370944_1383937784_aedbdf1fc1fb4cb27d1dce63d9d5d223_rle_crop_3959753674_0.png resize: (174, 106) 1383960616 -0.9098283722479258 treat image : temp/1758039628_3370944_1383937689_69b02b85e842a1323b5ce3638de312a2_rle_crop_3959753677_0.png resize: (157, 114) 1383960617 -0.7072115570003962 treat image : temp/1758039628_3370944_1383937687_255aa1891e4a72ee82663d840a062e3a_rle_crop_3959753680_0.png resize: (178, 208) 1383960618 -1.4989489379669108 treat image : temp/1758039628_3370944_1383937997_3d13c50103a0842393c4620f8c6b6efc_rle_crop_3959753622_0.png resize: (238, 167) 1383960631 -1.6177455310773996 treat image : temp/1758039628_3370944_1383937994_0b653ca7408c043bd5da282efe1d41e7_rle_crop_3959753624_0.png resize: (54, 51) 1383960632 -3.9245966153131677 treat image : temp/1758039628_3370944_1383937994_0b653ca7408c043bd5da282efe1d41e7_rle_crop_3959753625_0.png resize: (172, 142) 1383960633 -2.2009303425861413 treat image : temp/1758039628_3370944_1383937994_0b653ca7408c043bd5da282efe1d41e7_rle_crop_3959753626_0.png resize: (91, 110) 1383960634 -3.6603595282403063 treat image : temp/1758039628_3370944_1383937954_5a12aac56ec9ccaa002e500c35de5f1d_rle_crop_3959753627_0.png resize: (547, 345) 1383960635 -0.6445844683292764 treat image : temp/1758039628_3370944_1383937952_b0ef7eadff24ce8495d82b3a8ccf775c_rle_crop_3959753629_0.png resize: (501, 385) 1383960636 -0.40370927402098855 treat image : temp/1758039628_3370944_1383937924_1efbf02938b17c3851f6268df7c1db98_rle_crop_3959753630_0.png resize: (218, 148) 1383960637 -2.748479845234764 treat image : temp/1758039628_3370944_1383937920_2fc0156b5bf43f88cb97bb2fd02a8d8a_rle_crop_3959753635_0.png resize: (537, 376) 1383960638 0.6811972720042166 treat image : temp/1758039628_3370944_1383937920_2fc0156b5bf43f88cb97bb2fd02a8d8a_rle_crop_3959753636_0.png resize: (922, 1493) 1383960639 -2.824849715409462 treat image : temp/1758039628_3370944_1383937863_da202b8122cacc4a214fbfb62d79b66c_rle_crop_3959753641_0.png resize: (81, 97) 1383960640 -4.238864623511739 treat image : temp/1758039628_3370944_1383937861_c4735f5423aff62eed61f167b775a733_rle_crop_3959753643_0.png resize: (500, 366) 1383960641 -0.7533003740053739 treat image : temp/1758039628_3370944_1383937857_01e5f419404fed85e72a2557b16f5331_rle_crop_3959753645_0.png resize: (559, 370) 1383960642 -0.03505816621255628 treat image : temp/1758039628_3370944_1383937857_01e5f419404fed85e72a2557b16f5331_rle_crop_3959753646_0.png resize: (53, 82) 1383960643 -0.3181799959453577 treat image : temp/1758039628_3370944_1383937855_982cd709ebdc4767976b303589887ff0_rle_crop_3959753650_0.png resize: (484, 342) 1383960644 -0.6420437137008863 treat image : temp/1758039628_3370944_1383937851_4b2562b185b8ee602782c8a30eb41b4d_rle_crop_3959753651_0.png resize: (507, 346) 1383960645 -0.9086071486998508 treat image : temp/1758039628_3370944_1383937848_73ff5450d51f2eb5623ed2644149b5f9_rle_crop_3959753652_0.png resize: (104, 181) 1383960646 -1.542915310061107 treat image : temp/1758039628_3370944_1383937848_73ff5450d51f2eb5623ed2644149b5f9_rle_crop_3959753653_0.png resize: (487, 352) 1383960647 -1.24141025668347 treat image : temp/1758039628_3370944_1383937834_f4981aeb5de7c06f5c1a68867a11dc0c_rle_crop_3959753657_0.png resize: (145, 72) 1383960648 -0.1288670494669383 treat image : temp/1758039628_3370944_1383937834_f4981aeb5de7c06f5c1a68867a11dc0c_rle_crop_3959753659_0.png resize: (544, 351) 1383960649 0.32961606827672735 treat image : temp/1758039628_3370944_1383937833_2e8c829a00f9c3d66cbddf5206d3fe62_rle_crop_3959753661_0.png resize: (234, 183) 1383960650 -1.9860767322444426 treat image : temp/1758039628_3370944_1383937833_2e8c829a00f9c3d66cbddf5206d3fe62_rle_crop_3959753662_0.png resize: (547, 349) 1383960651 0.572649033486697 treat image : temp/1758039628_3370944_1383937831_06f7bf912518636410da24eed5b117bf_rle_crop_3959753664_0.png resize: (546, 390) 1383960652 -0.21713449532073545 treat image : temp/1758039628_3370944_1383937827_85630d0399cd527df1c483b53f0fa554_rle_crop_3959753665_0.png resize: (526, 375) 1383960653 0.2708979577480408 treat image : temp/1758039628_3370944_1383937827_85630d0399cd527df1c483b53f0fa554_rle_crop_3959753667_0.png resize: (861, 1659) 1383960654 -1.2024589961282124 treat image : temp/1758039628_3370944_1383937825_01e695d02825b45c17efe11604a92977_rle_crop_3959753669_0.png resize: (571, 314) 1383960655 -1.8393987264565668 treat image : temp/1758039628_3370944_1383937818_079c5fa03dd6ae8afaf18241cccb84b6_rle_crop_3959753670_0.png resize: (214, 164) 1383960656 -1.832992944823359 treat image : temp/1758039628_3370944_1383937797_2f314c053695766aa77e6c1e03b27662_rle_crop_3959753672_0.png resize: (516, 345) 1383960657 -0.6699978377929602 treat image : temp/1758039628_3370944_1383937784_aedbdf1fc1fb4cb27d1dce63d9d5d223_rle_crop_3959753673_0.png resize: (1006, 1123) 1383960658 -4.382674443125691 treat image : temp/1758039628_3370944_1383937773_c437480d47fab97e23965286b44c63b6_rle_crop_3959753675_0.png resize: (130, 147) 1383960659 -2.3547486344119233 treat image : temp/1758039628_3370944_1383937689_69b02b85e842a1323b5ce3638de312a2_rle_crop_3959753678_0.png resize: (119, 100) 1383960660 -3.0840661267427576 treat image : temp/1758039628_3370944_1383937687_255aa1891e4a72ee82663d840a062e3a_rle_crop_3959753679_0.png resize: (503, 338) 1383960661 0.3447100809311228 treat image : temp/1758039628_3370944_1383937687_255aa1891e4a72ee82663d840a062e3a_rle_crop_3959753681_0.png resize: (167, 216) 1383960662 -3.784326873630122 treat image : temp/1758039628_3370944_1383937857_01e5f419404fed85e72a2557b16f5331_rle_crop_3959753647_0.png resize: (98, 98) 1383960663 -1.0846744229245233 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 95 time used for this insertion : 0.016749143600463867 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 95 time used for this insertion : 0.01665210723876953 save missing photos in datou_result : time spend for datou_step_exec : 28.836227893829346 time spend to save output : 0.03801155090332031 total time spend for step 6 : 28.874239444732666 step7:brightness Tue Sep 16 18:22:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1758039628_3370944_1383938001_f2d55f5d3be4338e55cc2c350b5ffe95.jpg treat image : temp/1758039628_3370944_1383937999_36dddd745b6cb24254b28e3ef5e41a1c.jpg treat image : temp/1758039628_3370944_1383937997_3d13c50103a0842393c4620f8c6b6efc.jpg treat image : temp/1758039628_3370944_1383937994_0b653ca7408c043bd5da282efe1d41e7.jpg treat image : temp/1758039628_3370944_1383937954_5a12aac56ec9ccaa002e500c35de5f1d.jpg treat image : temp/1758039628_3370944_1383937952_b0ef7eadff24ce8495d82b3a8ccf775c.jpg treat image : temp/1758039628_3370944_1383937950_36ed37e25416bbda52a894b02103532f.jpg treat image : temp/1758039628_3370944_1383937946_58817a248127e4b3d61e82f5c03f6016.jpg treat image : temp/1758039628_3370944_1383937925_ae9d149dcf42d9fbc45c0d57b86b4407.jpg treat image : temp/1758039628_3370944_1383937924_1efbf02938b17c3851f6268df7c1db98.jpg treat image : temp/1758039628_3370944_1383937922_f1f476cf7ec7727477ac99a11036191e.jpg treat image : temp/1758039628_3370944_1383937921_1ddb06950f7dbe0ac744a3a32ccabe32.jpg treat image : temp/1758039628_3370944_1383937920_2fc0156b5bf43f88cb97bb2fd02a8d8a.jpg treat image : temp/1758039628_3370944_1383937919_951438ee56d91f5d1e400d3cd7ce2e87.jpg treat image : temp/1758039628_3370944_1383937863_da202b8122cacc4a214fbfb62d79b66c.jpg treat image : temp/1758039628_3370944_1383937861_c4735f5423aff62eed61f167b775a733.jpg treat image : temp/1758039628_3370944_1383937857_01e5f419404fed85e72a2557b16f5331.jpg treat image : temp/1758039628_3370944_1383937855_982cd709ebdc4767976b303589887ff0.jpg treat image : temp/1758039628_3370944_1383937851_4b2562b185b8ee602782c8a30eb41b4d.jpg treat image : temp/1758039628_3370944_1383937848_73ff5450d51f2eb5623ed2644149b5f9.jpg treat image : temp/1758039628_3370944_1383937834_f4981aeb5de7c06f5c1a68867a11dc0c.jpg treat image : temp/1758039628_3370944_1383937833_2e8c829a00f9c3d66cbddf5206d3fe62.jpg treat image : temp/1758039628_3370944_1383937831_06f7bf912518636410da24eed5b117bf.jpg treat image : temp/1758039628_3370944_1383937827_85630d0399cd527df1c483b53f0fa554.jpg treat image : temp/1758039628_3370944_1383937825_01e695d02825b45c17efe11604a92977.jpg treat image : temp/1758039628_3370944_1383937818_079c5fa03dd6ae8afaf18241cccb84b6.jpg treat image : temp/1758039628_3370944_1383937809_04b2ddc726a6fead0317ae46acb9bb56.jpg treat image : temp/1758039628_3370944_1383937797_2f314c053695766aa77e6c1e03b27662.jpg treat image : temp/1758039628_3370944_1383937784_aedbdf1fc1fb4cb27d1dce63d9d5d223.jpg treat image : temp/1758039628_3370944_1383937773_c437480d47fab97e23965286b44c63b6.jpg treat image : temp/1758039628_3370944_1383937755_eab635a08472ae66fe97cc8607031e6c.jpg treat image : temp/1758039628_3370944_1383937692_0853dfdab33aba730f8a1448a6618ee9.jpg treat image : temp/1758039628_3370944_1383937689_69b02b85e842a1323b5ce3638de312a2.jpg treat image : temp/1758039628_3370944_1383937687_255aa1891e4a72ee82663d840a062e3a.jpg treat image : temp/1758039628_3370944_1383938001_f2d55f5d3be4338e55cc2c350b5ffe95_rle_crop_3959753621_0.png treat image : temp/1758039628_3370944_1383937994_0b653ca7408c043bd5da282efe1d41e7_rle_crop_3959753623_0.png treat image : temp/1758039628_3370944_1383937921_1ddb06950f7dbe0ac744a3a32ccabe32_rle_crop_3959753631_0.png treat image : temp/1758039628_3370944_1383937920_2fc0156b5bf43f88cb97bb2fd02a8d8a_rle_crop_3959753634_0.png treat image : temp/1758039628_3370944_1383937919_951438ee56d91f5d1e400d3cd7ce2e87_rle_crop_3959753637_0.png treat image : temp/1758039628_3370944_1383937919_951438ee56d91f5d1e400d3cd7ce2e87_rle_crop_3959753639_0.png treat image : temp/1758039628_3370944_1383937861_c4735f5423aff62eed61f167b775a733_rle_crop_3959753644_0.png treat image : temp/1758039628_3370944_1383937857_01e5f419404fed85e72a2557b16f5331_rle_crop_3959753648_0.png treat image : temp/1758039628_3370944_1383937834_f4981aeb5de7c06f5c1a68867a11dc0c_rle_crop_3959753655_0.png treat image : temp/1758039628_3370944_1383937834_f4981aeb5de7c06f5c1a68867a11dc0c_rle_crop_3959753656_0.png treat image : temp/1758039628_3370944_1383937834_f4981aeb5de7c06f5c1a68867a11dc0c_rle_crop_3959753658_0.png treat image : temp/1758039628_3370944_1383937825_01e695d02825b45c17efe11604a92977_rle_crop_3959753668_0.png treat image : temp/1758039628_3370944_1383937809_04b2ddc726a6fead0317ae46acb9bb56_rle_crop_3959753671_0.png treat image : temp/1758039628_3370944_1383937755_eab635a08472ae66fe97cc8607031e6c_rle_crop_3959753676_0.png treat image : temp/1758039628_3370944_1383937952_b0ef7eadff24ce8495d82b3a8ccf775c_rle_crop_3959753628_0.png treat image : temp/1758039628_3370944_1383937921_1ddb06950f7dbe0ac744a3a32ccabe32_rle_crop_3959753632_0.png treat image : temp/1758039628_3370944_1383937920_2fc0156b5bf43f88cb97bb2fd02a8d8a_rle_crop_3959753633_0.png treat image : temp/1758039628_3370944_1383937919_951438ee56d91f5d1e400d3cd7ce2e87_rle_crop_3959753638_0.png treat image : temp/1758039628_3370944_1383937863_da202b8122cacc4a214fbfb62d79b66c_rle_crop_3959753640_0.png treat image : temp/1758039628_3370944_1383937861_c4735f5423aff62eed61f167b775a733_rle_crop_3959753642_0.png treat image : temp/1758039628_3370944_1383937855_982cd709ebdc4767976b303589887ff0_rle_crop_3959753649_0.png treat image : temp/1758039628_3370944_1383937834_f4981aeb5de7c06f5c1a68867a11dc0c_rle_crop_3959753654_0.png treat image : temp/1758039628_3370944_1383937834_f4981aeb5de7c06f5c1a68867a11dc0c_rle_crop_3959753660_0.png treat image : temp/1758039628_3370944_1383937831_06f7bf912518636410da24eed5b117bf_rle_crop_3959753663_0.png treat image : temp/1758039628_3370944_1383937827_85630d0399cd527df1c483b53f0fa554_rle_crop_3959753666_0.png treat image : temp/1758039628_3370944_1383937784_aedbdf1fc1fb4cb27d1dce63d9d5d223_rle_crop_3959753674_0.png treat image : temp/1758039628_3370944_1383937689_69b02b85e842a1323b5ce3638de312a2_rle_crop_3959753677_0.png treat image : temp/1758039628_3370944_1383937687_255aa1891e4a72ee82663d840a062e3a_rle_crop_3959753680_0.png treat image : temp/1758039628_3370944_1383937997_3d13c50103a0842393c4620f8c6b6efc_rle_crop_3959753622_0.png treat image : temp/1758039628_3370944_1383937994_0b653ca7408c043bd5da282efe1d41e7_rle_crop_3959753624_0.png treat image : temp/1758039628_3370944_1383937994_0b653ca7408c043bd5da282efe1d41e7_rle_crop_3959753625_0.png treat image : temp/1758039628_3370944_1383937994_0b653ca7408c043bd5da282efe1d41e7_rle_crop_3959753626_0.png treat image : temp/1758039628_3370944_1383937954_5a12aac56ec9ccaa002e500c35de5f1d_rle_crop_3959753627_0.png treat image : temp/1758039628_3370944_1383937952_b0ef7eadff24ce8495d82b3a8ccf775c_rle_crop_3959753629_0.png treat image : temp/1758039628_3370944_1383937924_1efbf02938b17c3851f6268df7c1db98_rle_crop_3959753630_0.png treat image : temp/1758039628_3370944_1383937920_2fc0156b5bf43f88cb97bb2fd02a8d8a_rle_crop_3959753635_0.png treat image : temp/1758039628_3370944_1383937920_2fc0156b5bf43f88cb97bb2fd02a8d8a_rle_crop_3959753636_0.png treat image : temp/1758039628_3370944_1383937863_da202b8122cacc4a214fbfb62d79b66c_rle_crop_3959753641_0.png treat image : temp/1758039628_3370944_1383937861_c4735f5423aff62eed61f167b775a733_rle_crop_3959753643_0.png treat image : temp/1758039628_3370944_1383937857_01e5f419404fed85e72a2557b16f5331_rle_crop_3959753645_0.png treat image : temp/1758039628_3370944_1383937857_01e5f419404fed85e72a2557b16f5331_rle_crop_3959753646_0.png treat image : temp/1758039628_3370944_1383937855_982cd709ebdc4767976b303589887ff0_rle_crop_3959753650_0.png treat image : temp/1758039628_3370944_1383937851_4b2562b185b8ee602782c8a30eb41b4d_rle_crop_3959753651_0.png treat image : temp/1758039628_3370944_1383937848_73ff5450d51f2eb5623ed2644149b5f9_rle_crop_3959753652_0.png treat image : temp/1758039628_3370944_1383937848_73ff5450d51f2eb5623ed2644149b5f9_rle_crop_3959753653_0.png treat image : temp/1758039628_3370944_1383937834_f4981aeb5de7c06f5c1a68867a11dc0c_rle_crop_3959753657_0.png treat image : temp/1758039628_3370944_1383937834_f4981aeb5de7c06f5c1a68867a11dc0c_rle_crop_3959753659_0.png treat image : temp/1758039628_3370944_1383937833_2e8c829a00f9c3d66cbddf5206d3fe62_rle_crop_3959753661_0.png treat image : temp/1758039628_3370944_1383937833_2e8c829a00f9c3d66cbddf5206d3fe62_rle_crop_3959753662_0.png treat image : temp/1758039628_3370944_1383937831_06f7bf912518636410da24eed5b117bf_rle_crop_3959753664_0.png treat image : temp/1758039628_3370944_1383937827_85630d0399cd527df1c483b53f0fa554_rle_crop_3959753665_0.png treat image : temp/1758039628_3370944_1383937827_85630d0399cd527df1c483b53f0fa554_rle_crop_3959753667_0.png treat image : temp/1758039628_3370944_1383937825_01e695d02825b45c17efe11604a92977_rle_crop_3959753669_0.png treat image : temp/1758039628_3370944_1383937818_079c5fa03dd6ae8afaf18241cccb84b6_rle_crop_3959753670_0.png treat image : temp/1758039628_3370944_1383937797_2f314c053695766aa77e6c1e03b27662_rle_crop_3959753672_0.png treat image : temp/1758039628_3370944_1383937784_aedbdf1fc1fb4cb27d1dce63d9d5d223_rle_crop_3959753673_0.png treat image : temp/1758039628_3370944_1383937773_c437480d47fab97e23965286b44c63b6_rle_crop_3959753675_0.png treat image : temp/1758039628_3370944_1383937689_69b02b85e842a1323b5ce3638de312a2_rle_crop_3959753678_0.png treat image : temp/1758039628_3370944_1383937687_255aa1891e4a72ee82663d840a062e3a_rle_crop_3959753679_0.png treat image : temp/1758039628_3370944_1383937687_255aa1891e4a72ee82663d840a062e3a_rle_crop_3959753681_0.png treat image : temp/1758039628_3370944_1383937857_01e5f419404fed85e72a2557b16f5331_rle_crop_3959753647_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 95 time used for this insertion : 0.014818191528320312 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 95 time used for this insertion : 0.015938997268676758 save missing photos in datou_result : time spend for datou_step_exec : 8.048682451248169 time spend to save output : 0.03529930114746094 total time spend for step 7 : 8.08398175239563 step8:velours_tree Tue Sep 16 18:22:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09144878387451172 time spend to save output : 3.4809112548828125e-05 total time spend for step 8 : 0.09148359298706055 step9:send_mail_cod Tue Sep 16 18:22:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26902187_16-09-2025_18_22_54.pdf 26903360 change filename to text .imagette269033601758039774 26903361 imagette269033611758039774 26903362 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette269033621758039774 26903363 imagette269033631758039774 26903364 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette269033641758039774 26903365 imagette269033651758039775 26903366 imagette269033661758039775 26903367 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette269033671758039775 26903368 imagette269033681758039777 26903369 imagette269033691758039777 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26902187 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26903359,26903360,26903361,26903362,26903363,26903364,26903365,26903366,26903367,26903368,26903369?tags=environnement,autre,mal_croppe,carton,background,papier,pet_fonce,flou,pet_clair,metal,pehd args[1383938001] : ((1383938001, -1.571702335256608, 492688767), (1383938001, 0.7447693006661094, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937999] : ((1383937999, -2.304024964884308, 492609224), (1383937999, 0.6369955639133392, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937997] : ((1383937997, -1.7951127141455787, 492688767), (1383937997, 0.634566433907392, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937994] : ((1383937994, -2.1989768260189932, 492609224), (1383937994, 0.5707493193091788, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937954] : ((1383937954, -2.56498405309684, 492609224), (1383937954, 0.2903688610010157, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937952] : ((1383937952, -2.6977782221779356, 492609224), (1383937952, 0.30504580356965355, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937950] : ((1383937950, -2.4189932226341115, 492609224), (1383937950, 0.6037344542106873, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937946] : ((1383937946, -2.3811960839514863, 492609224), (1383937946, 0.5416461351562452, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937925] : ((1383937925, 0.5337169209156096, 492688767), (1383937925, 0.7993831969902374, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937924] : ((1383937924, -2.493162215845162, 492609224), (1383937924, 0.5554519470586151, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937922] : ((1383937922, -2.1112945778871106, 492609224), (1383937922, 0.5249829110086044, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937921] : ((1383937921, -1.9201380280333626, 492688767), (1383937921, 0.6608069604609895, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937920] : ((1383937920, -2.9821410734404803, 492609224), (1383937920, 0.4197142044183485, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937919] : ((1383937919, -4.710761856457114, 492609224), (1383937919, 0.4518363832090617, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937863] : ((1383937863, -2.5746992223483613, 492609224), (1383937863, 0.5700631391069426, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937861] : ((1383937861, -2.7675883430206154, 492609224), (1383937861, 0.5004727493264624, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937857] : ((1383937857, -0.7518085734851087, 492688767), (1383937857, 0.5436959425916925, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937855] : ((1383937855, -2.2766778734450335, 492609224), (1383937855, 0.5417397193981004, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937851] : ((1383937851, -1.7229648391284726, 492688767), (1383937851, 0.6521625663355554, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937848] : ((1383937848, -2.7185397562892826, 492609224), (1383937848, 0.554159080102964, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937834] : ((1383937834, -2.6800150062834964, 492609224), (1383937834, 0.38170042609604055, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937833] : ((1383937833, -2.1203689378765045, 492609224), (1383937833, 0.4778169122959394, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937831] : ((1383937831, -4.535732658950807, 492609224), (1383937831, 0.3408200112212914, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937827] : ((1383937827, -3.1135266287889003, 492609224), (1383937827, 0.2673985209468216, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937825] : ((1383937825, -1.6794911431452593, 492688767), (1383937825, 0.6311250554478719, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937818] : ((1383937818, -1.4208738912737502, 492688767), (1383937818, 0.5641924853343784, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937809] : ((1383937809, -2.6339540358229967, 492609224), (1383937809, 0.5550081203346495, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937797] : ((1383937797, -2.710395887400717, 492609224), (1383937797, 0.4961408250447836, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937784] : ((1383937784, -3.847122143199717, 492609224), (1383937784, 0.3048282328274002, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937773] : ((1383937773, -0.0944079009752769, 492688767), (1383937773, 0.5347545182614327, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937755] : ((1383937755, -2.515723805164391, 492609224), (1383937755, 0.4425204628026625, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937692] : ((1383937692, -2.2734718227913207, 492609224), (1383937692, 0.6568465978104856, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937689] : ((1383937689, -1.4627973715609928, 492688767), (1383937689, 0.45026875286417123, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com args[1383937687] : ((1383937687, -2.8477820783964742, 492609224), (1383937687, 0.511971239775654, 2107752395), '0.07382847959785767') We are sending mail with results at report@fotonower.com refus_total : 0.07382847959785767 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26902187 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26902187_16-09-2025_18_22_54.pdf results_Auto_P26902187_16-09-2025_18_22_54.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26902187_16-09-2025_18_22_54.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26902187','results_Auto_P26902187_16-09-2025_18_22_54.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26902187_16-09-2025_18_22_54.pdf','pdf','','0.6','0.07382847959785767') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26902187

https://www.fotonower.com/image?json=false&list_photos_id=1383938001
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937999
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937997
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937994
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937954
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937952
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937950
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937946
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937925
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937924
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937922
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937921
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937920
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937919
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937863
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937861
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937857
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937855
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937851
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937848
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937834
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937833
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937831
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937827
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937825
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937818
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937809
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937797
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937784
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937773
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937755
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937692
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937689
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383937687
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 7.38%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/26903360?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26903362?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26903364?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26903367?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26902187_16-09-2025_18_22_54.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26903359,26903360,26903361,26903362,26903363,26903364,26903365,26903366,26903367,26903368,26903369?tags=environnement,autre,mal_croppe,carton,background,papier,pet_fonce,flou,pet_clair,metal,pehd.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 16 Sep 2025 16:23:00 GMT Content-Length: 0 Connection: close X-Message-Id: f3Yj_uvYR2aNSlHmaceCRw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1383938001, 1383937999, 1383937997, 1383937994, 1383937954, 1383937952, 1383937950, 1383937946, 1383937925, 1383937924, 1383937922, 1383937921, 1383937920, 1383937919, 1383937863, 1383937861, 1383937857, 1383937855, 1383937851, 1383937848, 1383937834, 1383937833, 1383937831, 1383937827, 1383937825, 1383937818, 1383937809, 1383937797, 1383937784, 1383937773, 1383937755, 1383937692, 1383937689, 1383937687] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383938001', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937999', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937997', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937994', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937954', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937952', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937950', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937946', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937925', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937924', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937922', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937921', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937920', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937919', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937863', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937861', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937857', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937855', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937851', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937848', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937834', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937833', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937831', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937827', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937825', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937818', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937809', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937797', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937784', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937773', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937755', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937692', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937689', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937687', None, None, None, None, None, '3729393') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 34 time used for this insertion : 0.0179290771484375 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.223930358886719 time spend to save output : 0.018310070037841797 total time spend for step 9 : 6.2422404289245605 step10:split_time_score Tue Sep 16 18:23:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 34),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 16092025 26902187 Nombre de photos uploadées : 34 / 23040 (0%) 16092025 26902187 Nombre de photos taguées (types de déchets): 0 / 34 (0%) 16092025 26902187 Nombre de photos taguées (volume) : 0 / 34 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.7220458984375e-06 ?????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.001567840576171875 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2052004337310791 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.1122128041031227 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26882766_16-09-2025_09_52_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26882766 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26882766 AND mptpi.`type`=3594 To do Qualite : 0.1705833654835391 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26882768_16-09-2025_09_41_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26882768 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26882768 AND mptpi.`type`=3594 To do Qualite : 0.05712583188657407 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26882771_16-09-2025_10_31_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26882771 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26882771 AND mptpi.`type`=3594 To do Qualite : 0.0553948408253684 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26882772_16-09-2025_10_53_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26882772 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26882772 AND mptpi.`type`=3594 To do Qualite : 0.03425365770417854 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26891609_16-09-2025_15_22_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26891609 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26891609 AND mptpi.`type`=3594 To do Qualite : 0.07995926568930034 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26891611_16-09-2025_13_53_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26891611 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26891611 AND mptpi.`type`=3594 To do Qualite : 0.09510918209876545 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26888808_16-09-2025_11_41_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26888808 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26888808 AND mptpi.`type`=3594 To do Qualite : 0.1363156741021324 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26890190_16-09-2025_12_31_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26890190 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26890190 AND mptpi.`type`=3594 To do Qualite : 0.06626128127755732 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26890528_16-09-2025_12_42_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26890528 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26890528 AND mptpi.`type`=3594 To do Qualite : 0.2100799961419753 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26891614_16-09-2025_13_33_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26891614 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26891614 AND mptpi.`type`=3594 To do Qualite : 0.09143330693632225 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26894974_16-09-2025_15_12_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26894974 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26894974 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26902185 order by id desc limit 1 Qualite : 0.07382847959785767 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26902187_16-09-2025_18_22_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26902187 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26902187 AND mptpi.`type`=3594 To do Qualite : 0.049925557659932666 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26902189_16-09-2025_18_11_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26902189 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26902189 AND mptpi.`type`=3594 To do Qualite : 0.14204439139660488 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26902191_16-09-2025_18_01_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26902191 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26902191 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'16092025': {'nb_upload': 34, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1383938001, 1383937999, 1383937997, 1383937994, 1383937954, 1383937952, 1383937950, 1383937946, 1383937925, 1383937924, 1383937922, 1383937921, 1383937920, 1383937919, 1383937863, 1383937861, 1383937857, 1383937855, 1383937851, 1383937848, 1383937834, 1383937833, 1383937831, 1383937827, 1383937825, 1383937818, 1383937809, 1383937797, 1383937784, 1383937773, 1383937755, 1383937692, 1383937689, 1383937687] Looping around the photos to save general results len do output : 1 /26902187Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383938001', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937999', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937997', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937994', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937954', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937952', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937950', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937946', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937925', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937924', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937922', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937921', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937920', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937919', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937863', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937861', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937857', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937855', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937851', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937848', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937834', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937833', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937831', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937827', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937825', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937818', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937809', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937797', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937784', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937773', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937755', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937692', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937689', None, None, None, None, None, '3729393') ('3318', None, None, None, None, None, None, None, '3729393') ('3318', '26902187', '1383937687', None, None, None, None, None, '3729393') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 35 time used for this insertion : 0.017751693725585938 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.201414108276367 time spend to save output : 0.018152713775634766 total time spend for step 10 : 2.219566822052002 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 34 set_done_treatment 95.98user 37.91system 2:37.76elapsed 84%CPU (0avgtext+0avgdata 3080076maxresident)k 582728inputs+52648outputs (6294major+2704511minor)pagefaults 0swaps