python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1011055 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3759467'] with mtr_portfolio_ids : ['27099650'] and first list_photo_ids : [] new path : /proc/1011055/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 27 ; length of list_pids : 27 ; length of list_args : 27 time to download the photos : 3.8556697368621826 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Sep 22 17:40:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10586 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-22 17:40:34.208925: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-22 17:40:34.216917: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-22 17:40:34.218323: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f08e0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-22 17:40:34.218372: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-22 17:40:34.220938: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-22 17:40:34.327043: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xdf61c30 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-22 17:40:34.327090: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-22 17:40:34.328491: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-22 17:40:34.328889: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-22 17:40:34.331930: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-22 17:40:34.334949: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-22 17:40:34.335471: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-22 17:40:34.338651: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-22 17:40:34.339978: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-22 17:40:34.345298: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-22 17:40:34.347094: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-22 17:40:34.347180: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-22 17:40:34.348116: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-22 17:40:34.348135: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-22 17:40:34.348146: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-22 17:40:34.349745: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9661 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-22 17:40:34.646244: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-22 17:40:34.646332: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-22 17:40:34.646353: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-22 17:40:34.646371: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-22 17:40:34.646388: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-22 17:40:34.646406: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-22 17:40:34.646422: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-22 17:40:34.646440: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-22 17:40:34.647999: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-22 17:40:34.649412: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-22 17:40:34.649465: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-22 17:40:34.649485: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-22 17:40:34.649501: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-22 17:40:34.649518: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-22 17:40:34.649534: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-22 17:40:34.649550: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-22 17:40:34.649567: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-22 17:40:34.651104: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-22 17:40:34.651135: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-22 17:40:34.651146: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-22 17:40:34.651155: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-22 17:40:34.652796: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9661 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-22 17:40:43.456964: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-22 17:40:43.831049: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 27 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 Detection mask done ! Trying to reset tf kernel 1011795 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 324 tf kernel not reseted sub process len(results) : 27 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 27 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5613 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.003529071807861328 nb_pixel_total : 111077 time to create 1 rle with old method : 0.16206073760986328 length of segment : 538 time for calcul the mask position with numpy : 0.000308990478515625 nb_pixel_total : 12390 time to create 1 rle with old method : 0.015198707580566406 length of segment : 173 time for calcul the mask position with numpy : 0.0002465248107910156 nb_pixel_total : 11927 time to create 1 rle with old method : 0.014696121215820312 length of segment : 144 time for calcul the mask position with numpy : 0.0003521442413330078 nb_pixel_total : 13498 time to create 1 rle with old method : 0.01652693748474121 length of segment : 185 time for calcul the mask position with numpy : 0.002774477005004883 nb_pixel_total : 158226 time to create 1 rle with new method : 0.009259700775146484 length of segment : 502 time for calcul the mask position with numpy : 0.0001888275146484375 nb_pixel_total : 7401 time to create 1 rle with old method : 0.009121894836425781 length of segment : 95 time for calcul the mask position with numpy : 0.0004124641418457031 nb_pixel_total : 8598 time to create 1 rle with old method : 0.013855457305908203 length of segment : 169 time for calcul the mask position with numpy : 0.0003390312194824219 nb_pixel_total : 13274 time to create 1 rle with old method : 0.01610112190246582 length of segment : 188 time for calcul the mask position with numpy : 0.0018024444580078125 nb_pixel_total : 102320 time to create 1 rle with old method : 0.12277507781982422 length of segment : 560 time for calcul the mask position with numpy : 0.0003135204315185547 nb_pixel_total : 15615 time to create 1 rle with old method : 0.01882171630859375 length of segment : 199 time for calcul the mask position with numpy : 0.0006356239318847656 nb_pixel_total : 23173 time to create 1 rle with old method : 0.02765631675720215 length of segment : 289 time for calcul the mask position with numpy : 0.00011992454528808594 nb_pixel_total : 1776 time to create 1 rle with old method : 0.0022962093353271484 length of segment : 39 time for calcul the mask position with numpy : 0.0004336833953857422 nb_pixel_total : 13638 time to create 1 rle with old method : 0.016464710235595703 length of segment : 183 time for calcul the mask position with numpy : 0.00041937828063964844 nb_pixel_total : 13819 time to create 1 rle with old method : 0.019626855850219727 length of segment : 196 time for calcul the mask position with numpy : 0.00011014938354492188 nb_pixel_total : 2976 time to create 1 rle with old method : 0.003698110580444336 length of segment : 58 time for calcul the mask position with numpy : 0.0001571178436279297 nb_pixel_total : 5365 time to create 1 rle with old method : 0.006473541259765625 length of segment : 117 time for calcul the mask position with numpy : 0.00034546852111816406 nb_pixel_total : 13288 time to create 1 rle with old method : 0.015867233276367188 length of segment : 184 time for calcul the mask position with numpy : 0.00020313262939453125 nb_pixel_total : 10295 time to create 1 rle with old method : 0.012373208999633789 length of segment : 148 time for calcul the mask position with numpy : 0.001537322998046875 nb_pixel_total : 105790 time to create 1 rle with old method : 0.1269681453704834 length of segment : 517 time for calcul the mask position with numpy : 0.0001659393310546875 nb_pixel_total : 4849 time to create 1 rle with old method : 0.00603175163269043 length of segment : 101 time for calcul the mask position with numpy : 0.0004057884216308594 nb_pixel_total : 14111 time to create 1 rle with old method : 0.016993045806884766 length of segment : 198 time for calcul the mask position with numpy : 0.0003960132598876953 nb_pixel_total : 19356 time to create 1 rle with old method : 0.02332162857055664 length of segment : 224 time for calcul the mask position with numpy : 0.013368606567382812 nb_pixel_total : 790784 time to create 1 rle with new method : 0.056940317153930664 length of segment : 925 time for calcul the mask position with numpy : 0.0004107952117919922 nb_pixel_total : 13902 time to create 1 rle with old method : 0.016612768173217773 length of segment : 193 time for calcul the mask position with numpy : 0.00048661231994628906 nb_pixel_total : 14281 time to create 1 rle with old method : 0.01710796356201172 length of segment : 193 time for calcul the mask position with numpy : 0.00043511390686035156 nb_pixel_total : 18236 time to create 1 rle with old method : 0.02184295654296875 length of segment : 242 time for calcul the mask position with numpy : 0.0008759498596191406 nb_pixel_total : 28316 time to create 1 rle with old method : 0.035597801208496094 length of segment : 515 time for calcul the mask position with numpy : 0.0002989768981933594 nb_pixel_total : 7735 time to create 1 rle with old method : 0.009541034698486328 length of segment : 104 time for calcul the mask position with numpy : 0.0002377033233642578 nb_pixel_total : 6463 time to create 1 rle with old method : 0.008036375045776367 length of segment : 101 time for calcul the mask position with numpy : 0.0003287792205810547 nb_pixel_total : 13646 time to create 1 rle with old method : 0.016234874725341797 length of segment : 195 time for calcul the mask position with numpy : 0.0002722740173339844 nb_pixel_total : 5990 time to create 1 rle with old method : 0.007534980773925781 length of segment : 128 time for calcul the mask position with numpy : 0.00013303756713867188 nb_pixel_total : 3604 time to create 1 rle with old method : 0.004861116409301758 length of segment : 70 time for calcul the mask position with numpy : 0.00024318695068359375 nb_pixel_total : 6379 time to create 1 rle with old method : 0.00790715217590332 length of segment : 104 time for calcul the mask position with numpy : 0.00019407272338867188 nb_pixel_total : 5674 time to create 1 rle with old method : 0.007461071014404297 length of segment : 92 time for calcul the mask position with numpy : 0.0003528594970703125 nb_pixel_total : 13952 time to create 1 rle with old method : 0.01743292808532715 length of segment : 194 time for calcul the mask position with numpy : 0.0002675056457519531 nb_pixel_total : 7092 time to create 1 rle with old method : 0.008926868438720703 length of segment : 80 time for calcul the mask position with numpy : 0.0005078315734863281 nb_pixel_total : 14025 time to create 1 rle with old method : 0.024285078048706055 length of segment : 184 time for calcul the mask position with numpy : 0.0002789497375488281 nb_pixel_total : 10248 time to create 1 rle with old method : 0.019495725631713867 length of segment : 81 time for calcul the mask position with numpy : 0.0005064010620117188 nb_pixel_total : 23956 time to create 1 rle with old method : 0.036959171295166016 length of segment : 262 time for calcul the mask position with numpy : 0.000476837158203125 nb_pixel_total : 14085 time to create 1 rle with old method : 0.017071008682250977 length of segment : 197 time for calcul the mask position with numpy : 0.0004889965057373047 nb_pixel_total : 14229 time to create 1 rle with old method : 0.017938852310180664 length of segment : 195 time for calcul the mask position with numpy : 0.00015616416931152344 nb_pixel_total : 5704 time to create 1 rle with old method : 0.007841110229492188 length of segment : 62 time for calcul the mask position with numpy : 0.00015115737915039062 nb_pixel_total : 3008 time to create 1 rle with old method : 0.003811359405517578 length of segment : 59 time for calcul the mask position with numpy : 0.0004487037658691406 nb_pixel_total : 12910 time to create 1 rle with old method : 0.01555633544921875 length of segment : 183 time for calcul the mask position with numpy : 0.0012183189392089844 nb_pixel_total : 50412 time to create 1 rle with old method : 0.0804598331451416 length of segment : 249 time for calcul the mask position with numpy : 0.0004620552062988281 nb_pixel_total : 13107 time to create 1 rle with old method : 0.015689849853515625 length of segment : 185 time for calcul the mask position with numpy : 0.0004036426544189453 nb_pixel_total : 18495 time to create 1 rle with old method : 0.022380352020263672 length of segment : 115 time for calcul the mask position with numpy : 0.0001735687255859375 nb_pixel_total : 5715 time to create 1 rle with old method : 0.0074117183685302734 length of segment : 71 time for calcul the mask position with numpy : 0.0004093647003173828 nb_pixel_total : 12467 time to create 1 rle with old method : 0.014878511428833008 length of segment : 154 time for calcul the mask position with numpy : 0.00044274330139160156 nb_pixel_total : 12700 time to create 1 rle with old method : 0.015385866165161133 length of segment : 186 time for calcul the mask position with numpy : 0.0002753734588623047 nb_pixel_total : 5143 time to create 1 rle with old method : 0.006287574768066406 length of segment : 136 time for calcul the mask position with numpy : 0.0005359649658203125 nb_pixel_total : 16392 time to create 1 rle with old method : 0.019564390182495117 length of segment : 153 time for calcul the mask position with numpy : 0.0004980564117431641 nb_pixel_total : 13039 time to create 1 rle with old method : 0.015608549118041992 length of segment : 190 time for calcul the mask position with numpy : 0.0011069774627685547 nb_pixel_total : 38528 time to create 1 rle with old method : 0.04561471939086914 length of segment : 297 time for calcul the mask position with numpy : 0.0005104541778564453 nb_pixel_total : 14002 time to create 1 rle with old method : 0.016802310943603516 length of segment : 193 time for calcul the mask position with numpy : 0.01823568344116211 nb_pixel_total : 1356591 time to create 1 rle with new method : 0.18612360954284668 length of segment : 1300 time for calcul the mask position with numpy : 0.0004999637603759766 nb_pixel_total : 13632 time to create 1 rle with old method : 0.016565799713134766 length of segment : 190 time for calcul the mask position with numpy : 0.0003609657287597656 nb_pixel_total : 6357 time to create 1 rle with old method : 0.008151054382324219 length of segment : 106 time for calcul the mask position with numpy : 0.0005605220794677734 nb_pixel_total : 13254 time to create 1 rle with old method : 0.021399497985839844 length of segment : 185 time for calcul the mask position with numpy : 0.0009181499481201172 nb_pixel_total : 34478 time to create 1 rle with old method : 0.040639638900756836 length of segment : 302 time for calcul the mask position with numpy : 0.0005085468292236328 nb_pixel_total : 12829 time to create 1 rle with old method : 0.018571138381958008 length of segment : 186 time for calcul the mask position with numpy : 0.0004892349243164062 nb_pixel_total : 11592 time to create 1 rle with old method : 0.014257669448852539 length of segment : 140 time for calcul the mask position with numpy : 0.0001666545867919922 nb_pixel_total : 3682 time to create 1 rle with old method : 0.0047702789306640625 length of segment : 50 time for calcul the mask position with numpy : 0.0004589557647705078 nb_pixel_total : 13732 time to create 1 rle with old method : 0.016502857208251953 length of segment : 187 time for calcul the mask position with numpy : 0.0001475811004638672 nb_pixel_total : 2732 time to create 1 rle with old method : 0.003566265106201172 length of segment : 50 time for calcul the mask position with numpy : 0.002353191375732422 nb_pixel_total : 106125 time to create 1 rle with old method : 0.15968799591064453 length of segment : 551 time for calcul the mask position with numpy : 0.00046634674072265625 nb_pixel_total : 13024 time to create 1 rle with old method : 0.015601634979248047 length of segment : 183 time for calcul the mask position with numpy : 0.0011074542999267578 nb_pixel_total : 41793 time to create 1 rle with old method : 0.05193209648132324 length of segment : 159 time for calcul the mask position with numpy : 0.0004642009735107422 nb_pixel_total : 13386 time to create 1 rle with old method : 0.015909910202026367 length of segment : 185 time for calcul the mask position with numpy : 0.0006318092346191406 nb_pixel_total : 13656 time to create 1 rle with old method : 0.016757965087890625 length of segment : 195 time for calcul the mask position with numpy : 0.0005667209625244141 nb_pixel_total : 17228 time to create 1 rle with old method : 0.02829122543334961 length of segment : 180 time for calcul the mask position with numpy : 0.0005748271942138672 nb_pixel_total : 10632 time to create 1 rle with old method : 0.03462982177734375 length of segment : 143 time for calcul the mask position with numpy : 0.0007987022399902344 nb_pixel_total : 13087 time to create 1 rle with old method : 0.02763056755065918 length of segment : 186 time for calcul the mask position with numpy : 0.0008103847503662109 nb_pixel_total : 22370 time to create 1 rle with old method : 0.026416540145874023 length of segment : 324 time for calcul the mask position with numpy : 0.0001380443572998047 nb_pixel_total : 5370 time to create 1 rle with old method : 0.006697654724121094 length of segment : 58 time spent for convertir_results : 5.282847881317139 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 75 chid ids of type : 3594 Number RLEs to save : 16155 save missing photos in datou_result : time spend for datou_step_exec : 39.013415575027466 time spend to save output : 0.9683825969696045 total time spend for step 1 : 39.98179817199707 step2:crop_condition Mon Sep 22 17:41:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 27 ! batch 1 Loaded 75 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 38 About to insert : list_path_to_insert length 38 new photo from crops ! About to upload 38 photos upload in portfolio : 3736932 init cache_photo without model_param we have 38 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758555674_1011055 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 38 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.378143548965454 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758555685_1011055 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.13566517829895 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758555688_1011055 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8503687381744385 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 29 About to insert : list_path_to_insert length 29 new photo from crops ! About to upload 29 photos upload in portfolio : 3736932 init cache_photo without model_param we have 29 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758555702_1011055 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 29 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.715771198272705 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758555712_1011055 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.705456018447876 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1385489552, 1385489454, 1385489355, 1385489331, 1385489305, 1385489277, 1385489250, 1385489225, 1385488967, 1385488942, 1385488918, 1385488893, 1385488867, 1385488842, 1385488663, 1385488650, 1385488649, 1385488612, 1385488281, 1385488271, 1385488243, 1385488166, 1385488130, 1385488105, 1385487875, 1385487806, 1385487778] Looping around the photos to save general results len do output : 75 /1385492375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385492575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489552', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489454', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489355', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489331', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489305', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489277', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489250', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489225', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488967', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488942', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488918', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488893', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488867', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488842', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488663', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488650', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488649', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488612', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488281', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488271', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488243', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488166', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488130', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488105', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385487875', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385487806', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385487778', None, None, None, None, None, '3759467') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 252 time used for this insertion : 0.025363683700561523 save_final save missing photos in datou_result : time spend for datou_step_exec : 40.97967553138733 time spend to save output : 0.027916431427001953 total time spend for step 2 : 41.00759196281433 step3:rle_unique_nms_with_priority Mon Sep 22 17:41:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 75 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.3682222366333008 time for calcul the mask position with numpy : 0.08887457847595215 nb_pixel_total : 1950133 time to create 1 rle with new method : 0.2176663875579834 time for calcul the mask position with numpy : 0.00675201416015625 nb_pixel_total : 12390 time to create 1 rle with old method : 0.014368295669555664 time for calcul the mask position with numpy : 0.008320808410644531 nb_pixel_total : 111077 time to create 1 rle with old method : 0.12941479682922363 create new chi : 0.4758749008178711 time to delete rle : 0.0213015079498291 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2502 TO DO : save crop sub photo not yet done ! save time : 0.20067310333251953 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.23268985748291016 time for calcul the mask position with numpy : 0.06513571739196777 nb_pixel_total : 1882548 time to create 1 rle with new method : 0.2544283866882324 time for calcul the mask position with numpy : 0.010860681533813477 nb_pixel_total : 7401 time to create 1 rle with old method : 0.008954048156738281 time for calcul the mask position with numpy : 0.01243448257446289 nb_pixel_total : 158226 time to create 1 rle with new method : 0.10547089576721191 time for calcul the mask position with numpy : 0.006317853927612305 nb_pixel_total : 13498 time to create 1 rle with old method : 0.015887022018432617 time for calcul the mask position with numpy : 0.0064160823822021484 nb_pixel_total : 11927 time to create 1 rle with old method : 0.013846158981323242 create new chi : 0.5097637176513672 time to delete rle : 0.0005559921264648438 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2932 TO DO : save crop sub photo not yet done ! save time : 0.2118091583251953 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.14513874053955078 time for calcul the mask position with numpy : 0.16351890563964844 nb_pixel_total : 1910620 time to create 1 rle with new method : 0.10407662391662598 time for calcul the mask position with numpy : 0.006874799728393555 nb_pixel_total : 23173 time to create 1 rle with old method : 0.032236337661743164 time for calcul the mask position with numpy : 0.006256580352783203 nb_pixel_total : 15615 time to create 1 rle with old method : 0.01815962791442871 time for calcul the mask position with numpy : 0.00673985481262207 nb_pixel_total : 102320 time to create 1 rle with old method : 0.11841654777526855 time for calcul the mask position with numpy : 0.006167173385620117 nb_pixel_total : 13274 time to create 1 rle with old method : 0.015325784683227539 time for calcul the mask position with numpy : 0.006257534027099609 nb_pixel_total : 8598 time to create 1 rle with old method : 0.010059356689453125 create new chi : 0.506486177444458 time to delete rle : 0.0005810260772705078 batch 1 Loaded 11 chid ids of type : 3594 ++++++++++Number RLEs to save : 3890 TO DO : save crop sub photo not yet done ! save time : 0.2879056930541992 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.038945913314819336 time for calcul the mask position with numpy : 0.019513368606567383 nb_pixel_total : 2058186 time to create 1 rle with new method : 0.08828377723693848 time for calcul the mask position with numpy : 0.00619816780090332 nb_pixel_total : 13638 time to create 1 rle with old method : 0.01596379280090332 time for calcul the mask position with numpy : 0.0060117244720458984 nb_pixel_total : 1776 time to create 1 rle with old method : 0.0021233558654785156 create new chi : 0.14541292190551758 time to delete rle : 0.0002624988555908203 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1524 TO DO : save crop sub photo not yet done ! save time : 0.14438438415527344 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05148172378540039 time for calcul the mask position with numpy : 0.1363370418548584 nb_pixel_total : 2051440 time to create 1 rle with new method : 0.08424568176269531 time for calcul the mask position with numpy : 0.00614476203918457 nb_pixel_total : 5365 time to create 1 rle with old method : 0.006277799606323242 time for calcul the mask position with numpy : 0.0060155391693115234 nb_pixel_total : 2976 time to create 1 rle with old method : 0.003579378128051758 time for calcul the mask position with numpy : 0.006061553955078125 nb_pixel_total : 13819 time to create 1 rle with old method : 0.016117334365844727 create new chi : 0.27555084228515625 time to delete rle : 0.0003046989440917969 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1822 TO DO : save crop sub photo not yet done ! save time : 0.1605215072631836 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.22201848030090332 time for calcul the mask position with numpy : 0.06467986106872559 nb_pixel_total : 1939381 time to create 1 rle with new method : 0.09222269058227539 time for calcul the mask position with numpy : 0.005892753601074219 nb_pixel_total : 4846 time to create 1 rle with old method : 0.005198001861572266 time for calcul the mask position with numpy : 0.0061511993408203125 nb_pixel_total : 105790 time to create 1 rle with old method : 0.1152963638305664 time for calcul the mask position with numpy : 0.00582432746887207 nb_pixel_total : 10295 time to create 1 rle with old method : 0.011363744735717773 time for calcul the mask position with numpy : 0.00589752197265625 nb_pixel_total : 13288 time to create 1 rle with old method : 0.014493942260742188 create new chi : 0.33736371994018555 time to delete rle : 0.00046944618225097656 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2977 TO DO : save crop sub photo not yet done ! save time : 0.21568775177001953 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.049637794494628906 time for calcul the mask position with numpy : 0.01385045051574707 nb_pixel_total : 1249637 time to create 1 rle with new method : 0.18124675750732422 time for calcul the mask position with numpy : 0.014077425003051758 nb_pixel_total : 790496 time to create 1 rle with new method : 0.1561756134033203 time for calcul the mask position with numpy : 0.0069692134857177734 nb_pixel_total : 19356 time to create 1 rle with old method : 0.02242279052734375 time for calcul the mask position with numpy : 0.006109476089477539 nb_pixel_total : 14111 time to create 1 rle with old method : 0.016466140747070312 create new chi : 0.42421793937683105 time to delete rle : 0.0005712509155273438 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 3735 TO DO : save crop sub photo not yet done ! save time : 0.2594771385192871 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.042597293853759766 time for calcul the mask position with numpy : 0.0727074146270752 nb_pixel_total : 2059698 time to create 1 rle with new method : 0.20713090896606445 time for calcul the mask position with numpy : 0.0059223175048828125 nb_pixel_total : 13902 time to create 1 rle with old method : 0.015238761901855469 create new chi : 0.31087207794189453 time to delete rle : 0.0002307891845703125 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1466 TO DO : save crop sub photo not yet done ! save time : 0.13046765327453613 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.4420621395111084 time for calcul the mask position with numpy : 0.06287407875061035 nb_pixel_total : 1998569 time to create 1 rle with new method : 0.1278667449951172 time for calcul the mask position with numpy : 0.006179094314575195 nb_pixel_total : 6463 time to create 1 rle with old method : 0.00749659538269043 time for calcul the mask position with numpy : 0.006041049957275391 nb_pixel_total : 7735 time to create 1 rle with old method : 0.009000062942504883 time for calcul the mask position with numpy : 0.006556987762451172 nb_pixel_total : 28316 time to create 1 rle with old method : 0.03332161903381348 time for calcul the mask position with numpy : 0.00647425651550293 nb_pixel_total : 18236 time to create 1 rle with old method : 0.020963191986083984 time for calcul the mask position with numpy : 0.006585836410522461 nb_pixel_total : 14281 time to create 1 rle with old method : 0.016143321990966797 create new chi : 0.32173681259155273 time to delete rle : 0.0005595684051513672 batch 1 Loaded 11 chid ids of type : 3594 +++++++++Number RLEs to save : 3390 TO DO : save crop sub photo not yet done ! save time : 0.2514793872833252 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.05974936485290527 time for calcul the mask position with numpy : 0.018999576568603516 nb_pixel_total : 2043981 time to create 1 rle with new method : 0.22764158248901367 time for calcul the mask position with numpy : 0.006346225738525391 nb_pixel_total : 6379 time to create 1 rle with old method : 0.007505178451538086 time for calcul the mask position with numpy : 0.0065920352935791016 nb_pixel_total : 3604 time to create 1 rle with old method : 0.004260063171386719 time for calcul the mask position with numpy : 0.006300926208496094 nb_pixel_total : 5990 time to create 1 rle with old method : 0.0068874359130859375 time for calcul the mask position with numpy : 0.0058252811431884766 nb_pixel_total : 13646 time to create 1 rle with old method : 0.015487194061279297 create new chi : 0.3131988048553467 time to delete rle : 0.0003495216369628906 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2074 TO DO : save crop sub photo not yet done ! save time : 0.17274975776672363 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.07652521133422852 time for calcul the mask position with numpy : 0.1851487159729004 nb_pixel_total : 2053974 time to create 1 rle with new method : 0.14972233772277832 time for calcul the mask position with numpy : 0.008380651473999023 nb_pixel_total : 13952 time to create 1 rle with old method : 0.02571392059326172 time for calcul the mask position with numpy : 0.00959324836730957 nb_pixel_total : 5674 time to create 1 rle with old method : 0.010735034942626953 create new chi : 0.4076542854309082 time to delete rle : 0.0005619525909423828 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1652 TO DO : save crop sub photo not yet done ! save time : 0.14676475524902344 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.16544151306152344 time for calcul the mask position with numpy : 0.14452219009399414 nb_pixel_total : 2042235 time to create 1 rle with new method : 0.09959959983825684 time for calcul the mask position with numpy : 0.009974002838134766 nb_pixel_total : 10248 time to create 1 rle with old method : 0.015453577041625977 time for calcul the mask position with numpy : 0.007090091705322266 nb_pixel_total : 14025 time to create 1 rle with old method : 0.024335622787475586 time for calcul the mask position with numpy : 0.010195016860961914 nb_pixel_total : 7092 time to create 1 rle with old method : 0.009105920791625977 create new chi : 0.33750271797180176 time to delete rle : 0.00035500526428222656 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1770 TO DO : save crop sub photo not yet done ! save time : 0.1486518383026123 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04239296913146973 time for calcul the mask position with numpy : 0.3461189270019531 nb_pixel_total : 2035559 time to create 1 rle with new method : 0.07987117767333984 time for calcul the mask position with numpy : 0.006147861480712891 nb_pixel_total : 14085 time to create 1 rle with old method : 0.015863418579101562 time for calcul the mask position with numpy : 0.0060274600982666016 nb_pixel_total : 23956 time to create 1 rle with old method : 0.02700018882751465 create new chi : 0.49030160903930664 time to delete rle : 0.0003077983856201172 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1998 TO DO : save crop sub photo not yet done ! save time : 0.1551058292388916 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.4378955364227295 time for calcul the mask position with numpy : 0.22710275650024414 nb_pixel_total : 2050659 time to create 1 rle with new method : 0.22084522247314453 time for calcul the mask position with numpy : 0.0061223506927490234 nb_pixel_total : 3008 time to create 1 rle with old method : 0.003333568572998047 time for calcul the mask position with numpy : 0.008859872817993164 nb_pixel_total : 5704 time to create 1 rle with old method : 0.009465694427490234 time for calcul the mask position with numpy : 0.0070188045501708984 nb_pixel_total : 14229 time to create 1 rle with old method : 0.018995285034179688 create new chi : 0.5115108489990234 time to delete rle : 0.0004029273986816406 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 1712 TO DO : save crop sub photo not yet done ! save time : 0.15225982666015625 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04794764518737793 time for calcul the mask position with numpy : 0.04737353324890137 nb_pixel_total : 2010278 time to create 1 rle with new method : 0.24921417236328125 time for calcul the mask position with numpy : 0.006483554840087891 nb_pixel_total : 50412 time to create 1 rle with old method : 0.05845212936401367 time for calcul the mask position with numpy : 0.0062215328216552734 nb_pixel_total : 12910 time to create 1 rle with old method : 0.015110492706298828 create new chi : 0.39180660247802734 time to delete rle : 0.0003693103790283203 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1944 TO DO : save crop sub photo not yet done ! save time : 0.17625904083251953 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.25559473037719727 time for calcul the mask position with numpy : 0.0905907154083252 nb_pixel_total : 2036283 time to create 1 rle with new method : 0.21998167037963867 time for calcul the mask position with numpy : 0.007116079330444336 nb_pixel_total : 5715 time to create 1 rle with old method : 0.008453607559204102 time for calcul the mask position with numpy : 0.007647991180419922 nb_pixel_total : 18495 time to create 1 rle with old method : 0.027435302734375 time for calcul the mask position with numpy : 0.0062351226806640625 nb_pixel_total : 13107 time to create 1 rle with old method : 0.015256166458129883 create new chi : 0.3931913375854492 time to delete rle : 0.0003228187561035156 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1822 TO DO : save crop sub photo not yet done ! save time : 0.15671062469482422 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.05441904067993164 time for calcul the mask position with numpy : 0.15609335899353027 nb_pixel_total : 2048433 time to create 1 rle with new method : 0.18039250373840332 time for calcul the mask position with numpy : 0.008014440536499023 nb_pixel_total : 12700 time to create 1 rle with old method : 0.014820098876953125 time for calcul the mask position with numpy : 0.006479501724243164 nb_pixel_total : 12467 time to create 1 rle with old method : 0.014683246612548828 create new chi : 0.3895244598388672 time to delete rle : 0.0004248619079589844 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1760 TO DO : save crop sub photo not yet done ! save time : 0.13475871086120605 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.31976866722106934 time for calcul the mask position with numpy : 0.15280389785766602 nb_pixel_total : 2000498 time to create 1 rle with new method : 0.09723377227783203 time for calcul the mask position with numpy : 0.006343364715576172 nb_pixel_total : 38528 time to create 1 rle with old method : 0.0437922477722168 time for calcul the mask position with numpy : 0.006508588790893555 nb_pixel_total : 13039 time to create 1 rle with old method : 0.015027999877929688 time for calcul the mask position with numpy : 0.0061113834381103516 nb_pixel_total : 16392 time to create 1 rle with old method : 0.018953800201416016 time for calcul the mask position with numpy : 0.006322622299194336 nb_pixel_total : 5143 time to create 1 rle with old method : 0.006661653518676758 create new chi : 0.37018442153930664 time to delete rle : 0.0005269050598144531 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2632 TO DO : save crop sub photo not yet done ! save time : 0.20676374435424805 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04230523109436035 time for calcul the mask position with numpy : 0.010410785675048828 nb_pixel_total : 703007 time to create 1 rle with new method : 0.19415879249572754 time for calcul the mask position with numpy : 0.015413045883178711 nb_pixel_total : 1356591 time to create 1 rle with new method : 0.04835176467895508 time for calcul the mask position with numpy : 0.007285356521606445 nb_pixel_total : 14002 time to create 1 rle with old method : 0.021691083908081055 create new chi : 0.3048286437988281 time to delete rle : 0.0008628368377685547 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 4066 TO DO : save crop sub photo not yet done ! save time : 0.2906324863433838 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04356551170349121 time for calcul the mask position with numpy : 0.019023895263671875 nb_pixel_total : 2053611 time to create 1 rle with new method : 0.2473604679107666 time for calcul the mask position with numpy : 0.005911827087402344 nb_pixel_total : 6357 time to create 1 rle with old method : 0.007412433624267578 time for calcul the mask position with numpy : 0.005782365798950195 nb_pixel_total : 13632 time to create 1 rle with old method : 0.015213489532470703 create new chi : 0.31053638458251953 time to delete rle : 0.0002586841583251953 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1672 TO DO : save crop sub photo not yet done ! save time : 0.14341020584106445 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.060721397399902344 time for calcul the mask position with numpy : 0.14886784553527832 nb_pixel_total : 2025868 time to create 1 rle with new method : 0.19071102142333984 time for calcul the mask position with numpy : 0.006459474563598633 nb_pixel_total : 34478 time to create 1 rle with old method : 0.03737592697143555 time for calcul the mask position with numpy : 0.005928754806518555 nb_pixel_total : 13254 time to create 1 rle with old method : 0.014644384384155273 create new chi : 0.4136202335357666 time to delete rle : 0.0004401206970214844 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2054 TO DO : save crop sub photo not yet done ! save time : 0.1944413185119629 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.9769558906555176 time for calcul the mask position with numpy : 0.06511855125427246 nb_pixel_total : 2045497 time to create 1 rle with new method : 0.681429386138916 time for calcul the mask position with numpy : 0.0065402984619140625 nb_pixel_total : 3682 time to create 1 rle with old method : 0.004385232925415039 time for calcul the mask position with numpy : 0.00675654411315918 nb_pixel_total : 11592 time to create 1 rle with old method : 0.013765811920166016 time for calcul the mask position with numpy : 0.007167816162109375 nb_pixel_total : 12829 time to create 1 rle with old method : 0.018303871154785156 create new chi : 0.8138856887817383 time to delete rle : 0.0005118846893310547 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1832 TO DO : save crop sub photo not yet done ! save time : 0.164015531539917 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.06482648849487305 time for calcul the mask position with numpy : 0.03723311424255371 nb_pixel_total : 1951011 time to create 1 rle with new method : 0.34733080863952637 time for calcul the mask position with numpy : 0.006575345993041992 nb_pixel_total : 106125 time to create 1 rle with old method : 0.12210488319396973 time for calcul the mask position with numpy : 0.006148338317871094 nb_pixel_total : 2732 time to create 1 rle with old method : 0.0031957626342773438 time for calcul the mask position with numpy : 0.0061223506927490234 nb_pixel_total : 13732 time to create 1 rle with old method : 0.01543426513671875 create new chi : 0.5543873310089111 time to delete rle : 0.0004146099090576172 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2656 TO DO : save crop sub photo not yet done ! save time : 0.20717716217041016 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04802298545837402 time for calcul the mask position with numpy : 0.024045705795288086 nb_pixel_total : 2060576 time to create 1 rle with new method : 0.12142014503479004 time for calcul the mask position with numpy : 0.006089925765991211 nb_pixel_total : 13024 time to create 1 rle with old method : 0.015189886093139648 create new chi : 0.16713404655456543 time to delete rle : 0.0002644062042236328 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1446 TO DO : save crop sub photo not yet done ! save time : 0.11806464195251465 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.046152353286743164 time for calcul the mask position with numpy : 0.18770408630371094 nb_pixel_total : 2018421 time to create 1 rle with new method : 0.08675646781921387 time for calcul the mask position with numpy : 0.006083250045776367 nb_pixel_total : 13386 time to create 1 rle with old method : 0.015418767929077148 time for calcul the mask position with numpy : 0.006316184997558594 nb_pixel_total : 41793 time to create 1 rle with old method : 0.0487973690032959 create new chi : 0.36141133308410645 time to delete rle : 0.0003254413604736328 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1768 TO DO : save crop sub photo not yet done ! save time : 0.1502676010131836 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.21852779388427734 time for calcul the mask position with numpy : 0.19213032722473145 nb_pixel_total : 2032084 time to create 1 rle with new method : 0.08212780952453613 time for calcul the mask position with numpy : 0.006292104721069336 nb_pixel_total : 10632 time to create 1 rle with old method : 0.012175798416137695 time for calcul the mask position with numpy : 0.005973100662231445 nb_pixel_total : 17228 time to create 1 rle with old method : 0.01961517333984375 time for calcul the mask position with numpy : 0.006046772003173828 nb_pixel_total : 13656 time to create 1 rle with old method : 0.015754222869873047 create new chi : 0.3506197929382324 time to delete rle : 0.0003561973571777344 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2116 TO DO : save crop sub photo not yet done ! save time : 0.17460370063781738 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.0662837028503418 time for calcul the mask position with numpy : 0.18144464492797852 nb_pixel_total : 2032773 time to create 1 rle with new method : 0.0868520736694336 time for calcul the mask position with numpy : 0.006019115447998047 nb_pixel_total : 5370 time to create 1 rle with old method : 0.006357908248901367 time for calcul the mask position with numpy : 0.006127357482910156 nb_pixel_total : 22370 time to create 1 rle with old method : 0.025762081146240234 time for calcul the mask position with numpy : 0.0061261653900146484 nb_pixel_total : 13087 time to create 1 rle with old method : 0.015249252319335938 create new chi : 0.3446979522705078 time to delete rle : 0.0003924369812011719 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2216 TO DO : save crop sub photo not yet done ! save time : 0.1747441291809082 map_output_result : {1385489552: (0.0, 'Should be the crop_list due to order', 0), 1385489454: (0.0, 'Should be the crop_list due to order', 0), 1385489355: (0.0, 'Should be the crop_list due to order', 0), 1385489331: (0.0, 'Should be the crop_list due to order', 0), 1385489305: (0.0, 'Should be the crop_list due to order', 0), 1385489277: (0.0, 'Should be the crop_list due to order', 0), 1385489250: (0.0, 'Should be the crop_list due to order', 0), 1385489225: (0.0, 'Should be the crop_list due to order', 0), 1385488967: (0.0, 'Should be the crop_list due to order', 0), 1385488942: (0.0, 'Should be the crop_list due to order', 0), 1385488918: (0.0, 'Should be the crop_list due to order', 0), 1385488893: (0.0, 'Should be the crop_list due to order', 0), 1385488867: (0.0, 'Should be the crop_list due to order', 0), 1385488842: (0.0, 'Should be the crop_list due to order', 0), 1385488663: (0.0, 'Should be the crop_list due to order', 0), 1385488650: (0.0, 'Should be the crop_list due to order', 0), 1385488649: (0.0, 'Should be the crop_list due to order', 0), 1385488612: (0.0, 'Should be the crop_list due to order', 0), 1385488281: (0.0, 'Should be the crop_list due to order', 0), 1385488271: (0.0, 'Should be the crop_list due to order', 0), 1385488243: (0.0, 'Should be the crop_list due to order', 0), 1385488166: (0.0, 'Should be the crop_list due to order', 0), 1385488130: (0.0, 'Should be the crop_list due to order', 0), 1385488105: (0.0, 'Should be the crop_list due to order', 0), 1385487875: (0.0, 'Should be the crop_list due to order', 0), 1385487806: (0.0, 'Should be the crop_list due to order', 0), 1385487778: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1385489552, 1385489454, 1385489355, 1385489331, 1385489305, 1385489277, 1385489250, 1385489225, 1385488967, 1385488942, 1385488918, 1385488893, 1385488867, 1385488842, 1385488663, 1385488650, 1385488649, 1385488612, 1385488281, 1385488271, 1385488243, 1385488166, 1385488130, 1385488105, 1385487875, 1385487806, 1385487778] Looping around the photos to save general results len do output : 27 /1385489552.Didn't retrieve data . /1385489454.Didn't retrieve data . /1385489355.Didn't retrieve data . /1385489331.Didn't retrieve data . /1385489305.Didn't retrieve data . /1385489277.Didn't retrieve data . /1385489250.Didn't retrieve data . /1385489225.Didn't retrieve data . /1385488967.Didn't retrieve data . /1385488942.Didn't retrieve data . /1385488918.Didn't retrieve data . /1385488893.Didn't retrieve data . /1385488867.Didn't retrieve data . /1385488842.Didn't retrieve data . /1385488663.Didn't retrieve data . /1385488650.Didn't retrieve data . /1385488649.Didn't retrieve data . /1385488612.Didn't retrieve data . /1385488281.Didn't retrieve data . /1385488271.Didn't retrieve data . /1385488243.Didn't retrieve data . /1385488166.Didn't retrieve data . /1385488130.Didn't retrieve data . /1385488105.Didn't retrieve data . /1385487875.Didn't retrieve data . /1385487806.Didn't retrieve data . /1385487778.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489552', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489454', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489355', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489331', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489305', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489277', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489250', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489225', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488967', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488942', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488918', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488893', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488867', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488842', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488663', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488650', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488649', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488612', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488281', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488271', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488243', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488166', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488130', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488105', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385487875', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385487806', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385487778', None, None, None, None, None, '3759467') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 81 time used for this insertion : 0.020451784133911133 save_final save missing photos in datou_result : time spend for datou_step_exec : 20.897956371307373 time spend to save output : 0.021233320236206055 total time spend for step 3 : 20.91918969154358 step4:ventilate_hashtags_in_portfolio Mon Sep 22 17:42:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 27099650 get user id for portfolio 27099650 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27099650 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','mal_croppe','background','autre','environnement','papier','pet_clair','carton','pehd','flou','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27099650 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','mal_croppe','background','autre','environnement','papier','pet_clair','carton','pehd','flou','pet_fonce')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27099650 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','mal_croppe','background','autre','environnement','papier','pet_clair','carton','pehd','flou','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/27100103,27100104,27100105,27100106,27100107,27100108,27100109,27100110,27100111,27100112,27100113?tags=metal,mal_croppe,background,autre,environnement,papier,pet_clair,carton,pehd,flou,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1385489552, 1385489454, 1385489355, 1385489331, 1385489305, 1385489277, 1385489250, 1385489225, 1385488967, 1385488942, 1385488918, 1385488893, 1385488867, 1385488842, 1385488663, 1385488650, 1385488649, 1385488612, 1385488281, 1385488271, 1385488243, 1385488166, 1385488130, 1385488105, 1385487875, 1385487806, 1385487778] Looping around the photos to save general results len do output : 1 /27099650. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489552', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489454', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489355', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489331', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489305', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489277', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489250', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489225', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488967', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488942', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488918', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488893', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488867', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488842', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488663', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488650', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488649', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488612', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488281', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488271', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488243', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488166', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488130', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488105', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385487875', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385487806', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385487778', None, None, None, None, None, '3759467') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 28 time used for this insertion : 0.019257545471191406 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.679410457611084 time spend to save output : 0.019633054733276367 total time spend for step 4 : 1.6990435123443604 step5:final Mon Sep 22 17:42:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1385489552: ('0.06505486968449932',), 1385489454: ('0.06505486968449932',), 1385489355: ('0.06505486968449932',), 1385489331: ('0.06505486968449932',), 1385489305: ('0.06505486968449932',), 1385489277: ('0.06505486968449932',), 1385489250: ('0.06505486968449932',), 1385489225: ('0.06505486968449932',), 1385488967: ('0.06505486968449932',), 1385488942: ('0.06505486968449932',), 1385488918: ('0.06505486968449932',), 1385488893: ('0.06505486968449932',), 1385488867: ('0.06505486968449932',), 1385488842: ('0.06505486968449932',), 1385488663: ('0.06505486968449932',), 1385488650: ('0.06505486968449932',), 1385488649: ('0.06505486968449932',), 1385488612: ('0.06505486968449932',), 1385488281: ('0.06505486968449932',), 1385488271: ('0.06505486968449932',), 1385488243: ('0.06505486968449932',), 1385488166: ('0.06505486968449932',), 1385488130: ('0.06505486968449932',), 1385488105: ('0.06505486968449932',), 1385487875: ('0.06505486968449932',), 1385487806: ('0.06505486968449932',), 1385487778: ('0.06505486968449932',)} new output for save of step final : {1385489552: ('0.06505486968449932',), 1385489454: ('0.06505486968449932',), 1385489355: ('0.06505486968449932',), 1385489331: ('0.06505486968449932',), 1385489305: ('0.06505486968449932',), 1385489277: ('0.06505486968449932',), 1385489250: ('0.06505486968449932',), 1385489225: ('0.06505486968449932',), 1385488967: ('0.06505486968449932',), 1385488942: ('0.06505486968449932',), 1385488918: ('0.06505486968449932',), 1385488893: ('0.06505486968449932',), 1385488867: ('0.06505486968449932',), 1385488842: ('0.06505486968449932',), 1385488663: ('0.06505486968449932',), 1385488650: ('0.06505486968449932',), 1385488649: ('0.06505486968449932',), 1385488612: ('0.06505486968449932',), 1385488281: ('0.06505486968449932',), 1385488271: ('0.06505486968449932',), 1385488243: ('0.06505486968449932',), 1385488166: ('0.06505486968449932',), 1385488130: ('0.06505486968449932',), 1385488105: ('0.06505486968449932',), 1385487875: ('0.06505486968449932',), 1385487806: ('0.06505486968449932',), 1385487778: ('0.06505486968449932',)} [1385489552, 1385489454, 1385489355, 1385489331, 1385489305, 1385489277, 1385489250, 1385489225, 1385488967, 1385488942, 1385488918, 1385488893, 1385488867, 1385488842, 1385488663, 1385488650, 1385488649, 1385488612, 1385488281, 1385488271, 1385488243, 1385488166, 1385488130, 1385488105, 1385487875, 1385487806, 1385487778] Looping around the photos to save general results len do output : 27 /1385489552.Didn't retrieve data . /1385489454.Didn't retrieve data . /1385489355.Didn't retrieve data . /1385489331.Didn't retrieve data . /1385489305.Didn't retrieve data . /1385489277.Didn't retrieve data . /1385489250.Didn't retrieve data . /1385489225.Didn't retrieve data . /1385488967.Didn't retrieve data . /1385488942.Didn't retrieve data . /1385488918.Didn't retrieve data . /1385488893.Didn't retrieve data . /1385488867.Didn't retrieve data . /1385488842.Didn't retrieve data . /1385488663.Didn't retrieve data . /1385488650.Didn't retrieve data . /1385488649.Didn't retrieve data . /1385488612.Didn't retrieve data . /1385488281.Didn't retrieve data . /1385488271.Didn't retrieve data . /1385488243.Didn't retrieve data . /1385488166.Didn't retrieve data . /1385488130.Didn't retrieve data . /1385488105.Didn't retrieve data . /1385487875.Didn't retrieve data . /1385487806.Didn't retrieve data . /1385487778.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489552', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489454', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489355', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489331', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489305', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489277', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489250', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489225', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488967', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488942', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488918', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488893', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488867', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488842', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488663', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488650', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488649', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488612', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488281', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488271', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488243', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488166', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488130', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488105', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385487875', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385487806', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385487778', None, None, None, None, None, '3759467') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 81 time used for this insertion : 0.014330387115478516 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12564873695373535 time spend to save output : 0.015439033508300781 total time spend for step 5 : 0.14108777046203613 step6:blur_detection Mon Sep 22 17:42:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1758555627_1011055_1385489552_a92c0cf6a8733c26e9aa3786cccc2a6e.jpg resize: (1080, 1920) 1385489552 -4.170584743070964 treat image : temp/1758555627_1011055_1385489454_1683727fb8261e389ff4a4aac845d129.jpg resize: (1080, 1920) 1385489454 -3.1599566076932315 treat image : temp/1758555627_1011055_1385489355_b985d07d57e677ba800cc6b8394a8477.jpg resize: (1080, 1920) 1385489355 -2.207668895682125 treat image : temp/1758555627_1011055_1385489331_5b417812779932ea37b26fa011430867.jpg resize: (1080, 1920) 1385489331 -2.3522318844759833 treat image : temp/1758555627_1011055_1385489305_2535415be29c0e604281b31e918db1fb.jpg resize: (1080, 1920) 1385489305 -2.3762216349692764 treat image : temp/1758555627_1011055_1385489277_24108aceba829c032fc246be5dc2906a.jpg resize: (1080, 1920) 1385489277 -4.040999328484105 treat image : temp/1758555627_1011055_1385489250_0bc9b0e9587eba623417c9b3ea9229c5.jpg resize: (1080, 1920) 1385489250 -1.8367093736063034 treat image : temp/1758555627_1011055_1385489225_6b468fb57d8020201b2347b50acda1a2.jpg resize: (1080, 1920) 1385489225 -2.640272314657172 treat image : temp/1758555627_1011055_1385488967_902fdac790371068d6a79f111cf62f24.jpg resize: (1080, 1920) 1385488967 -1.8290103413578598 treat image : temp/1758555627_1011055_1385488942_c474995c67a4f759dc57f4446ed87ff7.jpg resize: (1080, 1920) 1385488942 -2.2945753634589185 treat image : temp/1758555627_1011055_1385488918_a86bc214d7821101c9cfda7e4c6676d8.jpg resize: (1080, 1920) 1385488918 -2.482145414996438 treat image : temp/1758555627_1011055_1385488893_bca019459c8ff1228bf81004682b7135.jpg resize: (1080, 1920) 1385488893 -1.9092474397858363 treat image : temp/1758555627_1011055_1385488867_4b910f2d30820bc2c42587b49e0d1d00.jpg resize: (1080, 1920) 1385488867 -2.1495989368609525 treat image : temp/1758555627_1011055_1385488842_bbb7f25c850a7b949da579533c881830.jpg resize: (1080, 1920) 1385488842 -2.2390660736063803 treat image : temp/1758555627_1011055_1385488663_99c7d9a20c26a2ef19a29991014dfc3b.jpg resize: (1080, 1920) 1385488663 -2.132850553506551 treat image : temp/1758555627_1011055_1385488650_3860bf33f2b3e1222c1c52b2c7f02895.jpg resize: (1080, 1920) 1385488650 -1.7701357568257852 treat image : temp/1758555627_1011055_1385488649_0580ac16853de98c1a18ceb6e5e94180.jpg resize: (1080, 1920) 1385488649 -4.167029619628642 treat image : temp/1758555627_1011055_1385488612_eb8cc71707a6fde76a75ea594de4a330.jpg resize: (1080, 1920) 1385488612 -2.100316536870506 treat image : temp/1758555627_1011055_1385488281_d593ebe1a9c4d5357ab438654ecb5e7d.jpg resize: (1080, 1920) 1385488281 -2.5154737519516988 treat image : temp/1758555627_1011055_1385488271_ef8fb79c160a32a75aa4543d3faffe39.jpg resize: (1080, 1920) 1385488271 -1.8007848697217101 treat image : temp/1758555627_1011055_1385488243_399184446317b12541e91503e28b39dd.jpg resize: (1080, 1920) 1385488243 -1.8873802268557252 treat image : temp/1758555627_1011055_1385488166_dc063d1e7cd1adbe6ba5d6ddff9e352d.jpg resize: (1080, 1920) 1385488166 -0.25004564260530565 treat image : temp/1758555627_1011055_1385488130_5225bc0810ab9501acfe598b7424f4ff.jpg resize: (1080, 1920) 1385488130 -1.2918641929518637 treat image : temp/1758555627_1011055_1385488105_b3fc6a6914a59e7dc44ceb2ebe564c02.jpg resize: (1080, 1920) 1385488105 -1.8228374197394317 treat image : temp/1758555627_1011055_1385487875_91130ac51bb52c3b47e8002a016a1ab9.jpg resize: (1080, 1920) 1385487875 -2.3419575224606466 treat image : temp/1758555627_1011055_1385487806_61faec67f5cd9edf323b77b15231af3a.jpg resize: (1080, 1920) 1385487806 -2.3541075672116007 treat image : temp/1758555627_1011055_1385487778_140b8f322b0d28b9679b9ba14e176350.jpg resize: (1080, 1920) 1385487778 0.027101529829295493 treat image : temp/1758555627_1011055_1385489552_a92c0cf6a8733c26e9aa3786cccc2a6e_rle_crop_3970237715_0.png resize: (173, 108) 1385492375 -0.5329022766082321 treat image : temp/1758555627_1011055_1385489454_1683727fb8261e389ff4a4aac845d129_rle_crop_3970237717_0.png resize: (185, 120) 1385492376 -0.5752461504016377 treat image : temp/1758555627_1011055_1385489454_1683727fb8261e389ff4a4aac845d129_rle_crop_3970237719_0.png resize: (92, 115) 1385492377 -1.4651542998319178 treat image : temp/1758555627_1011055_1385489355_b985d07d57e677ba800cc6b8394a8477_rle_crop_3970237720_0.png resize: (164, 119) 1385492378 -2.134829142131028 treat image : temp/1758555627_1011055_1385489355_b985d07d57e677ba800cc6b8394a8477_rle_crop_3970237721_0.png resize: (188, 119) 1385492379 -0.5376187818809063 treat image : temp/1758555627_1011055_1385489331_5b417812779932ea37b26fa011430867_rle_crop_3970237726_0.png resize: (183, 119) 1385492380 -0.7217835011096946 treat image : temp/1758555627_1011055_1385489305_2535415be29c0e604281b31e918db1fb_rle_crop_3970237727_0.png resize: (194, 118) 1385492382 -0.3740298924838524 treat image : temp/1758555627_1011055_1385489277_24108aceba829c032fc246be5dc2906a_rle_crop_3970237730_0.png resize: (183, 119) 1385492383 -0.4227062333518164 treat image : temp/1758555627_1011055_1385489277_24108aceba829c032fc246be5dc2906a_rle_crop_3970237733_0.png resize: (101, 88) 1385492384 -1.9365862474510196 treat image : temp/1758555627_1011055_1385489250_0bc9b0e9587eba623417c9b3ea9229c5_rle_crop_3970237734_0.png resize: (198, 122) 1385492385 -0.5077595240133288 treat image : temp/1758555627_1011055_1385489250_0bc9b0e9587eba623417c9b3ea9229c5_rle_crop_3970237735_0.png resize: (219, 153) 1385492386 -2.221911073218111 treat image : temp/1758555627_1011055_1385489225_6b468fb57d8020201b2347b50acda1a2_rle_crop_3970237737_0.png resize: (191, 116) 1385492387 -0.42369485354414277 treat image : temp/1758555627_1011055_1385488967_902fdac790371068d6a79f111cf62f24_rle_crop_3970237738_0.png resize: (191, 124) 1385492388 -0.37443424534744235 treat image : temp/1758555627_1011055_1385488967_902fdac790371068d6a79f111cf62f24_rle_crop_3970237741_0.png resize: (104, 110) 1385492389 -1.1813429171181917 treat image : temp/1758555627_1011055_1385488942_c474995c67a4f759dc57f4446ed87ff7_rle_crop_3970237743_0.png resize: (194, 115) 1385492391 -0.3182498502842504 treat image : temp/1758555627_1011055_1385488942_c474995c67a4f759dc57f4446ed87ff7_rle_crop_3970237745_0.png resize: (65, 108) 1385492392 -0.9259927783378189 treat image : temp/1758555627_1011055_1385488918_a86bc214d7821101c9cfda7e4c6676d8_rle_crop_3970237747_0.png resize: (92, 82) 1385492393 -0.10160602733165738 treat image : temp/1758555627_1011055_1385488918_a86bc214d7821101c9cfda7e4c6676d8_rle_crop_3970237748_0.png resize: (194, 121) 1385492394 -0.49471191128559544 treat image : temp/1758555627_1011055_1385488893_bca019459c8ff1228bf81004682b7135_rle_crop_3970237750_0.png resize: (182, 123) 1385492395 -0.4526201416558171 treat image : temp/1758555627_1011055_1385488867_4b910f2d30820bc2c42587b49e0d1d00_rle_crop_3970237753_0.png resize: (196, 121) 1385492396 -0.41978015177304623 treat image : temp/1758555627_1011055_1385488842_bbb7f25c850a7b949da579533c881830_rle_crop_3970237754_0.png resize: (193, 121) 1385492397 -0.3858160133162958 treat image : temp/1758555627_1011055_1385488663_99c7d9a20c26a2ef19a29991014dfc3b_rle_crop_3970237757_0.png resize: (183, 111) 1385492399 -0.27316100906428165 treat image : temp/1758555627_1011055_1385488650_3860bf33f2b3e1222c1c52b2c7f02895_rle_crop_3970237759_0.png resize: (183, 122) 1385492400 -0.5278351103325652 treat image : temp/1758555627_1011055_1385488650_3860bf33f2b3e1222c1c52b2c7f02895_rle_crop_3970237761_0.png resize: (66, 116) 1385492401 -1.2574958020495033 treat image : temp/1758555627_1011055_1385488649_0580ac16853de98c1a18ceb6e5e94180_rle_crop_3970237763_0.png resize: (185, 110) 1385492402 -0.37399432624687934 treat image : temp/1758555627_1011055_1385488612_eb8cc71707a6fde76a75ea594de4a330_rle_crop_3970237764_0.png resize: (136, 65) 1385492403 -2.010961916838743 treat image : temp/1758555627_1011055_1385488612_eb8cc71707a6fde76a75ea594de4a330_rle_crop_3970237766_0.png resize: (190, 111) 1385492404 -0.2723279636145283 treat image : temp/1758555627_1011055_1385488281_d593ebe1a9c4d5357ab438654ecb5e7d_rle_crop_3970237768_0.png resize: (191, 120) 1385492405 -0.3630188350351681 treat image : temp/1758555627_1011055_1385488271_ef8fb79c160a32a75aa4543d3faffe39_rle_crop_3970237770_0.png resize: (189, 119) 1385492406 -0.41470097484704266 treat image : temp/1758555627_1011055_1385488271_ef8fb79c160a32a75aa4543d3faffe39_rle_crop_3970237771_0.png resize: (106, 121) 1385492407 -0.4350623720358161 treat image : temp/1758555627_1011055_1385488243_399184446317b12541e91503e28b39dd_rle_crop_3970237772_0.png resize: (184, 122) 1385492408 -0.57604018823991 treat image : temp/1758555627_1011055_1385488166_dc063d1e7cd1adbe6ba5d6ddff9e352d_rle_crop_3970237774_0.png resize: (186, 117) 1385492409 -0.400507727756664 treat image : temp/1758555627_1011055_1385488130_5225bc0810ab9501acfe598b7424f4ff_rle_crop_3970237777_0.png resize: (187, 120) 1385492410 -0.334288332223434 treat image : temp/1758555627_1011055_1385488130_5225bc0810ab9501acfe598b7424f4ff_rle_crop_3970237778_0.png resize: (50, 77) 1385492411 -0.20519868868882007 treat image : temp/1758555627_1011055_1385488105_b3fc6a6914a59e7dc44ceb2ebe564c02_rle_crop_3970237780_0.png resize: (182, 116) 1385492412 -0.49431737956666705 treat image : temp/1758555627_1011055_1385487875_91130ac51bb52c3b47e8002a016a1ab9_rle_crop_3970237782_0.png resize: (185, 116) 1385492413 -0.3728787585655506 treat image : temp/1758555627_1011055_1385487806_61faec67f5cd9edf323b77b15231af3a_rle_crop_3970237783_0.png resize: (194, 115) 1385492414 -0.244517937324732 treat image : temp/1758555627_1011055_1385487778_140b8f322b0d28b9679b9ba14e176350_rle_crop_3970237786_0.png resize: (185, 119) 1385492415 -0.32042070494249325 treat image : temp/1758555627_1011055_1385489454_1683727fb8261e389ff4a4aac845d129_rle_crop_3970237716_0.png resize: (143, 100) 1385492417 -0.2058253995167771 treat image : temp/1758555627_1011055_1385489277_24108aceba829c032fc246be5dc2906a_rle_crop_3970237731_0.png resize: (148, 90) 1385492418 -0.3506536734384325 treat image : temp/1758555627_1011055_1385488649_0580ac16853de98c1a18ceb6e5e94180_rle_crop_3970237762_0.png resize: (154, 101) 1385492419 -0.11070300093283267 treat image : temp/1758555627_1011055_1385488166_dc063d1e7cd1adbe6ba5d6ddff9e352d_rle_crop_3970237776_0.png resize: (50, 93) 1385492420 1.9239603505843965 treat image : temp/1758555627_1011055_1385487806_61faec67f5cd9edf323b77b15231af3a_rle_crop_3970237785_0.png resize: (143, 108) 1385492421 -0.9906485182284237 treat image : temp/1758555627_1011055_1385488842_bbb7f25c850a7b949da579533c881830_rle_crop_3970237755_0.png resize: (50, 153) 1385492429 -1.291094493834155 treat image : temp/1758555627_1011055_1385487778_140b8f322b0d28b9679b9ba14e176350_rle_crop_3970237788_0.png resize: (56, 107) 1385492430 2.992639078282429 treat image : temp/1758555627_1011055_1385489552_a92c0cf6a8733c26e9aa3786cccc2a6e_rle_crop_3970237714_0.png resize: (537, 367) 1385492538 -0.18839975307556098 treat image : temp/1758555627_1011055_1385489454_1683727fb8261e389ff4a4aac845d129_rle_crop_3970237718_0.png resize: (401, 664) 1385492539 -1.63819023192118 treat image : temp/1758555627_1011055_1385489355_b985d07d57e677ba800cc6b8394a8477_rle_crop_3970237722_0.png resize: (488, 383) 1385492540 -0.8043588848412778 treat image : temp/1758555627_1011055_1385489355_b985d07d57e677ba800cc6b8394a8477_rle_crop_3970237723_0.png resize: (186, 108) 1385492541 -1.5831870404870056 treat image : temp/1758555627_1011055_1385489355_b985d07d57e677ba800cc6b8394a8477_rle_crop_3970237724_0.png resize: (249, 175) 1385492542 -1.631745585682934 treat image : temp/1758555627_1011055_1385489331_5b417812779932ea37b26fa011430867_rle_crop_3970237725_0.png resize: (39, 55) 1385492543 0.9572501226292423 treat image : temp/1758555627_1011055_1385489305_2535415be29c0e604281b31e918db1fb_rle_crop_3970237728_0.png resize: (58, 59) 1385492544 -3.059572736991586 treat image : temp/1758555627_1011055_1385489305_2535415be29c0e604281b31e918db1fb_rle_crop_3970237729_0.png resize: (117, 53) 1385492545 1.806187954492192 treat image : temp/1758555627_1011055_1385489277_24108aceba829c032fc246be5dc2906a_rle_crop_3970237732_0.png resize: (517, 332) 1385492547 -0.17473185335990604 treat image : temp/1758555627_1011055_1385489250_0bc9b0e9587eba623417c9b3ea9229c5_rle_crop_3970237736_0.png resize: (920, 1155) 1385492548 -0.35970630964723616 treat image : temp/1758555627_1011055_1385488967_902fdac790371068d6a79f111cf62f24_rle_crop_3970237739_0.png resize: (242, 116) 1385492549 -3.1342803653590794 treat image : temp/1758555627_1011055_1385488967_902fdac790371068d6a79f111cf62f24_rle_crop_3970237740_0.png resize: (251, 219) 1385492550 -3.7379681241444507 treat image : temp/1758555627_1011055_1385488942_c474995c67a4f759dc57f4446ed87ff7_rle_crop_3970237744_0.png resize: (128, 87) 1385492551 -2.6620846831589913 treat image : temp/1758555627_1011055_1385488942_c474995c67a4f759dc57f4446ed87ff7_rle_crop_3970237746_0.png resize: (104, 84) 1385492552 -2.780418320675466 treat image : temp/1758555627_1011055_1385488893_bca019459c8ff1228bf81004682b7135_rle_crop_3970237749_0.png resize: (80, 133) 1385492553 -3.3805829221975614 treat image : temp/1758555627_1011055_1385488893_bca019459c8ff1228bf81004682b7135_rle_crop_3970237751_0.png resize: (81, 171) 1385492554 -1.3803067622133383 treat image : temp/1758555627_1011055_1385488867_4b910f2d30820bc2c42587b49e0d1d00_rle_crop_3970237752_0.png resize: (261, 161) 1385492555 -2.906500710494603 treat image : temp/1758555627_1011055_1385488842_bbb7f25c850a7b949da579533c881830_rle_crop_3970237756_0.png resize: (57, 65) 1385492556 -0.9076364000512364 treat image : temp/1758555627_1011055_1385488663_99c7d9a20c26a2ef19a29991014dfc3b_rle_crop_3970237758_0.png resize: (219, 332) 1385492557 -4.517782758221759 treat image : temp/1758555627_1011055_1385488650_3860bf33f2b3e1222c1c52b2c7f02895_rle_crop_3970237760_0.png resize: (112, 184) 1385492558 -1.4121306110929746 treat image : temp/1758555627_1011055_1385488612_eb8cc71707a6fde76a75ea594de4a330_rle_crop_3970237765_0.png resize: (153, 180) 1385492559 -1.431395997648123 treat image : temp/1758555627_1011055_1385488612_eb8cc71707a6fde76a75ea594de4a330_rle_crop_3970237767_0.png resize: (284, 294) 1385492560 -1.7268661503844684 treat image : temp/1758555627_1011055_1385488281_d593ebe1a9c4d5357ab438654ecb5e7d_rle_crop_3970237769_0.png resize: (987, 1460) 1385492561 -2.7803262547187053 treat image : temp/1758555627_1011055_1385488243_399184446317b12541e91503e28b39dd_rle_crop_3970237773_0.png resize: (292, 170) 1385492563 -2.0842267363423335 treat image : temp/1758555627_1011055_1385488166_dc063d1e7cd1adbe6ba5d6ddff9e352d_rle_crop_3970237775_0.png resize: (135, 120) 1385492564 -2.5933280240619134 treat image : temp/1758555627_1011055_1385488130_5225bc0810ab9501acfe598b7424f4ff_rle_crop_3970237779_0.png resize: (540, 341) 1385492565 0.11661032369342052 treat image : temp/1758555627_1011055_1385487875_91130ac51bb52c3b47e8002a016a1ab9_rle_crop_3970237781_0.png resize: (142, 394) 1385492567 -2.7941219884833375 treat image : temp/1758555627_1011055_1385487806_61faec67f5cd9edf323b77b15231af3a_rle_crop_3970237784_0.png resize: (180, 137) 1385492568 -4.018630062054899 treat image : temp/1758555627_1011055_1385487778_140b8f322b0d28b9679b9ba14e176350_rle_crop_3970237787_0.png resize: (324, 119) 1385492569 -2.6418162414529918 treat image : temp/1758555627_1011055_1385488967_902fdac790371068d6a79f111cf62f24_rle_crop_3970237742_0.png resize: (101, 80) 1385492575 0.41267036171358157 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 102 time used for this insertion : 0.018829345703125 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 102 time used for this insertion : 0.030045509338378906 save missing photos in datou_result : time spend for datou_step_exec : 23.010826349258423 time spend to save output : 0.05396270751953125 total time spend for step 6 : 23.064789056777954 step7:brightness Mon Sep 22 17:42:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1758555627_1011055_1385489552_a92c0cf6a8733c26e9aa3786cccc2a6e.jpg treat image : temp/1758555627_1011055_1385489454_1683727fb8261e389ff4a4aac845d129.jpg treat image : temp/1758555627_1011055_1385489355_b985d07d57e677ba800cc6b8394a8477.jpg treat image : temp/1758555627_1011055_1385489331_5b417812779932ea37b26fa011430867.jpg treat image : temp/1758555627_1011055_1385489305_2535415be29c0e604281b31e918db1fb.jpg treat image : temp/1758555627_1011055_1385489277_24108aceba829c032fc246be5dc2906a.jpg treat image : temp/1758555627_1011055_1385489250_0bc9b0e9587eba623417c9b3ea9229c5.jpg treat image : temp/1758555627_1011055_1385489225_6b468fb57d8020201b2347b50acda1a2.jpg treat image : temp/1758555627_1011055_1385488967_902fdac790371068d6a79f111cf62f24.jpg treat image : temp/1758555627_1011055_1385488942_c474995c67a4f759dc57f4446ed87ff7.jpg treat image : temp/1758555627_1011055_1385488918_a86bc214d7821101c9cfda7e4c6676d8.jpg treat image : temp/1758555627_1011055_1385488893_bca019459c8ff1228bf81004682b7135.jpg treat image : temp/1758555627_1011055_1385488867_4b910f2d30820bc2c42587b49e0d1d00.jpg treat image : temp/1758555627_1011055_1385488842_bbb7f25c850a7b949da579533c881830.jpg treat image : temp/1758555627_1011055_1385488663_99c7d9a20c26a2ef19a29991014dfc3b.jpg treat image : temp/1758555627_1011055_1385488650_3860bf33f2b3e1222c1c52b2c7f02895.jpg treat image : temp/1758555627_1011055_1385488649_0580ac16853de98c1a18ceb6e5e94180.jpg treat image : temp/1758555627_1011055_1385488612_eb8cc71707a6fde76a75ea594de4a330.jpg treat image : temp/1758555627_1011055_1385488281_d593ebe1a9c4d5357ab438654ecb5e7d.jpg treat image : temp/1758555627_1011055_1385488271_ef8fb79c160a32a75aa4543d3faffe39.jpg treat image : temp/1758555627_1011055_1385488243_399184446317b12541e91503e28b39dd.jpg treat image : temp/1758555627_1011055_1385488166_dc063d1e7cd1adbe6ba5d6ddff9e352d.jpg treat image : temp/1758555627_1011055_1385488130_5225bc0810ab9501acfe598b7424f4ff.jpg treat image : temp/1758555627_1011055_1385488105_b3fc6a6914a59e7dc44ceb2ebe564c02.jpg treat image : temp/1758555627_1011055_1385487875_91130ac51bb52c3b47e8002a016a1ab9.jpg treat image : temp/1758555627_1011055_1385487806_61faec67f5cd9edf323b77b15231af3a.jpg treat image : temp/1758555627_1011055_1385487778_140b8f322b0d28b9679b9ba14e176350.jpg treat image : temp/1758555627_1011055_1385489552_a92c0cf6a8733c26e9aa3786cccc2a6e_rle_crop_3970237715_0.png treat image : temp/1758555627_1011055_1385489454_1683727fb8261e389ff4a4aac845d129_rle_crop_3970237717_0.png treat image : temp/1758555627_1011055_1385489454_1683727fb8261e389ff4a4aac845d129_rle_crop_3970237719_0.png treat image : temp/1758555627_1011055_1385489355_b985d07d57e677ba800cc6b8394a8477_rle_crop_3970237720_0.png treat image : temp/1758555627_1011055_1385489355_b985d07d57e677ba800cc6b8394a8477_rle_crop_3970237721_0.png treat image : temp/1758555627_1011055_1385489331_5b417812779932ea37b26fa011430867_rle_crop_3970237726_0.png treat image : temp/1758555627_1011055_1385489305_2535415be29c0e604281b31e918db1fb_rle_crop_3970237727_0.png treat image : temp/1758555627_1011055_1385489277_24108aceba829c032fc246be5dc2906a_rle_crop_3970237730_0.png treat image : temp/1758555627_1011055_1385489277_24108aceba829c032fc246be5dc2906a_rle_crop_3970237733_0.png treat image : temp/1758555627_1011055_1385489250_0bc9b0e9587eba623417c9b3ea9229c5_rle_crop_3970237734_0.png treat image : temp/1758555627_1011055_1385489250_0bc9b0e9587eba623417c9b3ea9229c5_rle_crop_3970237735_0.png treat image : temp/1758555627_1011055_1385489225_6b468fb57d8020201b2347b50acda1a2_rle_crop_3970237737_0.png treat image : temp/1758555627_1011055_1385488967_902fdac790371068d6a79f111cf62f24_rle_crop_3970237738_0.png treat image : temp/1758555627_1011055_1385488967_902fdac790371068d6a79f111cf62f24_rle_crop_3970237741_0.png treat image : temp/1758555627_1011055_1385488942_c474995c67a4f759dc57f4446ed87ff7_rle_crop_3970237743_0.png treat image : temp/1758555627_1011055_1385488942_c474995c67a4f759dc57f4446ed87ff7_rle_crop_3970237745_0.png treat image : temp/1758555627_1011055_1385488918_a86bc214d7821101c9cfda7e4c6676d8_rle_crop_3970237747_0.png treat image : temp/1758555627_1011055_1385488918_a86bc214d7821101c9cfda7e4c6676d8_rle_crop_3970237748_0.png treat image : temp/1758555627_1011055_1385488893_bca019459c8ff1228bf81004682b7135_rle_crop_3970237750_0.png treat image : temp/1758555627_1011055_1385488867_4b910f2d30820bc2c42587b49e0d1d00_rle_crop_3970237753_0.png treat image : temp/1758555627_1011055_1385488842_bbb7f25c850a7b949da579533c881830_rle_crop_3970237754_0.png treat image : temp/1758555627_1011055_1385488663_99c7d9a20c26a2ef19a29991014dfc3b_rle_crop_3970237757_0.png treat image : temp/1758555627_1011055_1385488650_3860bf33f2b3e1222c1c52b2c7f02895_rle_crop_3970237759_0.png treat image : temp/1758555627_1011055_1385488650_3860bf33f2b3e1222c1c52b2c7f02895_rle_crop_3970237761_0.png treat image : temp/1758555627_1011055_1385488649_0580ac16853de98c1a18ceb6e5e94180_rle_crop_3970237763_0.png treat image : temp/1758555627_1011055_1385488612_eb8cc71707a6fde76a75ea594de4a330_rle_crop_3970237764_0.png treat image : temp/1758555627_1011055_1385488612_eb8cc71707a6fde76a75ea594de4a330_rle_crop_3970237766_0.png treat image : temp/1758555627_1011055_1385488281_d593ebe1a9c4d5357ab438654ecb5e7d_rle_crop_3970237768_0.png treat image : temp/1758555627_1011055_1385488271_ef8fb79c160a32a75aa4543d3faffe39_rle_crop_3970237770_0.png treat image : temp/1758555627_1011055_1385488271_ef8fb79c160a32a75aa4543d3faffe39_rle_crop_3970237771_0.png treat image : temp/1758555627_1011055_1385488243_399184446317b12541e91503e28b39dd_rle_crop_3970237772_0.png treat image : temp/1758555627_1011055_1385488166_dc063d1e7cd1adbe6ba5d6ddff9e352d_rle_crop_3970237774_0.png treat image : temp/1758555627_1011055_1385488130_5225bc0810ab9501acfe598b7424f4ff_rle_crop_3970237777_0.png treat image : temp/1758555627_1011055_1385488130_5225bc0810ab9501acfe598b7424f4ff_rle_crop_3970237778_0.png treat image : temp/1758555627_1011055_1385488105_b3fc6a6914a59e7dc44ceb2ebe564c02_rle_crop_3970237780_0.png treat image : temp/1758555627_1011055_1385487875_91130ac51bb52c3b47e8002a016a1ab9_rle_crop_3970237782_0.png treat image : temp/1758555627_1011055_1385487806_61faec67f5cd9edf323b77b15231af3a_rle_crop_3970237783_0.png treat image : temp/1758555627_1011055_1385487778_140b8f322b0d28b9679b9ba14e176350_rle_crop_3970237786_0.png treat image : temp/1758555627_1011055_1385489454_1683727fb8261e389ff4a4aac845d129_rle_crop_3970237716_0.png treat image : temp/1758555627_1011055_1385489277_24108aceba829c032fc246be5dc2906a_rle_crop_3970237731_0.png treat image : temp/1758555627_1011055_1385488649_0580ac16853de98c1a18ceb6e5e94180_rle_crop_3970237762_0.png treat image : temp/1758555627_1011055_1385488166_dc063d1e7cd1adbe6ba5d6ddff9e352d_rle_crop_3970237776_0.png treat image : temp/1758555627_1011055_1385487806_61faec67f5cd9edf323b77b15231af3a_rle_crop_3970237785_0.png treat image : temp/1758555627_1011055_1385488842_bbb7f25c850a7b949da579533c881830_rle_crop_3970237755_0.png treat image : temp/1758555627_1011055_1385487778_140b8f322b0d28b9679b9ba14e176350_rle_crop_3970237788_0.png treat image : temp/1758555627_1011055_1385489552_a92c0cf6a8733c26e9aa3786cccc2a6e_rle_crop_3970237714_0.png treat image : temp/1758555627_1011055_1385489454_1683727fb8261e389ff4a4aac845d129_rle_crop_3970237718_0.png treat image : temp/1758555627_1011055_1385489355_b985d07d57e677ba800cc6b8394a8477_rle_crop_3970237722_0.png treat image : temp/1758555627_1011055_1385489355_b985d07d57e677ba800cc6b8394a8477_rle_crop_3970237723_0.png treat image : temp/1758555627_1011055_1385489355_b985d07d57e677ba800cc6b8394a8477_rle_crop_3970237724_0.png treat image : temp/1758555627_1011055_1385489331_5b417812779932ea37b26fa011430867_rle_crop_3970237725_0.png treat image : temp/1758555627_1011055_1385489305_2535415be29c0e604281b31e918db1fb_rle_crop_3970237728_0.png treat image : temp/1758555627_1011055_1385489305_2535415be29c0e604281b31e918db1fb_rle_crop_3970237729_0.png treat image : temp/1758555627_1011055_1385489277_24108aceba829c032fc246be5dc2906a_rle_crop_3970237732_0.png treat image : temp/1758555627_1011055_1385489250_0bc9b0e9587eba623417c9b3ea9229c5_rle_crop_3970237736_0.png treat image : temp/1758555627_1011055_1385488967_902fdac790371068d6a79f111cf62f24_rle_crop_3970237739_0.png treat image : temp/1758555627_1011055_1385488967_902fdac790371068d6a79f111cf62f24_rle_crop_3970237740_0.png treat image : temp/1758555627_1011055_1385488942_c474995c67a4f759dc57f4446ed87ff7_rle_crop_3970237744_0.png treat image : temp/1758555627_1011055_1385488942_c474995c67a4f759dc57f4446ed87ff7_rle_crop_3970237746_0.png treat image : temp/1758555627_1011055_1385488893_bca019459c8ff1228bf81004682b7135_rle_crop_3970237749_0.png treat image : temp/1758555627_1011055_1385488893_bca019459c8ff1228bf81004682b7135_rle_crop_3970237751_0.png treat image : temp/1758555627_1011055_1385488867_4b910f2d30820bc2c42587b49e0d1d00_rle_crop_3970237752_0.png treat image : temp/1758555627_1011055_1385488842_bbb7f25c850a7b949da579533c881830_rle_crop_3970237756_0.png treat image : temp/1758555627_1011055_1385488663_99c7d9a20c26a2ef19a29991014dfc3b_rle_crop_3970237758_0.png treat image : temp/1758555627_1011055_1385488650_3860bf33f2b3e1222c1c52b2c7f02895_rle_crop_3970237760_0.png treat image : temp/1758555627_1011055_1385488612_eb8cc71707a6fde76a75ea594de4a330_rle_crop_3970237765_0.png treat image : temp/1758555627_1011055_1385488612_eb8cc71707a6fde76a75ea594de4a330_rle_crop_3970237767_0.png treat image : temp/1758555627_1011055_1385488281_d593ebe1a9c4d5357ab438654ecb5e7d_rle_crop_3970237769_0.png treat image : temp/1758555627_1011055_1385488243_399184446317b12541e91503e28b39dd_rle_crop_3970237773_0.png treat image : temp/1758555627_1011055_1385488166_dc063d1e7cd1adbe6ba5d6ddff9e352d_rle_crop_3970237775_0.png treat image : temp/1758555627_1011055_1385488130_5225bc0810ab9501acfe598b7424f4ff_rle_crop_3970237779_0.png treat image : temp/1758555627_1011055_1385487875_91130ac51bb52c3b47e8002a016a1ab9_rle_crop_3970237781_0.png treat image : temp/1758555627_1011055_1385487806_61faec67f5cd9edf323b77b15231af3a_rle_crop_3970237784_0.png treat image : temp/1758555627_1011055_1385487778_140b8f322b0d28b9679b9ba14e176350_rle_crop_3970237787_0.png treat image : temp/1758555627_1011055_1385488967_902fdac790371068d6a79f111cf62f24_rle_crop_3970237742_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 102 time used for this insertion : 0.016440391540527344 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 102 time used for this insertion : 0.028148651123046875 save missing photos in datou_result : time spend for datou_step_exec : 6.462055921554565 time spend to save output : 0.0505983829498291 total time spend for step 7 : 6.5126543045043945 step8:velours_tree Mon Sep 22 17:42:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.14438962936401367 time spend to save output : 4.2438507080078125e-05 total time spend for step 8 : 0.14443206787109375 step9:send_mail_cod Mon Sep 22 17:42:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P27099650_22-09-2025_17_42_44.pdf 27100103 change filename to text .change filename to text .imagette271001031758555764 27100104 imagette271001041758555765 27100105 imagette271001051758555765 27100106 change filename to text .imagette271001061758555765 27100108 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette271001081758555765 27100109 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette271001091758555766 27100110 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette271001101758555768 27100111 imagette271001111758555769 27100112 imagette271001121758555769 27100113 imagette271001131758555769 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=27099650 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/27100103,27100104,27100105,27100106,27100107,27100108,27100109,27100110,27100111,27100112,27100113?tags=metal,mal_croppe,background,autre,environnement,papier,pet_clair,carton,pehd,flou,pet_fonce args[1385489552] : ((1385489552, -4.170584743070964, 492609224), (1385489552, 0.25222311539714576, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385489454] : ((1385489454, -3.1599566076932315, 492609224), (1385489454, 0.16097320304612303, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385489355] : ((1385489355, -2.207668895682125, 492609224), (1385489355, 0.5072126246585139, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385489331] : ((1385489331, -2.3522318844759833, 492609224), (1385489331, 0.5559120138292089, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385489305] : ((1385489305, -2.3762216349692764, 492609224), (1385489305, 0.5828259328171764, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385489277] : ((1385489277, -4.040999328484105, 492609224), (1385489277, 0.44123667766866337, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385489250] : ((1385489250, -1.8367093736063034, 492688767), (1385489250, 0.35519789750051267, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385489225] : ((1385489225, -2.640272314657172, 492609224), (1385489225, 0.40638992574586125, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385488967] : ((1385488967, -1.8290103413578598, 492688767), (1385488967, 0.5194892505044431, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385488942] : ((1385488942, -2.2945753634589185, 492609224), (1385488942, 0.5536718202573406, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385488918] : ((1385488918, -2.482145414996438, 492609224), (1385488918, 0.42038909854232387, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385488893] : ((1385488893, -1.9092474397858363, 492688767), (1385488893, 0.3429569995551481, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385488867] : ((1385488867, -2.1495989368609525, 492609224), (1385488867, 0.3594401375014433, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385488842] : ((1385488842, -2.2390660736063803, 492609224), (1385488842, 0.405989563457209, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385488663] : ((1385488663, -2.132850553506551, 492609224), (1385488663, 0.592623179127803, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385488650] : ((1385488650, -1.7701357568257852, 492688767), (1385488650, 0.5429792733130627, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385488649] : ((1385488649, -4.167029619628642, 492609224), (1385488649, 0.36255633293580564, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385488612] : ((1385488612, -2.100316536870506, 492609224), (1385488612, 0.5617537547273751, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385488281] : ((1385488281, -2.5154737519516988, 492609224), (1385488281, 0.5738826145182058, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385488271] : ((1385488271, -1.8007848697217101, 492688767), (1385488271, 0.475237025920521, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385488243] : ((1385488243, -1.8873802268557252, 492688767), (1385488243, 0.4886065351629666, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385488166] : ((1385488166, -0.25004564260530565, 492688767), (1385488166, 0.31357335354073906, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385488130] : ((1385488130, -1.2918641929518637, 492688767), (1385488130, 0.3507329701403571, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385488105] : ((1385488105, -1.8228374197394317, 492688767), (1385488105, 0.4054816097049427, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385487875] : ((1385487875, -2.3419575224606466, 492609224), (1385487875, 0.5970814577329201, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385487806] : ((1385487806, -2.3541075672116007, 492609224), (1385487806, 0.6603092374632621, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com args[1385487778] : ((1385487778, 0.027101529829295493, 492688767), (1385487778, 0.3970125528571506, 2107752395), '0.06505486968449932') We are sending mail with results at report@fotonower.com refus_total : 0.06505486968449932 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=27099650 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27099650_22-09-2025_17_42_44.pdf results_Auto_P27099650_22-09-2025_17_42_44.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27099650_22-09-2025_17_42_44.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','27099650','results_Auto_P27099650_22-09-2025_17_42_44.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27099650_22-09-2025_17_42_44.pdf','pdf','','0.46','0.06505486968449932') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/27099650

https://www.fotonower.com/image?json=false&list_photos_id=1385489552
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385489454
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385489355
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385489331
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385489305
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385489277
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385489250
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385489225
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385488967
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385488942
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385488918
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385488893
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385488867
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385488842
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385488663
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385488650
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385488649
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385488612
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385488281
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385488271
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385488243
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385488166
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385488130
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385488105
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385487875
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385487806
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385487778
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 6.51%
Veuillez trouver les photos des contaminants.

exemples de contaminants: metal: https://www.fotonower.com/view/27100103?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/27100106?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/27100108?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/27100109?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/27100110?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27099650_22-09-2025_17_42_44.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/27100103,27100104,27100105,27100106,27100107,27100108,27100109,27100110,27100111,27100112,27100113?tags=metal,mal_croppe,background,autre,environnement,papier,pet_clair,carton,pehd,flou,pet_fonce.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 22 Sep 2025 15:42:51 GMT Content-Length: 0 Connection: close X-Message-Id: K0FJZUV1Sn2dsJqywBmyKg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1385489552, 1385489454, 1385489355, 1385489331, 1385489305, 1385489277, 1385489250, 1385489225, 1385488967, 1385488942, 1385488918, 1385488893, 1385488867, 1385488842, 1385488663, 1385488650, 1385488649, 1385488612, 1385488281, 1385488271, 1385488243, 1385488166, 1385488130, 1385488105, 1385487875, 1385487806, 1385487778] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489552', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489454', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489355', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489331', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489305', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489277', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489250', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489225', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488967', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488942', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488918', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488893', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488867', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488842', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488663', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488650', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488649', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488612', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488281', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488271', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488243', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488166', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488130', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488105', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385487875', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385487806', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385487778', None, None, None, None, None, '3759467') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.017658710479736328 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.003246307373047 time spend to save output : 0.01811695098876953 total time spend for step 9 : 7.021363258361816 step10:split_time_score Mon Sep 22 17:42:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('17', 27),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 22092025 27099650 Nombre de photos uploadées : 27 / 23040 (0%) 22092025 27099650 Nombre de photos taguées (types de déchets): 0 / 27 (0%) 22092025 27099650 Nombre de photos taguées (volume) : 0 / 27 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 6.4373016357421875e-06 ??????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0013012886047363281 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20974421501159668 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.05209852430555556 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27081911_22-09-2025_09_51_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27081911 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27081911 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27086455 order by id desc limit 1 Qualite : 0.11064838927469141 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27086457_22-09-2025_10_51_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27086457 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27086457 AND mptpi.`type`=3594 To do Qualite : 0.12047576678240735 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27096228_22-09-2025_17_11_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27096228 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27096228 AND mptpi.`type`=3594 To do Qualite : 0.07098423032407408 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27096232_22-09-2025_16_31_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27096232 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27096232 AND mptpi.`type`=3594 To do Qualite : 0.03187968474426807 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27096240_22-09-2025_16_22_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27096240 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27096240 AND mptpi.`type`=3594 To do Qualite : 0.06591898999183013 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27096242_22-09-2025_16_13_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27096242 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27096242 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27099648 order by id desc limit 1 Qualite : 0.06505486968449932 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27099650_22-09-2025_17_42_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27099650 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27099650 AND mptpi.`type`=3594 To do Qualite : 0.08340133101851852 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27099651_22-09-2025_17_31_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27099651 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27099651 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'22092025': {'nb_upload': 27, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1385489552, 1385489454, 1385489355, 1385489331, 1385489305, 1385489277, 1385489250, 1385489225, 1385488967, 1385488942, 1385488918, 1385488893, 1385488867, 1385488842, 1385488663, 1385488650, 1385488649, 1385488612, 1385488281, 1385488271, 1385488243, 1385488166, 1385488130, 1385488105, 1385487875, 1385487806, 1385487778] Looping around the photos to save general results len do output : 1 /27099650Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489552', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489454', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489355', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489331', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489305', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489277', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489250', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385489225', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488967', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488942', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488918', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488893', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488867', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488842', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488663', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488650', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488649', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488612', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488281', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488271', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488243', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488166', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488130', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385488105', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385487875', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385487806', None, None, None, None, None, '3759467') ('3318', None, None, None, None, None, None, None, '3759467') ('3318', '27099650', '1385487778', None, None, None, None, None, '3759467') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 28 time used for this insertion : 0.01995396614074707 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.977518081665039 time spend to save output : 0.02029109001159668 total time spend for step 10 : 2.9978091716766357 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 27 set_done_treatment 78.27user 37.03system 2:29.76elapsed 76%CPU (0avgtext+0avgdata 2959796maxresident)k 884064inputs+40728outputs (10504major+2464167minor)pagefaults 0swaps