python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2382335 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3726864'] with mtr_portfolio_ids : ['26882772'] and first list_photo_ids : [] new path : /proc/2382335/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 31 ; length of list_pids : 31 ; length of list_args : 31 time to download the photos : 4.095766067504883 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Sep 16 10:50:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10366 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-16 10:50:34.951962: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-16 10:50:34.980920: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-16 10:50:34.982809: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7efb40000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-16 10:50:34.982882: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-16 10:50:34.986226: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-16 10:50:35.113457: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xab27d80 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-16 10:50:35.113529: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-16 10:50:35.114609: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-16 10:50:35.114967: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-16 10:50:35.117244: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-16 10:50:35.119600: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-16 10:50:35.120123: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-16 10:50:35.122595: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-16 10:50:35.123862: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-16 10:50:35.128875: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-16 10:50:35.130523: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-16 10:50:35.130629: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-16 10:50:35.131429: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-16 10:50:35.131446: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-16 10:50:35.131455: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-16 10:50:35.133466: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9458 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-16 10:50:35.476911: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-16 10:50:35.477012: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-16 10:50:35.477036: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-16 10:50:35.477058: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-16 10:50:35.477079: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-16 10:50:35.477099: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-16 10:50:35.477120: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-16 10:50:35.477140: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-16 10:50:35.478699: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-16 10:50:35.480071: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-16 10:50:35.480122: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-16 10:50:35.480141: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-16 10:50:35.480158: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-16 10:50:35.480176: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-16 10:50:35.480193: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-16 10:50:35.480210: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-16 10:50:35.480227: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-16 10:50:35.481797: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-16 10:50:35.481833: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-16 10:50:35.481844: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-16 10:50:35.481854: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-16 10:50:35.483453: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9458 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-16 10:50:44.727302: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-16 10:50:44.946063: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 31 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 Detection mask done ! Trying to reset tf kernel 2382988 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 107 tf kernel not reseted sub process len(results) : 31 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 31 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5396 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0008788108825683594 nb_pixel_total : 35605 time to create 1 rle with old method : 0.04245710372924805 length of segment : 320 time for calcul the mask position with numpy : 0.00023698806762695312 nb_pixel_total : 9873 time to create 1 rle with old method : 0.011716127395629883 length of segment : 128 time for calcul the mask position with numpy : 0.00016260147094726562 nb_pixel_total : 6969 time to create 1 rle with old method : 0.008218050003051758 length of segment : 116 time for calcul the mask position with numpy : 9.417533874511719e-05 nb_pixel_total : 2631 time to create 1 rle with old method : 0.0032241344451904297 length of segment : 47 time for calcul the mask position with numpy : 0.00022840499877929688 nb_pixel_total : 10828 time to create 1 rle with old method : 0.01278543472290039 length of segment : 127 time for calcul the mask position with numpy : 0.00012731552124023438 nb_pixel_total : 5598 time to create 1 rle with old method : 0.0067899227142333984 length of segment : 123 time for calcul the mask position with numpy : 0.0001952648162841797 nb_pixel_total : 12332 time to create 1 rle with old method : 0.014253377914428711 length of segment : 159 time for calcul the mask position with numpy : 0.001905202865600586 nb_pixel_total : 113930 time to create 1 rle with old method : 0.12666606903076172 length of segment : 493 time for calcul the mask position with numpy : 0.00019240379333496094 nb_pixel_total : 12491 time to create 1 rle with old method : 0.014544486999511719 length of segment : 125 time for calcul the mask position with numpy : 0.001383066177368164 nb_pixel_total : 98251 time to create 1 rle with old method : 0.11058235168457031 length of segment : 514 time for calcul the mask position with numpy : 0.00011491775512695312 nb_pixel_total : 5522 time to create 1 rle with old method : 0.006473541259765625 length of segment : 91 time for calcul the mask position with numpy : 0.00036716461181640625 nb_pixel_total : 26978 time to create 1 rle with old method : 0.03130912780761719 length of segment : 150 time for calcul the mask position with numpy : 0.00011968612670898438 nb_pixel_total : 5532 time to create 1 rle with old method : 0.006493091583251953 length of segment : 148 time for calcul the mask position with numpy : 0.00019288063049316406 nb_pixel_total : 12659 time to create 1 rle with old method : 0.014769554138183594 length of segment : 105 time for calcul the mask position with numpy : 0.012616634368896484 nb_pixel_total : 748241 time to create 1 rle with new method : 0.3173251152038574 length of segment : 1010 time for calcul the mask position with numpy : 0.00015735626220703125 nb_pixel_total : 6946 time to create 1 rle with old method : 0.00820612907409668 length of segment : 114 time for calcul the mask position with numpy : 0.011378765106201172 nb_pixel_total : 833133 time to create 1 rle with new method : 0.019499778747558594 length of segment : 1112 time for calcul the mask position with numpy : 0.001528024673461914 nb_pixel_total : 116853 time to create 1 rle with old method : 0.12911653518676758 length of segment : 541 time for calcul the mask position with numpy : 0.00018477439880371094 nb_pixel_total : 6444 time to create 1 rle with old method : 0.0076694488525390625 length of segment : 158 time for calcul the mask position with numpy : 0.00018835067749023438 nb_pixel_total : 8134 time to create 1 rle with old method : 0.009607553482055664 length of segment : 117 time for calcul the mask position with numpy : 0.00026798248291015625 nb_pixel_total : 10910 time to create 1 rle with old method : 0.012972116470336914 length of segment : 178 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 3198 time to create 1 rle with old method : 0.0039288997650146484 length of segment : 52 time for calcul the mask position with numpy : 0.0002288818359375 nb_pixel_total : 14633 time to create 1 rle with old method : 0.01681971549987793 length of segment : 161 time for calcul the mask position with numpy : 0.0014195442199707031 nb_pixel_total : 110487 time to create 1 rle with old method : 0.15398645401000977 length of segment : 502 time for calcul the mask position with numpy : 0.00025153160095214844 nb_pixel_total : 9212 time to create 1 rle with old method : 0.010738611221313477 length of segment : 71 time for calcul the mask position with numpy : 0.0002753734588623047 nb_pixel_total : 8172 time to create 1 rle with old method : 0.009536027908325195 length of segment : 104 time for calcul the mask position with numpy : 0.0003762245178222656 nb_pixel_total : 13581 time to create 1 rle with old method : 0.016299009323120117 length of segment : 97 time for calcul the mask position with numpy : 0.0002613067626953125 nb_pixel_total : 10157 time to create 1 rle with old method : 0.012126445770263672 length of segment : 69 time for calcul the mask position with numpy : 0.00029540061950683594 nb_pixel_total : 7759 time to create 1 rle with old method : 0.009211301803588867 length of segment : 112 time for calcul the mask position with numpy : 0.0025849342346191406 nb_pixel_total : 112981 time to create 1 rle with old method : 0.12874484062194824 length of segment : 545 time for calcul the mask position with numpy : 0.0019321441650390625 nb_pixel_total : 108957 time to create 1 rle with old method : 0.16450881958007812 length of segment : 509 time for calcul the mask position with numpy : 0.0006268024444580078 nb_pixel_total : 18447 time to create 1 rle with old method : 0.02194070816040039 length of segment : 100 time for calcul the mask position with numpy : 0.0006406307220458984 nb_pixel_total : 22173 time to create 1 rle with old method : 0.025210857391357422 length of segment : 184 time for calcul the mask position with numpy : 0.002399444580078125 nb_pixel_total : 102795 time to create 1 rle with old method : 0.11511683464050293 length of segment : 501 time for calcul the mask position with numpy : 0.0007545948028564453 nb_pixel_total : 17285 time to create 1 rle with old method : 0.01905059814453125 length of segment : 205 time for calcul the mask position with numpy : 0.00031876564025878906 nb_pixel_total : 8807 time to create 1 rle with old method : 0.009595394134521484 length of segment : 181 time for calcul the mask position with numpy : 0.0025284290313720703 nb_pixel_total : 111556 time to create 1 rle with old method : 0.11876630783081055 length of segment : 555 time for calcul the mask position with numpy : 0.0003218650817871094 nb_pixel_total : 8757 time to create 1 rle with old method : 0.009792089462280273 length of segment : 175 time for calcul the mask position with numpy : 0.0006456375122070312 nb_pixel_total : 13096 time to create 1 rle with old method : 0.015424013137817383 length of segment : 176 time for calcul the mask position with numpy : 0.0002391338348388672 nb_pixel_total : 4251 time to create 1 rle with old method : 0.004994630813598633 length of segment : 80 time for calcul the mask position with numpy : 0.00025582313537597656 nb_pixel_total : 7372 time to create 1 rle with old method : 0.008702754974365234 length of segment : 65 time for calcul the mask position with numpy : 0.0026657581329345703 nb_pixel_total : 103514 time to create 1 rle with old method : 0.10968255996704102 length of segment : 571 time for calcul the mask position with numpy : 0.00023889541625976562 nb_pixel_total : 7603 time to create 1 rle with old method : 0.008502483367919922 length of segment : 68 time for calcul the mask position with numpy : 0.0003859996795654297 nb_pixel_total : 7239 time to create 1 rle with old method : 0.00811910629272461 length of segment : 106 time for calcul the mask position with numpy : 0.0005066394805908203 nb_pixel_total : 10380 time to create 1 rle with old method : 0.0113372802734375 length of segment : 177 time for calcul the mask position with numpy : 0.002718210220336914 nb_pixel_total : 111362 time to create 1 rle with old method : 0.12274479866027832 length of segment : 548 time for calcul the mask position with numpy : 0.0017547607421875 nb_pixel_total : 120005 time to create 1 rle with old method : 0.1326131820678711 length of segment : 557 time for calcul the mask position with numpy : 0.00023818016052246094 nb_pixel_total : 3757 time to create 1 rle with old method : 0.004599332809448242 length of segment : 89 time for calcul the mask position with numpy : 0.00048613548278808594 nb_pixel_total : 9586 time to create 1 rle with old method : 0.011214256286621094 length of segment : 182 time for calcul the mask position with numpy : 0.00028514862060546875 nb_pixel_total : 4718 time to create 1 rle with old method : 0.0056917667388916016 length of segment : 141 time for calcul the mask position with numpy : 0.0004394054412841797 nb_pixel_total : 15646 time to create 1 rle with old method : 0.019187450408935547 length of segment : 166 time for calcul the mask position with numpy : 0.0002605915069580078 nb_pixel_total : 4468 time to create 1 rle with old method : 0.005258798599243164 length of segment : 138 time for calcul the mask position with numpy : 0.002409219741821289 nb_pixel_total : 107534 time to create 1 rle with old method : 0.1290581226348877 length of segment : 538 time for calcul the mask position with numpy : 0.00033664703369140625 nb_pixel_total : 10726 time to create 1 rle with old method : 0.012502908706665039 length of segment : 164 time for calcul the mask position with numpy : 0.0027458667755126953 nb_pixel_total : 106434 time to create 1 rle with old method : 0.13440775871276855 length of segment : 553 time for calcul the mask position with numpy : 0.001062631607055664 nb_pixel_total : 26556 time to create 1 rle with old method : 0.030230998992919922 length of segment : 337 time for calcul the mask position with numpy : 0.0002980232238769531 nb_pixel_total : 5088 time to create 1 rle with old method : 0.0061609745025634766 length of segment : 102 time for calcul the mask position with numpy : 0.00013208389282226562 nb_pixel_total : 2927 time to create 1 rle with old method : 0.0036945343017578125 length of segment : 53 time for calcul the mask position with numpy : 0.00026416778564453125 nb_pixel_total : 6840 time to create 1 rle with old method : 0.008466482162475586 length of segment : 106 time for calcul the mask position with numpy : 0.00033855438232421875 nb_pixel_total : 9611 time to create 1 rle with old method : 0.011436939239501953 length of segment : 122 time for calcul the mask position with numpy : 0.00029015541076660156 nb_pixel_total : 6115 time to create 1 rle with old method : 0.007264852523803711 length of segment : 115 time for calcul the mask position with numpy : 0.0022859573364257812 nb_pixel_total : 103665 time to create 1 rle with old method : 0.1177663803100586 length of segment : 527 time for calcul the mask position with numpy : 0.00026345252990722656 nb_pixel_total : 8807 time to create 1 rle with old method : 0.010470390319824219 length of segment : 79 time for calcul the mask position with numpy : 0.0005471706390380859 nb_pixel_total : 10817 time to create 1 rle with old method : 0.013668060302734375 length of segment : 182 time for calcul the mask position with numpy : 0.0003464221954345703 nb_pixel_total : 7451 time to create 1 rle with old method : 0.00877070426940918 length of segment : 129 time for calcul the mask position with numpy : 0.00046753883361816406 nb_pixel_total : 14501 time to create 1 rle with old method : 0.016994714736938477 length of segment : 203 time for calcul the mask position with numpy : 0.0002002716064453125 nb_pixel_total : 3029 time to create 1 rle with old method : 0.003651857376098633 length of segment : 95 time for calcul the mask position with numpy : 0.0023963451385498047 nb_pixel_total : 108734 time to create 1 rle with old method : 0.12989044189453125 length of segment : 538 time for calcul the mask position with numpy : 0.0009026527404785156 nb_pixel_total : 30267 time to create 1 rle with old method : 0.034479379653930664 length of segment : 228 time for calcul the mask position with numpy : 0.0004603862762451172 nb_pixel_total : 8853 time to create 1 rle with old method : 0.01053619384765625 length of segment : 161 time spent for convertir_results : 5.847779035568237 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 70 chid ids of type : 3594 Number RLEs to save : 17295 save missing photos in datou_result : time spend for datou_step_exec : 39.630197048187256 time spend to save output : 1.3545684814453125 total time spend for step 1 : 40.98476552963257 step2:crop_condition Tue Sep 16 10:51:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 31 ! batch 1 Loaded 70 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 26 About to insert : list_path_to_insert length 26 new photo from crops ! About to upload 26 photos upload in portfolio : 3736932 init cache_photo without model_param we have 26 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758012675_2382335 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 26 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.77113151550293 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758012684_2382335 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2410337924957275 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 36 About to insert : list_path_to_insert length 36 new photo from crops ! About to upload 36 photos upload in portfolio : 3736932 init cache_photo without model_param we have 36 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758012700_2382335 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 36 photos in the portfolio 3736932 time of upload the photos Elapsed time : 11.785965204238892 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758012713_2382335 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.3392069339752197 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758012715_2382335 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7552673816680908 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1383857531, 1383857489, 1383857486, 1383857483, 1383857479, 1383857460, 1383857315, 1383857305, 1383857301, 1383857297, 1383857293, 1383857290, 1383857230, 1383857220, 1383857212, 1383857205, 1383857087, 1383857057, 1383857046, 1383857036, 1383857022, 1383857004, 1383856968, 1383856966, 1383856964, 1383856962, 1383856960, 1383856958, 1383856843, 1383856755, 1383856746] Looping around the photos to save general results len do output : 70 /1383879611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383879740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857531', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857489', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857486', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857483', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857479', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857460', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857315', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857305', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857301', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857297', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857293', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857290', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857230', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857220', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857212', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857205', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857087', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857057', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857046', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857036', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857022', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857004', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856968', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856966', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856964', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856962', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856960', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856958', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856843', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856755', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856746', None, None, None, None, None, '3726864') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 241 time used for this insertion : 0.3684861660003662 save_final save missing photos in datou_result : time spend for datou_step_exec : 42.41930818557739 time spend to save output : 0.3717072010040283 total time spend for step 2 : 42.79101538658142 step3:rle_unique_nms_with_priority Tue Sep 16 10:51:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 70 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.1404266357421875 time for calcul the mask position with numpy : 0.34827232360839844 nb_pixel_total : 2037995 time to create 1 rle with new method : 0.11931419372558594 time for calcul the mask position with numpy : 0.007440805435180664 nb_pixel_total : 35605 time to create 1 rle with old method : 0.04022026062011719 create new chi : 0.5263442993164062 time to delete rle : 0.021538972854614258 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1720 TO DO : save crop sub photo not yet done ! save time : 0.29900336265563965 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.2430133819580078 time for calcul the mask position with numpy : 0.08952736854553223 nb_pixel_total : 2043299 time to create 1 rle with new method : 0.11247134208679199 time for calcul the mask position with numpy : 0.006428241729736328 nb_pixel_total : 10828 time to create 1 rle with old method : 0.01242518424987793 time for calcul the mask position with numpy : 0.006554841995239258 nb_pixel_total : 2631 time to create 1 rle with old method : 0.003151416778564453 time for calcul the mask position with numpy : 0.006489753723144531 nb_pixel_total : 6969 time to create 1 rle with old method : 0.008376598358154297 time for calcul the mask position with numpy : 0.0068340301513671875 nb_pixel_total : 9873 time to create 1 rle with old method : 0.012447357177734375 create new chi : 0.2757883071899414 time to delete rle : 0.00043964385986328125 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 1916 TO DO : save crop sub photo not yet done ! save time : 0.26520466804504395 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.05805373191833496 time for calcul the mask position with numpy : 0.06816458702087402 nb_pixel_total : 1941740 time to create 1 rle with new method : 0.29111623764038086 time for calcul the mask position with numpy : 0.006752490997314453 nb_pixel_total : 113930 time to create 1 rle with old method : 0.1302649974822998 time for calcul the mask position with numpy : 0.00640106201171875 nb_pixel_total : 12332 time to create 1 rle with old method : 0.013908863067626953 time for calcul the mask position with numpy : 0.00601506233215332 nb_pixel_total : 5598 time to create 1 rle with old method : 0.00623631477355957 create new chi : 0.539271354675293 time to delete rle : 0.0004169940948486328 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2630 TO DO : save crop sub photo not yet done ! save time : 0.40654611587524414 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04287981986999512 time for calcul the mask position with numpy : 0.01885080337524414 nb_pixel_total : 1962858 time to create 1 rle with new method : 0.25202393531799316 time for calcul the mask position with numpy : 0.006880521774291992 nb_pixel_total : 98251 time to create 1 rle with old method : 0.11076712608337402 time for calcul the mask position with numpy : 0.006597995758056641 nb_pixel_total : 12491 time to create 1 rle with old method : 0.014109373092651367 create new chi : 0.40967750549316406 time to delete rle : 0.0004029273986816406 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2358 TO DO : save crop sub photo not yet done ! save time : 0.17855334281921387 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.2781994342803955 time for calcul the mask position with numpy : 0.0928654670715332 nb_pixel_total : 2041100 time to create 1 rle with new method : 0.13239026069641113 time for calcul the mask position with numpy : 0.00812220573425293 nb_pixel_total : 26978 time to create 1 rle with old method : 0.033234596252441406 time for calcul the mask position with numpy : 0.0066204071044921875 nb_pixel_total : 5522 time to create 1 rle with old method : 0.006413936614990234 create new chi : 0.292651891708374 time to delete rle : 0.0003559589385986328 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1562 TO DO : save crop sub photo not yet done ! save time : 0.14931249618530273 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.1380784511566162 time for calcul the mask position with numpy : 0.18311858177185059 nb_pixel_total : 1312025 time to create 1 rle with new method : 0.2107243537902832 time for calcul the mask position with numpy : 0.012603998184204102 nb_pixel_total : 743384 time to create 1 rle with new method : 0.11480569839477539 time for calcul the mask position with numpy : 0.006476402282714844 nb_pixel_total : 12659 time to create 1 rle with old method : 0.014476299285888672 time for calcul the mask position with numpy : 0.006568193435668945 nb_pixel_total : 5532 time to create 1 rle with old method : 0.006265401840209961 create new chi : 0.5656511783599854 time to delete rle : 0.0005805492401123047 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3605 TO DO : save crop sub photo not yet done ! save time : 0.26810240745544434 No data in photo_id : 1383857315 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04975008964538574 time for calcul the mask position with numpy : 0.01594233512878418 nb_pixel_total : 1233711 time to create 1 rle with new method : 0.14833927154541016 time for calcul the mask position with numpy : 0.012587785720825195 nb_pixel_total : 832943 time to create 1 rle with new method : 0.13587617874145508 time for calcul the mask position with numpy : 0.00655055046081543 nb_pixel_total : 6946 time to create 1 rle with old method : 0.008086919784545898 create new chi : 0.33522677421569824 time to delete rle : 0.0005879402160644531 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 3497 TO DO : save crop sub photo not yet done ! save time : 0.4085354804992676 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.06447458267211914 time for calcul the mask position with numpy : 0.32320308685302734 nb_pixel_total : 1956747 time to create 1 rle with new method : 0.2859957218170166 time for calcul the mask position with numpy : 0.00716710090637207 nb_pixel_total : 116853 time to create 1 rle with old method : 0.13466835021972656 create new chi : 0.761782169342041 time to delete rle : 0.0006208419799804688 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2162 TO DO : save crop sub photo not yet done ! save time : 0.23436307907104492 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.2216188907623291 time for calcul the mask position with numpy : 0.0707705020904541 nb_pixel_total : 2048112 time to create 1 rle with new method : 0.24663567543029785 time for calcul the mask position with numpy : 0.0076406002044677734 nb_pixel_total : 10910 time to create 1 rle with old method : 0.012665987014770508 time for calcul the mask position with numpy : 0.006530046463012695 nb_pixel_total : 8134 time to create 1 rle with old method : 0.00920867919921875 time for calcul the mask position with numpy : 0.0065228939056396484 nb_pixel_total : 6444 time to create 1 rle with old method : 0.007884025573730469 create new chi : 0.3807516098022461 time to delete rle : 0.0004038810729980469 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1986 TO DO : save crop sub photo not yet done ! save time : 0.2662231922149658 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04456496238708496 time for calcul the mask position with numpy : 0.28853869438171387 nb_pixel_total : 2055769 time to create 1 rle with new method : 0.08243465423583984 time for calcul the mask position with numpy : 0.006319284439086914 nb_pixel_total : 14633 time to create 1 rle with old method : 0.017538070678710938 time for calcul the mask position with numpy : 0.006250858306884766 nb_pixel_total : 3198 time to create 1 rle with old method : 0.004409313201904297 create new chi : 0.4161064624786377 time to delete rle : 0.00032019615173339844 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1506 TO DO : save crop sub photo not yet done ! save time : 0.16776561737060547 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.25189971923828125 time for calcul the mask position with numpy : 0.2639145851135254 nb_pixel_total : 1932148 time to create 1 rle with new method : 0.10259437561035156 time for calcul the mask position with numpy : 0.006276130676269531 nb_pixel_total : 13581 time to create 1 rle with old method : 0.015624761581420898 time for calcul the mask position with numpy : 0.006669521331787109 nb_pixel_total : 8172 time to create 1 rle with old method : 0.009454727172851562 time for calcul the mask position with numpy : 0.006982326507568359 nb_pixel_total : 9212 time to create 1 rle with old method : 0.01132965087890625 time for calcul the mask position with numpy : 0.00783991813659668 nb_pixel_total : 110487 time to create 1 rle with old method : 0.1250154972076416 create new chi : 0.5677392482757568 time to delete rle : 0.0004334449768066406 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2628 TO DO : save crop sub photo not yet done ! save time : 0.27597975730895996 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.31244969367980957 time for calcul the mask position with numpy : 0.0766596794128418 nb_pixel_total : 1938043 time to create 1 rle with new method : 0.23565292358398438 time for calcul the mask position with numpy : 0.006565570831298828 nb_pixel_total : 4660 time to create 1 rle with old method : 0.005682706832885742 time for calcul the mask position with numpy : 0.007560253143310547 nb_pixel_total : 112981 time to create 1 rle with old method : 0.1287088394165039 time for calcul the mask position with numpy : 0.011092185974121094 nb_pixel_total : 7759 time to create 1 rle with old method : 0.008782386779785156 time for calcul the mask position with numpy : 0.006536006927490234 nb_pixel_total : 10157 time to create 1 rle with old method : 0.011751651763916016 create new chi : 0.5105307102203369 time to delete rle : 0.0006234645843505859 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3085 TO DO : save crop sub photo not yet done ! save time : 0.2705724239349365 No data in photo_id : 1383857220 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.07217192649841309 time for calcul the mask position with numpy : 0.03291821479797363 nb_pixel_total : 2032980 time to create 1 rle with new method : 0.08649492263793945 time for calcul the mask position with numpy : 0.006659507751464844 nb_pixel_total : 22173 time to create 1 rle with old method : 0.02499556541442871 time for calcul the mask position with numpy : 0.006982088088989258 nb_pixel_total : 18447 time to create 1 rle with old method : 0.02361297607421875 create new chi : 0.18205904960632324 time to delete rle : 0.0003597736358642578 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1648 TO DO : save crop sub photo not yet done ! save time : 0.15331125259399414 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.5874497890472412 time for calcul the mask position with numpy : 0.2524731159210205 nb_pixel_total : 1944713 time to create 1 rle with new method : 0.3325474262237549 time for calcul the mask position with numpy : 0.006616115570068359 nb_pixel_total : 8807 time to create 1 rle with old method : 0.009955644607543945 time for calcul the mask position with numpy : 0.006681203842163086 nb_pixel_total : 17285 time to create 1 rle with old method : 0.020257949829101562 time for calcul the mask position with numpy : 0.007709980010986328 nb_pixel_total : 102795 time to create 1 rle with old method : 0.12244987487792969 create new chi : 0.7693896293640137 time to delete rle : 0.0004951953887939453 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2854 TO DO : save crop sub photo not yet done ! save time : 0.25866127014160156 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.08571457862854004 time for calcul the mask position with numpy : 0.34105753898620605 nb_pixel_total : 1953287 time to create 1 rle with new method : 0.10860276222229004 time for calcul the mask position with numpy : 0.0066411495208740234 nb_pixel_total : 8757 time to create 1 rle with old method : 0.011785030364990234 time for calcul the mask position with numpy : 0.007006645202636719 nb_pixel_total : 111556 time to create 1 rle with old method : 0.1455388069152832 create new chi : 0.62996506690979 time to delete rle : 0.0011165142059326172 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2540 TO DO : save crop sub photo not yet done ! save time : 0.20802545547485352 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.2722184658050537 time for calcul the mask position with numpy : 0.06564211845397949 nb_pixel_total : 2060504 time to create 1 rle with new method : 0.27916646003723145 time for calcul the mask position with numpy : 0.006125688552856445 nb_pixel_total : 13096 time to create 1 rle with old method : 0.014794349670410156 create new chi : 0.37598752975463867 time to delete rle : 0.00029087066650390625 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1432 TO DO : save crop sub photo not yet done ! save time : 0.8111557960510254 No data in photo_id : 1383857046 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.45607876777648926 time for calcul the mask position with numpy : 0.23552799224853516 nb_pixel_total : 1958463 time to create 1 rle with new method : 0.08220243453979492 time for calcul the mask position with numpy : 0.0064907073974609375 nb_pixel_total : 103514 time to create 1 rle with old method : 0.11501240730285645 time for calcul the mask position with numpy : 0.007739067077636719 nb_pixel_total : 7372 time to create 1 rle with old method : 0.009851455688476562 time for calcul the mask position with numpy : 0.0062863826751708984 nb_pixel_total : 4251 time to create 1 rle with old method : 0.004860877990722656 create new chi : 0.4789102077484131 time to delete rle : 0.0004477500915527344 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2512 TO DO : save crop sub photo not yet done ! save time : 0.617457389831543 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.036156654357910156 time for calcul the mask position with numpy : 0.02028346061706543 nb_pixel_total : 2065997 time to create 1 rle with new method : 0.12151861190795898 time for calcul the mask position with numpy : 0.011808395385742188 nb_pixel_total : 7603 time to create 1 rle with old method : 0.01271820068359375 create new chi : 0.17519283294677734 time to delete rle : 0.0003437995910644531 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1216 TO DO : save crop sub photo not yet done ! save time : 0.3054068088531494 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.38843846321105957 time for calcul the mask position with numpy : 0.2152559757232666 nb_pixel_total : 1934170 time to create 1 rle with new method : 0.08710169792175293 time for calcul the mask position with numpy : 0.0063855648040771484 nb_pixel_total : 10449 time to create 1 rle with old method : 0.012261152267456055 time for calcul the mask position with numpy : 0.00746464729309082 nb_pixel_total : 111362 time to create 1 rle with old method : 0.12516498565673828 time for calcul the mask position with numpy : 0.007000446319580078 nb_pixel_total : 10380 time to create 1 rle with old method : 0.01286458969116211 time for calcul the mask position with numpy : 0.007376909255981445 nb_pixel_total : 7239 time to create 1 rle with old method : 0.008462905883789062 create new chi : 0.500145673751831 time to delete rle : 0.0006055831909179688 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 3367 TO DO : save crop sub photo not yet done ! save time : 0.6789000034332275 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.05627632141113281 time for calcul the mask position with numpy : 0.020563125610351562 nb_pixel_total : 2055539 time to create 1 rle with new method : 0.0790555477142334 time for calcul the mask position with numpy : 0.0060994625091552734 nb_pixel_total : 4718 time to create 1 rle with old method : 0.00541377067565918 time for calcul the mask position with numpy : 0.00625300407409668 nb_pixel_total : 9586 time to create 1 rle with old method : 0.010859251022338867 time for calcul the mask position with numpy : 0.006094932556152344 nb_pixel_total : 3757 time to create 1 rle with old method : 0.004289388656616211 create new chi : 0.14578700065612793 time to delete rle : 0.00035762786865234375 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1904 TO DO : save crop sub photo not yet done ! save time : 0.1612083911895752 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.2657504081726074 time for calcul the mask position with numpy : 0.29323792457580566 nb_pixel_total : 2053486 time to create 1 rle with new method : 0.26680445671081543 time for calcul the mask position with numpy : 0.0064296722412109375 nb_pixel_total : 4468 time to create 1 rle with old method : 0.005015373229980469 time for calcul the mask position with numpy : 0.006733417510986328 nb_pixel_total : 15646 time to create 1 rle with old method : 0.01763916015625 create new chi : 0.6064081192016602 time to delete rle : 0.00032067298889160156 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1688 TO DO : save crop sub photo not yet done ! save time : 0.2938263416290283 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.07444047927856445 time for calcul the mask position with numpy : 0.07033491134643555 nb_pixel_total : 1955340 time to create 1 rle with new method : 0.19963788986206055 time for calcul the mask position with numpy : 0.006540775299072266 nb_pixel_total : 10726 time to create 1 rle with old method : 0.012179136276245117 time for calcul the mask position with numpy : 0.006830692291259766 nb_pixel_total : 107534 time to create 1 rle with old method : 0.12083053588867188 create new chi : 0.4275181293487549 time to delete rle : 0.0005044937133789062 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2484 TO DO : save crop sub photo not yet done ! save time : 0.19278550148010254 No data in photo_id : 1383856962 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.15794038772583008 time for calcul the mask position with numpy : 0.0718984603881836 nb_pixel_total : 1932595 time to create 1 rle with new method : 0.25716161727905273 time for calcul the mask position with numpy : 0.006228446960449219 nb_pixel_total : 2927 time to create 1 rle with old method : 0.0033092498779296875 time for calcul the mask position with numpy : 0.0061228275299072266 nb_pixel_total : 5088 time to create 1 rle with old method : 0.005547761917114258 time for calcul the mask position with numpy : 0.0062007904052734375 nb_pixel_total : 26556 time to create 1 rle with old method : 0.02981734275817871 time for calcul the mask position with numpy : 0.006688117980957031 nb_pixel_total : 106434 time to create 1 rle with old method : 0.11940693855285645 create new chi : 0.5231657028198242 time to delete rle : 0.0005612373352050781 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 3170 TO DO : save crop sub photo not yet done ! save time : 0.2801952362060547 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.05033135414123535 time for calcul the mask position with numpy : 0.12856245040893555 nb_pixel_total : 2051034 time to create 1 rle with new method : 0.08609414100646973 time for calcul the mask position with numpy : 0.006526947021484375 nb_pixel_total : 6115 time to create 1 rle with old method : 0.006968259811401367 time for calcul the mask position with numpy : 0.00647425651550293 nb_pixel_total : 9611 time to create 1 rle with old method : 0.012553691864013672 time for calcul the mask position with numpy : 0.00652003288269043 nb_pixel_total : 6840 time to create 1 rle with old method : 0.010742425918579102 create new chi : 0.27582454681396484 time to delete rle : 0.00043082237243652344 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1766 TO DO : save crop sub photo not yet done ! save time : 0.2185077667236328 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.050119876861572266 time for calcul the mask position with numpy : 0.06723499298095703 nb_pixel_total : 1950311 time to create 1 rle with new method : 0.15552258491516113 time for calcul the mask position with numpy : 0.006289005279541016 nb_pixel_total : 10817 time to create 1 rle with old method : 0.012256145477294922 time for calcul the mask position with numpy : 0.006284236907958984 nb_pixel_total : 8807 time to create 1 rle with old method : 0.010046720504760742 time for calcul the mask position with numpy : 0.007190227508544922 nb_pixel_total : 103665 time to create 1 rle with old method : 0.11907672882080078 create new chi : 0.39328765869140625 time to delete rle : 0.00043129920959472656 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2656 TO DO : save crop sub photo not yet done ! save time : 0.3903179168701172 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.050553083419799805 time for calcul the mask position with numpy : 0.02356433868408203 nb_pixel_total : 2051648 time to create 1 rle with new method : 0.33617353439331055 time for calcul the mask position with numpy : 0.006274223327636719 nb_pixel_total : 14501 time to create 1 rle with old method : 0.016310453414916992 time for calcul the mask position with numpy : 0.0060672760009765625 nb_pixel_total : 7451 time to create 1 rle with old method : 0.00825953483581543 create new chi : 0.4076206684112549 time to delete rle : 0.0003399848937988281 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1744 TO DO : save crop sub photo not yet done ! save time : 0.16302919387817383 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.6555864810943604 time for calcul the mask position with numpy : 0.12826037406921387 nb_pixel_total : 1922717 time to create 1 rle with new method : 0.2723119258880615 time for calcul the mask position with numpy : 0.006136417388916016 nb_pixel_total : 8853 time to create 1 rle with old method : 0.009859800338745117 time for calcul the mask position with numpy : 0.006458759307861328 nb_pixel_total : 30267 time to create 1 rle with old method : 0.03330850601196289 time for calcul the mask position with numpy : 0.0065975189208984375 nb_pixel_total : 108734 time to create 1 rle with old method : 0.11885571479797363 time for calcul the mask position with numpy : 0.006264686584472656 nb_pixel_total : 3029 time to create 1 rle with old method : 0.0033423900604248047 create new chi : 0.6025443077087402 time to delete rle : 0.0005433559417724609 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3124 TO DO : save crop sub photo not yet done ! save time : 0.36739134788513184 map_output_result : {1383857531: (0.0, 'Should be the crop_list due to order', 0), 1383857489: (0.0, 'Should be the crop_list due to order', 0), 1383857486: (0.0, 'Should be the crop_list due to order', 0), 1383857483: (0.0, 'Should be the crop_list due to order', 0), 1383857479: (0.0, 'Should be the crop_list due to order', 0), 1383857460: (0.0, 'Should be the crop_list due to order', 0), 1383857315: (0.0, 'Should be the crop_list due to order', 0.0), 1383857305: (0.0, 'Should be the crop_list due to order', 0), 1383857301: (0.0, 'Should be the crop_list due to order', 0), 1383857297: (0.0, 'Should be the crop_list due to order', 0), 1383857293: (0.0, 'Should be the crop_list due to order', 0), 1383857290: (0.0, 'Should be the crop_list due to order', 0), 1383857230: (0.0, 'Should be the crop_list due to order', 0), 1383857220: (0.0, 'Should be the crop_list due to order', 0.0), 1383857212: (0.0, 'Should be the crop_list due to order', 0), 1383857205: (0.0, 'Should be the crop_list due to order', 0), 1383857087: (0.0, 'Should be the crop_list due to order', 0), 1383857057: (0.0, 'Should be the crop_list due to order', 0), 1383857046: (0.0, 'Should be the crop_list due to order', 0.0), 1383857036: (0.0, 'Should be the crop_list due to order', 0), 1383857022: (0.0, 'Should be the crop_list due to order', 0), 1383857004: (0.0, 'Should be the crop_list due to order', 0), 1383856968: (0.0, 'Should be the crop_list due to order', 0), 1383856966: (0.0, 'Should be the crop_list due to order', 0), 1383856964: (0.0, 'Should be the crop_list due to order', 0), 1383856962: (0.0, 'Should be the crop_list due to order', 0.0), 1383856960: (0.0, 'Should be the crop_list due to order', 0), 1383856958: (0.0, 'Should be the crop_list due to order', 0), 1383856843: (0.0, 'Should be the crop_list due to order', 0), 1383856755: (0.0, 'Should be the crop_list due to order', 0), 1383856746: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1383857531, 1383857489, 1383857486, 1383857483, 1383857479, 1383857460, 1383857315, 1383857305, 1383857301, 1383857297, 1383857293, 1383857290, 1383857230, 1383857220, 1383857212, 1383857205, 1383857087, 1383857057, 1383857046, 1383857036, 1383857022, 1383857004, 1383856968, 1383856966, 1383856964, 1383856962, 1383856960, 1383856958, 1383856843, 1383856755, 1383856746] Looping around the photos to save general results len do output : 31 /1383857531.Didn't retrieve data . /1383857489.Didn't retrieve data . /1383857486.Didn't retrieve data . /1383857483.Didn't retrieve data . /1383857479.Didn't retrieve data . /1383857460.Didn't retrieve data . /1383857315.Didn't retrieve data . /1383857305.Didn't retrieve data . /1383857301.Didn't retrieve data . /1383857297.Didn't retrieve data . /1383857293.Didn't retrieve data . /1383857290.Didn't retrieve data . /1383857230.Didn't retrieve data . /1383857220.Didn't retrieve data . /1383857212.Didn't retrieve data . /1383857205.Didn't retrieve data . /1383857087.Didn't retrieve data . /1383857057.Didn't retrieve data . /1383857046.Didn't retrieve data . /1383857036.Didn't retrieve data . /1383857022.Didn't retrieve data . /1383857004.Didn't retrieve data . /1383856968.Didn't retrieve data . /1383856966.Didn't retrieve data . /1383856964.Didn't retrieve data . /1383856962.Didn't retrieve data . /1383856960.Didn't retrieve data . /1383856958.Didn't retrieve data . /1383856843.Didn't retrieve data . /1383856755.Didn't retrieve data . /1383856746.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857531', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857489', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857486', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857483', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857479', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857460', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857315', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857305', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857301', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857297', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857293', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857290', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857230', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857220', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857212', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857205', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857087', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857057', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857046', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857036', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857022', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857004', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856968', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856966', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856964', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856962', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856960', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856958', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856843', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856755', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856746', None, None, None, None, None, '3726864') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 93 time used for this insertion : 0.022871017456054688 save_final save missing photos in datou_result : time spend for datou_step_exec : 26.378243446350098 time spend to save output : 0.023790597915649414 total time spend for step 3 : 26.402034044265747 step4:ventilate_hashtags_in_portfolio Tue Sep 16 10:52:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26882772 get user id for portfolio 26882772 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26882772 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','mal_croppe','autre','flou','background','environnement','papier','carton','pet_fonce','pet_clair','pehd')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26882772 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','mal_croppe','autre','flou','background','environnement','papier','carton','pet_fonce','pet_clair','pehd')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26882772 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','mal_croppe','autre','flou','background','environnement','papier','carton','pet_fonce','pet_clair','pehd')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26886919,26886920,26886921,26886922,26886923,26886924,26886925,26886926,26886927,26886928,26886929?tags=metal,mal_croppe,autre,flou,background,environnement,papier,carton,pet_fonce,pet_clair,pehd Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1383857531, 1383857489, 1383857486, 1383857483, 1383857479, 1383857460, 1383857315, 1383857305, 1383857301, 1383857297, 1383857293, 1383857290, 1383857230, 1383857220, 1383857212, 1383857205, 1383857087, 1383857057, 1383857046, 1383857036, 1383857022, 1383857004, 1383856968, 1383856966, 1383856964, 1383856962, 1383856960, 1383856958, 1383856843, 1383856755, 1383856746] Looping around the photos to save general results len do output : 1 /26882772. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857531', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857489', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857486', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857483', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857479', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857460', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857315', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857305', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857301', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857297', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857293', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857290', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857230', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857220', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857212', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857205', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857087', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857057', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857046', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857036', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857022', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857004', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856968', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856966', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856964', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856962', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856960', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856958', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856843', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856755', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856746', None, None, None, None, None, '3726864') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 32 time used for this insertion : 0.16560745239257812 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.8673923015594482 time spend to save output : 0.166046142578125 total time spend for step 4 : 2.0334384441375732 step5:final Tue Sep 16 10:52:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1383857531: ('0.0553948408253684',), 1383857489: ('0.0553948408253684',), 1383857486: ('0.0553948408253684',), 1383857483: ('0.0553948408253684',), 1383857479: ('0.0553948408253684',), 1383857460: ('0.0553948408253684',), 1383857315: ('0.0553948408253684',), 1383857305: ('0.0553948408253684',), 1383857301: ('0.0553948408253684',), 1383857297: ('0.0553948408253684',), 1383857293: ('0.0553948408253684',), 1383857290: ('0.0553948408253684',), 1383857230: ('0.0553948408253684',), 1383857220: ('0.0553948408253684',), 1383857212: ('0.0553948408253684',), 1383857205: ('0.0553948408253684',), 1383857087: ('0.0553948408253684',), 1383857057: ('0.0553948408253684',), 1383857046: ('0.0553948408253684',), 1383857036: ('0.0553948408253684',), 1383857022: ('0.0553948408253684',), 1383857004: ('0.0553948408253684',), 1383856968: ('0.0553948408253684',), 1383856966: ('0.0553948408253684',), 1383856964: ('0.0553948408253684',), 1383856962: ('0.0553948408253684',), 1383856960: ('0.0553948408253684',), 1383856958: ('0.0553948408253684',), 1383856843: ('0.0553948408253684',), 1383856755: ('0.0553948408253684',), 1383856746: ('0.0553948408253684',)} new output for save of step final : {1383857531: ('0.0553948408253684',), 1383857489: ('0.0553948408253684',), 1383857486: ('0.0553948408253684',), 1383857483: ('0.0553948408253684',), 1383857479: ('0.0553948408253684',), 1383857460: ('0.0553948408253684',), 1383857315: ('0.0553948408253684',), 1383857305: ('0.0553948408253684',), 1383857301: ('0.0553948408253684',), 1383857297: ('0.0553948408253684',), 1383857293: ('0.0553948408253684',), 1383857290: ('0.0553948408253684',), 1383857230: ('0.0553948408253684',), 1383857220: ('0.0553948408253684',), 1383857212: ('0.0553948408253684',), 1383857205: ('0.0553948408253684',), 1383857087: ('0.0553948408253684',), 1383857057: ('0.0553948408253684',), 1383857046: ('0.0553948408253684',), 1383857036: ('0.0553948408253684',), 1383857022: ('0.0553948408253684',), 1383857004: ('0.0553948408253684',), 1383856968: ('0.0553948408253684',), 1383856966: ('0.0553948408253684',), 1383856964: ('0.0553948408253684',), 1383856962: ('0.0553948408253684',), 1383856960: ('0.0553948408253684',), 1383856958: ('0.0553948408253684',), 1383856843: ('0.0553948408253684',), 1383856755: ('0.0553948408253684',), 1383856746: ('0.0553948408253684',)} [1383857531, 1383857489, 1383857486, 1383857483, 1383857479, 1383857460, 1383857315, 1383857305, 1383857301, 1383857297, 1383857293, 1383857290, 1383857230, 1383857220, 1383857212, 1383857205, 1383857087, 1383857057, 1383857046, 1383857036, 1383857022, 1383857004, 1383856968, 1383856966, 1383856964, 1383856962, 1383856960, 1383856958, 1383856843, 1383856755, 1383856746] Looping around the photos to save general results len do output : 31 /1383857531.Didn't retrieve data . /1383857489.Didn't retrieve data . /1383857486.Didn't retrieve data . /1383857483.Didn't retrieve data . /1383857479.Didn't retrieve data . /1383857460.Didn't retrieve data . /1383857315.Didn't retrieve data . /1383857305.Didn't retrieve data . /1383857301.Didn't retrieve data . /1383857297.Didn't retrieve data . /1383857293.Didn't retrieve data . /1383857290.Didn't retrieve data . /1383857230.Didn't retrieve data . /1383857220.Didn't retrieve data . /1383857212.Didn't retrieve data . /1383857205.Didn't retrieve data . /1383857087.Didn't retrieve data . /1383857057.Didn't retrieve data . /1383857046.Didn't retrieve data . /1383857036.Didn't retrieve data . /1383857022.Didn't retrieve data . /1383857004.Didn't retrieve data . /1383856968.Didn't retrieve data . /1383856966.Didn't retrieve data . /1383856964.Didn't retrieve data . /1383856962.Didn't retrieve data . /1383856960.Didn't retrieve data . /1383856958.Didn't retrieve data . /1383856843.Didn't retrieve data . /1383856755.Didn't retrieve data . /1383856746.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857531', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857489', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857486', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857483', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857479', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857460', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857315', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857305', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857301', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857297', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857293', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857290', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857230', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857220', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857212', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857205', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857087', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857057', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857046', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857036', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857022', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857004', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856968', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856966', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856964', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856962', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856960', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856958', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856843', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856755', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856746', None, None, None, None, None, '3726864') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 93 time used for this insertion : 0.14417409896850586 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.16619038581848145 time spend to save output : 0.145582914352417 total time spend for step 5 : 0.31177330017089844 step6:blur_detection Tue Sep 16 10:52:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1758012628_2382335_1383857531_41d447cd226a33946d602003a8b4a867.jpg resize: (1080, 1920) 1383857531 -2.452282176255973 treat image : temp/1758012628_2382335_1383857489_59d80160cbccdddaf3395160384b9b4c.jpg resize: (1080, 1920) 1383857489 -2.7216812208180823 treat image : temp/1758012628_2382335_1383857486_41de7e88f7bfe99a9e3eb34680d89ada.jpg resize: (1080, 1920) 1383857486 -2.922380398539223 treat image : temp/1758012628_2382335_1383857483_68ab727a7d95734203570feaa0f236b6.jpg resize: (1080, 1920) 1383857483 -2.5340998162354342 treat image : temp/1758012628_2382335_1383857479_03c2482227ab677c920ba59f88df0951.jpg resize: (1080, 1920) 1383857479 -4.078931964332263 treat image : temp/1758012628_2382335_1383857460_e03ca3e060237698488e24b27d55444d.jpg resize: (1080, 1920) 1383857460 -1.5609320652355387 treat image : temp/1758012628_2382335_1383857315_7d8d7d5cc6e1b9f92bae42368e2725f4.jpg resize: (1080, 1920) 1383857315 -2.7244152530164474 treat image : temp/1758012628_2382335_1383857305_daacc87a56d33986dc0b40e8addb58b6.jpg resize: (1080, 1920) 1383857305 -1.639089984812483 treat image : temp/1758012628_2382335_1383857301_9f6403db311304b67cf1a83519af1b4c.jpg resize: (1080, 1920) 1383857301 -2.3476571450212758 treat image : temp/1758012628_2382335_1383857297_419ab7c9db4ec56a2dba291d945bebc5.jpg resize: (1080, 1920) 1383857297 -2.6315396816584475 treat image : temp/1758012628_2382335_1383857293_42580d9cc876b1d0e3cbdf09be39581a.jpg resize: (1080, 1920) 1383857293 -2.1421031405475723 treat image : temp/1758012628_2382335_1383857290_cbec0d5b20ed990a69183cec0c4ab1e8.jpg resize: (1080, 1920) 1383857290 -2.650208608921909 treat image : temp/1758012628_2382335_1383857230_17a33780cafa82675b16c79fa7691509.jpg resize: (1080, 1920) 1383857230 -2.976566474492597 treat image : temp/1758012628_2382335_1383857220_d95e286e415a70580cb085af7b4c6ca7.jpg resize: (1080, 1920) 1383857220 -1.6670236255010757 treat image : temp/1758012628_2382335_1383857212_6ade15aabe5e48ce646a82d65dcebc11.jpg resize: (1080, 1920) 1383857212 -2.7578970791697714 treat image : temp/1758012628_2382335_1383857205_189696696861316c86f30f4c5d9dc49c.jpg resize: (1080, 1920) 1383857205 -2.841765855921897 treat image : temp/1758012628_2382335_1383857087_3c575ea960d10de2c22e9a6c105fa8d9.jpg resize: (1080, 1920) 1383857087 -2.2289034730547845 treat image : temp/1758012628_2382335_1383857057_9e5bc49736be56145f03fcba63b3009e.jpg resize: (1080, 1920) 1383857057 -2.484904755026112 treat image : temp/1758012628_2382335_1383857046_dcf5da8bf13de0bf1a65fec59a7c2a05.jpg resize: (1080, 1920) 1383857046 -2.4439239453543906 treat image : temp/1758012628_2382335_1383857036_ed73ef97ded6b20adeb7447a3ab3594e.jpg resize: (1080, 1920) 1383857036 -1.5541625268846242 treat image : temp/1758012628_2382335_1383857022_2f068e95a951d11c09eb112452b11533.jpg resize: (1080, 1920) 1383857022 -2.707196797289637 treat image : temp/1758012628_2382335_1383857004_bfc21aa54529932c8c9be3b961ac3af9.jpg resize: (1080, 1920) 1383857004 -4.17372000924225 treat image : temp/1758012628_2382335_1383856968_0571d3fbe9ddb632eaa424f7bfee914e.jpg resize: (1080, 1920) 1383856968 -2.7735854229531207 treat image : temp/1758012628_2382335_1383856966_4f6256cbaac2ab301a0299658a3eff72.jpg resize: (1080, 1920) 1383856966 -1.9649904399465508 treat image : temp/1758012628_2382335_1383856964_7db45cf02fd6936ca13db2bfaa5b8676.jpg resize: (1080, 1920) 1383856964 -2.6943481434380288 treat image : temp/1758012628_2382335_1383856962_7c1ecf43b49d4406b9965947c5accee4.jpg resize: (1080, 1920) 1383856962 -2.9275815314058535 treat image : temp/1758012628_2382335_1383856960_428e12d776726fb3780bc43ef9acb6b9.jpg resize: (1080, 1920) 1383856960 -2.6630809037558345 treat image : temp/1758012628_2382335_1383856958_f3690a961f29813e685359942a14434c.jpg resize: (1080, 1920) 1383856958 -2.819529265287474 treat image : temp/1758012628_2382335_1383856843_0aa9554850cb5a4fb66d6346c9baaf00.jpg resize: (1080, 1920) 1383856843 -3.4173628163698946 treat image : temp/1758012628_2382335_1383856755_a1a0967ac201797033d5f3244eae48cd.jpg resize: (1080, 1920) 1383856755 -3.0038929828777037 treat image : temp/1758012628_2382335_1383856746_cd19b7399ed17fbb26ddc60a61821dd5.jpg resize: (1080, 1920) 1383856746 -0.9359503559345068 treat image : temp/1758012628_2382335_1383857489_59d80160cbccdddaf3395160384b9b4c_rle_crop_3959189947_0.png resize: (128, 120) 1383879611 -0.7382525897597253 treat image : temp/1758012628_2382335_1383857489_59d80160cbccdddaf3395160384b9b4c_rle_crop_3959189950_0.png resize: (127, 108) 1383879612 -1.293368709314482 treat image : temp/1758012628_2382335_1383857486_41de7e88f7bfe99a9e3eb34680d89ada_rle_crop_3959189951_0.png resize: (123, 75) 1383879613 -2.283393282519335 treat image : temp/1758012628_2382335_1383857479_03c2482227ab677c920ba59f88df0951_rle_crop_3959189956_0.png resize: (78, 84) 1383879614 -0.43724226281229395 treat image : temp/1758012628_2382335_1383857305_daacc87a56d33986dc0b40e8addb58b6_rle_crop_3959189961_0.png resize: (114, 105) 1383879615 -1.9272280307699268 treat image : temp/1758012628_2382335_1383857297_419ab7c9db4ec56a2dba291d945bebc5_rle_crop_3959189964_0.png resize: (152, 86) 1383879616 -2.0863671791469436 treat image : temp/1758012628_2382335_1383857297_419ab7c9db4ec56a2dba291d945bebc5_rle_crop_3959189965_0.png resize: (117, 119) 1383879617 -2.0692853576455037 treat image : temp/1758012628_2382335_1383857297_419ab7c9db4ec56a2dba291d945bebc5_rle_crop_3959189966_0.png resize: (173, 113) 1383879618 -1.757978554259701 treat image : temp/1758012628_2382335_1383857230_17a33780cafa82675b16c79fa7691509_rle_crop_3959189974_0.png resize: (112, 111) 1383879619 -1.733932474956634 treat image : temp/1758012628_2382335_1383857205_189696696861316c86f30f4c5d9dc49c_rle_crop_3959189981_0.png resize: (181, 100) 1383879620 -2.031664446940109 treat image : temp/1758012628_2382335_1383857087_3c575ea960d10de2c22e9a6c105fa8d9_rle_crop_3959189983_0.png resize: (175, 110) 1383879621 -2.0903903993461586 treat image : temp/1758012628_2382335_1383857022_2f068e95a951d11c09eb112452b11533_rle_crop_3959189988_0.png resize: (65, 134) 1383879622 4.227942872856882 treat image : temp/1758012628_2382335_1383857004_bfc21aa54529932c8c9be3b961ac3af9_rle_crop_3959189989_0.png resize: (106, 112) 1383879623 -1.8647698170364542 treat image : temp/1758012628_2382335_1383857004_bfc21aa54529932c8c9be3b961ac3af9_rle_crop_3959189990_0.png resize: (179, 110) 1383879624 -1.8700392532393249 treat image : temp/1758012628_2382335_1383856968_0571d3fbe9ddb632eaa424f7bfee914e_rle_crop_3959189993_0.png resize: (89, 77) 1383879625 -2.062121603418405 treat image : temp/1758012628_2382335_1383856968_0571d3fbe9ddb632eaa424f7bfee914e_rle_crop_3959189994_0.png resize: (182, 106) 1383879626 -1.8110804321662615 treat image : temp/1758012628_2382335_1383856968_0571d3fbe9ddb632eaa424f7bfee914e_rle_crop_3959189995_0.png resize: (141, 45) 1383879627 -0.18222784667299186 treat image : temp/1758012628_2382335_1383856966_4f6256cbaac2ab301a0299658a3eff72_rle_crop_3959189997_0.png resize: (138, 42) 1383879628 -0.1784603390714995 treat image : temp/1758012628_2382335_1383856964_7db45cf02fd6936ca13db2bfaa5b8676_rle_crop_3959189999_0.png resize: (164, 106) 1383879629 -0.6365327979150918 treat image : temp/1758012628_2382335_1383856960_428e12d776726fb3780bc43ef9acb6b9_rle_crop_3959190002_0.png resize: (98, 84) 1383879630 1.1462269773278821 treat image : temp/1758012628_2382335_1383856960_428e12d776726fb3780bc43ef9acb6b9_rle_crop_3959190003_0.png resize: (52, 88) 1383879631 0.010145776184773013 treat image : temp/1758012628_2382335_1383856958_f3690a961f29813e685359942a14434c_rle_crop_3959190004_0.png resize: (94, 138) 1383879632 -3.115265290343014 treat image : temp/1758012628_2382335_1383856843_0aa9554850cb5a4fb66d6346c9baaf00_rle_crop_3959190009_0.png resize: (182, 103) 1383879633 -1.2518243205618858 treat image : temp/1758012628_2382335_1383856755_a1a0967ac201797033d5f3244eae48cd_rle_crop_3959190011_0.png resize: (203, 90) 1383879634 -1.9313342875631008 treat image : temp/1758012628_2382335_1383856746_cd19b7399ed17fbb26ddc60a61821dd5_rle_crop_3959190012_0.png resize: (95, 58) 1383879635 -1.973095564646846 treat image : temp/1758012628_2382335_1383856746_cd19b7399ed17fbb26ddc60a61821dd5_rle_crop_3959190015_0.png resize: (161, 104) 1383879636 -1.131292106576941 treat image : temp/1758012628_2382335_1383857290_cbec0d5b20ed990a69183cec0c4ab1e8_rle_crop_3959189971_0.png resize: (104, 121) 1383879641 -1.5728618230388134 treat image : temp/1758012628_2382335_1383857230_17a33780cafa82675b16c79fa7691509_rle_crop_3959189976_0.png resize: (503, 347) 1383879642 0.1563131410157282 treat image : temp/1758012628_2382335_1383857004_bfc21aa54529932c8c9be3b961ac3af9_rle_crop_3959189992_0.png resize: (550, 368) 1383879643 -0.3760576945393732 treat image : temp/1758012628_2382335_1383857531_41d447cd226a33946d602003a8b4a867_rle_crop_3959189946_0.png resize: (318, 166) 1383879700 -1.1992034132713898 treat image : temp/1758012628_2382335_1383857489_59d80160cbccdddaf3395160384b9b4c_rle_crop_3959189948_0.png resize: (116, 82) 1383879701 -1.0494278250601543 treat image : temp/1758012628_2382335_1383857489_59d80160cbccdddaf3395160384b9b4c_rle_crop_3959189949_0.png resize: (47, 73) 1383879702 -3.3927154411653997 treat image : temp/1758012628_2382335_1383857486_41de7e88f7bfe99a9e3eb34680d89ada_rle_crop_3959189953_0.png resize: (491, 351) 1383879703 0.18367421479642373 treat image : temp/1758012628_2382335_1383857483_68ab727a7d95734203570feaa0f236b6_rle_crop_3959189954_0.png resize: (125, 114) 1383879704 -1.0429765187228526 treat image : temp/1758012628_2382335_1383857483_68ab727a7d95734203570feaa0f236b6_rle_crop_3959189955_0.png resize: (506, 329) 1383879705 -0.3751172512288765 treat image : temp/1758012628_2382335_1383857479_03c2482227ab677c920ba59f88df0951_rle_crop_3959189957_0.png resize: (148, 237) 1383879706 -3.7622536527222903 treat image : temp/1758012628_2382335_1383857460_e03ca3e060237698488e24b27d55444d_rle_crop_3959189960_0.png resize: (975, 1052) 1383879707 -0.25484342968081464 treat image : temp/1758012628_2382335_1383857305_daacc87a56d33986dc0b40e8addb58b6_rle_crop_3959189962_0.png resize: (968, 1205) 1383879708 -0.4098650693041392 treat image : temp/1758012628_2382335_1383857301_9f6403db311304b67cf1a83519af1b4c_rle_crop_3959189963_0.png resize: (536, 340) 1383879709 0.3331551560410593 treat image : temp/1758012628_2382335_1383857293_42580d9cc876b1d0e3cbdf09be39581a_rle_crop_3959189967_0.png resize: (52, 74) 1383879710 -2.9365027498127603 treat image : temp/1758012628_2382335_1383857293_42580d9cc876b1d0e3cbdf09be39581a_rle_crop_3959189968_0.png resize: (161, 115) 1383879711 -0.7589387881766431 treat image : temp/1758012628_2382335_1383857290_cbec0d5b20ed990a69183cec0c4ab1e8_rle_crop_3959189969_0.png resize: (501, 350) 1383879712 0.3325231717574106 treat image : temp/1758012628_2382335_1383857290_cbec0d5b20ed990a69183cec0c4ab1e8_rle_crop_3959189970_0.png resize: (71, 155) 1383879713 -3.5238538252734424 treat image : temp/1758012628_2382335_1383857290_cbec0d5b20ed990a69183cec0c4ab1e8_rle_crop_3959189972_0.png resize: (91, 191) 1383879714 -4.48406370583478 treat image : temp/1758012628_2382335_1383857230_17a33780cafa82675b16c79fa7691509_rle_crop_3959189973_0.png resize: (68, 173) 1383879715 -2.303799039059057 treat image : temp/1758012628_2382335_1383857230_17a33780cafa82675b16c79fa7691509_rle_crop_3959189975_0.png resize: (530, 341) 1383879716 -0.03638970998581415 treat image : temp/1758012628_2382335_1383857212_6ade15aabe5e48ce646a82d65dcebc11_rle_crop_3959189977_0.png resize: (83, 292) 1383879717 -2.134538345667622 treat image : temp/1758012628_2382335_1383857212_6ade15aabe5e48ce646a82d65dcebc11_rle_crop_3959189978_0.png resize: (183, 155) 1383879718 -0.8765447346400307 treat image : temp/1758012628_2382335_1383857205_189696696861316c86f30f4c5d9dc49c_rle_crop_3959189979_0.png resize: (500, 336) 1383879719 0.17636501726378023 treat image : temp/1758012628_2382335_1383857205_189696696861316c86f30f4c5d9dc49c_rle_crop_3959189980_0.png resize: (200, 245) 1383879720 -2.3322507038419737 treat image : temp/1758012628_2382335_1383857087_3c575ea960d10de2c22e9a6c105fa8d9_rle_crop_3959189982_0.png resize: (545, 356) 1383879721 0.1613749238672147 treat image : temp/1758012628_2382335_1383857057_9e5bc49736be56145f03fcba63b3009e_rle_crop_3959189984_0.png resize: (175, 176) 1383879722 -1.7640488957744966 treat image : temp/1758012628_2382335_1383857036_ed73ef97ded6b20adeb7447a3ab3594e_rle_crop_3959189985_0.png resize: (79, 79) 1383879723 -2.587963640579479 treat image : temp/1758012628_2382335_1383857036_ed73ef97ded6b20adeb7447a3ab3594e_rle_crop_3959189987_0.png resize: (556, 328) 1383879724 -0.2631104946759514 treat image : temp/1758012628_2382335_1383857004_bfc21aa54529932c8c9be3b961ac3af9_rle_crop_3959189991_0.png resize: (544, 344) 1383879725 0.13675495594312503 treat image : temp/1758012628_2382335_1383856966_4f6256cbaac2ab301a0299658a3eff72_rle_crop_3959189996_0.png resize: (164, 130) 1383879726 -2.613023812133352 treat image : temp/1758012628_2382335_1383856964_7db45cf02fd6936ca13db2bfaa5b8676_rle_crop_3959189998_0.png resize: (531, 336) 1383879727 -0.21986537354457347 treat image : temp/1758012628_2382335_1383856960_428e12d776726fb3780bc43ef9acb6b9_rle_crop_3959190000_0.png resize: (546, 349) 1383879728 0.3076881387580234 treat image : temp/1758012628_2382335_1383856960_428e12d776726fb3780bc43ef9acb6b9_rle_crop_3959190001_0.png resize: (337, 193) 1383879729 -1.6342901799150442 treat image : temp/1758012628_2382335_1383856958_f3690a961f29813e685359942a14434c_rle_crop_3959190005_0.png resize: (122, 115) 1383879730 -3.4607438694408477 treat image : temp/1758012628_2382335_1383856843_0aa9554850cb5a4fb66d6346c9baaf00_rle_crop_3959190007_0.png resize: (526, 324) 1383879731 0.2835583913373009 treat image : temp/1758012628_2382335_1383856843_0aa9554850cb5a4fb66d6346c9baaf00_rle_crop_3959190008_0.png resize: (79, 156) 1383879732 -1.4101039804890518 treat image : temp/1758012628_2382335_1383856755_a1a0967ac201797033d5f3244eae48cd_rle_crop_3959190010_0.png resize: (129, 92) 1383879733 -5.122280329366506 treat image : temp/1758012628_2382335_1383856746_cd19b7399ed17fbb26ddc60a61821dd5_rle_crop_3959190013_0.png resize: (535, 349) 1383879734 0.23601964644336124 treat image : temp/1758012628_2382335_1383856746_cd19b7399ed17fbb26ddc60a61821dd5_rle_crop_3959190014_0.png resize: (228, 206) 1383879735 -1.9736742042703814 treat image : temp/1758012628_2382335_1383857486_41de7e88f7bfe99a9e3eb34680d89ada_rle_crop_3959189952_0.png resize: (159, 104) 1383879736 -5.047327915510107 treat image : temp/1758012628_2382335_1383857460_e03ca3e060237698488e24b27d55444d_rle_crop_3959189958_0.png resize: (148, 49) 1383879737 -0.41020162040643265 treat image : temp/1758012628_2382335_1383857460_e03ca3e060237698488e24b27d55444d_rle_crop_3959189959_0.png resize: (102, 160) 1383879738 -4.110951115549501 treat image : temp/1758012628_2382335_1383856958_f3690a961f29813e685359942a14434c_rle_crop_3959190006_0.png resize: (115, 73) 1383879739 -2.3202408695706698 treat image : temp/1758012628_2382335_1383857036_ed73ef97ded6b20adeb7447a3ab3594e_rle_crop_3959189986_0.png resize: (65, 143) 1383879740 -5.556731603273163 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 101 time used for this insertion : 0.025299549102783203 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 101 time used for this insertion : 0.31904077529907227 save missing photos in datou_result : time spend for datou_step_exec : 27.60430145263672 time spend to save output : 0.3493211269378662 total time spend for step 6 : 27.953622579574585 step7:brightness Tue Sep 16 10:52:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1758012628_2382335_1383857531_41d447cd226a33946d602003a8b4a867.jpg treat image : temp/1758012628_2382335_1383857489_59d80160cbccdddaf3395160384b9b4c.jpg treat image : temp/1758012628_2382335_1383857486_41de7e88f7bfe99a9e3eb34680d89ada.jpg treat image : temp/1758012628_2382335_1383857483_68ab727a7d95734203570feaa0f236b6.jpg treat image : temp/1758012628_2382335_1383857479_03c2482227ab677c920ba59f88df0951.jpg treat image : temp/1758012628_2382335_1383857460_e03ca3e060237698488e24b27d55444d.jpg treat image : temp/1758012628_2382335_1383857315_7d8d7d5cc6e1b9f92bae42368e2725f4.jpg treat image : temp/1758012628_2382335_1383857305_daacc87a56d33986dc0b40e8addb58b6.jpg treat image : temp/1758012628_2382335_1383857301_9f6403db311304b67cf1a83519af1b4c.jpg treat image : temp/1758012628_2382335_1383857297_419ab7c9db4ec56a2dba291d945bebc5.jpg treat image : temp/1758012628_2382335_1383857293_42580d9cc876b1d0e3cbdf09be39581a.jpg treat image : temp/1758012628_2382335_1383857290_cbec0d5b20ed990a69183cec0c4ab1e8.jpg treat image : temp/1758012628_2382335_1383857230_17a33780cafa82675b16c79fa7691509.jpg treat image : temp/1758012628_2382335_1383857220_d95e286e415a70580cb085af7b4c6ca7.jpg treat image : temp/1758012628_2382335_1383857212_6ade15aabe5e48ce646a82d65dcebc11.jpg treat image : temp/1758012628_2382335_1383857205_189696696861316c86f30f4c5d9dc49c.jpg treat image : temp/1758012628_2382335_1383857087_3c575ea960d10de2c22e9a6c105fa8d9.jpg treat image : temp/1758012628_2382335_1383857057_9e5bc49736be56145f03fcba63b3009e.jpg treat image : temp/1758012628_2382335_1383857046_dcf5da8bf13de0bf1a65fec59a7c2a05.jpg treat image : temp/1758012628_2382335_1383857036_ed73ef97ded6b20adeb7447a3ab3594e.jpg treat image : temp/1758012628_2382335_1383857022_2f068e95a951d11c09eb112452b11533.jpg treat image : temp/1758012628_2382335_1383857004_bfc21aa54529932c8c9be3b961ac3af9.jpg treat image : temp/1758012628_2382335_1383856968_0571d3fbe9ddb632eaa424f7bfee914e.jpg treat image : temp/1758012628_2382335_1383856966_4f6256cbaac2ab301a0299658a3eff72.jpg treat image : temp/1758012628_2382335_1383856964_7db45cf02fd6936ca13db2bfaa5b8676.jpg treat image : temp/1758012628_2382335_1383856962_7c1ecf43b49d4406b9965947c5accee4.jpg treat image : temp/1758012628_2382335_1383856960_428e12d776726fb3780bc43ef9acb6b9.jpg treat image : temp/1758012628_2382335_1383856958_f3690a961f29813e685359942a14434c.jpg treat image : temp/1758012628_2382335_1383856843_0aa9554850cb5a4fb66d6346c9baaf00.jpg treat image : temp/1758012628_2382335_1383856755_a1a0967ac201797033d5f3244eae48cd.jpg treat image : temp/1758012628_2382335_1383856746_cd19b7399ed17fbb26ddc60a61821dd5.jpg treat image : temp/1758012628_2382335_1383857489_59d80160cbccdddaf3395160384b9b4c_rle_crop_3959189947_0.png treat image : temp/1758012628_2382335_1383857489_59d80160cbccdddaf3395160384b9b4c_rle_crop_3959189950_0.png treat image : temp/1758012628_2382335_1383857486_41de7e88f7bfe99a9e3eb34680d89ada_rle_crop_3959189951_0.png treat image : temp/1758012628_2382335_1383857479_03c2482227ab677c920ba59f88df0951_rle_crop_3959189956_0.png treat image : temp/1758012628_2382335_1383857305_daacc87a56d33986dc0b40e8addb58b6_rle_crop_3959189961_0.png treat image : temp/1758012628_2382335_1383857297_419ab7c9db4ec56a2dba291d945bebc5_rle_crop_3959189964_0.png treat image : temp/1758012628_2382335_1383857297_419ab7c9db4ec56a2dba291d945bebc5_rle_crop_3959189965_0.png treat image : temp/1758012628_2382335_1383857297_419ab7c9db4ec56a2dba291d945bebc5_rle_crop_3959189966_0.png treat image : temp/1758012628_2382335_1383857230_17a33780cafa82675b16c79fa7691509_rle_crop_3959189974_0.png treat image : temp/1758012628_2382335_1383857205_189696696861316c86f30f4c5d9dc49c_rle_crop_3959189981_0.png treat image : temp/1758012628_2382335_1383857087_3c575ea960d10de2c22e9a6c105fa8d9_rle_crop_3959189983_0.png treat image : temp/1758012628_2382335_1383857022_2f068e95a951d11c09eb112452b11533_rle_crop_3959189988_0.png treat image : temp/1758012628_2382335_1383857004_bfc21aa54529932c8c9be3b961ac3af9_rle_crop_3959189989_0.png treat image : temp/1758012628_2382335_1383857004_bfc21aa54529932c8c9be3b961ac3af9_rle_crop_3959189990_0.png treat image : temp/1758012628_2382335_1383856968_0571d3fbe9ddb632eaa424f7bfee914e_rle_crop_3959189993_0.png treat image : temp/1758012628_2382335_1383856968_0571d3fbe9ddb632eaa424f7bfee914e_rle_crop_3959189994_0.png treat image : temp/1758012628_2382335_1383856968_0571d3fbe9ddb632eaa424f7bfee914e_rle_crop_3959189995_0.png treat image : temp/1758012628_2382335_1383856966_4f6256cbaac2ab301a0299658a3eff72_rle_crop_3959189997_0.png treat image : temp/1758012628_2382335_1383856964_7db45cf02fd6936ca13db2bfaa5b8676_rle_crop_3959189999_0.png treat image : temp/1758012628_2382335_1383856960_428e12d776726fb3780bc43ef9acb6b9_rle_crop_3959190002_0.png treat image : temp/1758012628_2382335_1383856960_428e12d776726fb3780bc43ef9acb6b9_rle_crop_3959190003_0.png treat image : temp/1758012628_2382335_1383856958_f3690a961f29813e685359942a14434c_rle_crop_3959190004_0.png treat image : temp/1758012628_2382335_1383856843_0aa9554850cb5a4fb66d6346c9baaf00_rle_crop_3959190009_0.png treat image : temp/1758012628_2382335_1383856755_a1a0967ac201797033d5f3244eae48cd_rle_crop_3959190011_0.png treat image : temp/1758012628_2382335_1383856746_cd19b7399ed17fbb26ddc60a61821dd5_rle_crop_3959190012_0.png treat image : temp/1758012628_2382335_1383856746_cd19b7399ed17fbb26ddc60a61821dd5_rle_crop_3959190015_0.png treat image : temp/1758012628_2382335_1383857290_cbec0d5b20ed990a69183cec0c4ab1e8_rle_crop_3959189971_0.png treat image : temp/1758012628_2382335_1383857230_17a33780cafa82675b16c79fa7691509_rle_crop_3959189976_0.png treat image : temp/1758012628_2382335_1383857004_bfc21aa54529932c8c9be3b961ac3af9_rle_crop_3959189992_0.png treat image : temp/1758012628_2382335_1383857531_41d447cd226a33946d602003a8b4a867_rle_crop_3959189946_0.png treat image : temp/1758012628_2382335_1383857489_59d80160cbccdddaf3395160384b9b4c_rle_crop_3959189948_0.png treat image : temp/1758012628_2382335_1383857489_59d80160cbccdddaf3395160384b9b4c_rle_crop_3959189949_0.png treat image : temp/1758012628_2382335_1383857486_41de7e88f7bfe99a9e3eb34680d89ada_rle_crop_3959189953_0.png treat image : temp/1758012628_2382335_1383857483_68ab727a7d95734203570feaa0f236b6_rle_crop_3959189954_0.png treat image : temp/1758012628_2382335_1383857483_68ab727a7d95734203570feaa0f236b6_rle_crop_3959189955_0.png treat image : temp/1758012628_2382335_1383857479_03c2482227ab677c920ba59f88df0951_rle_crop_3959189957_0.png treat image : temp/1758012628_2382335_1383857460_e03ca3e060237698488e24b27d55444d_rle_crop_3959189960_0.png treat image : temp/1758012628_2382335_1383857305_daacc87a56d33986dc0b40e8addb58b6_rle_crop_3959189962_0.png treat image : temp/1758012628_2382335_1383857301_9f6403db311304b67cf1a83519af1b4c_rle_crop_3959189963_0.png treat image : temp/1758012628_2382335_1383857293_42580d9cc876b1d0e3cbdf09be39581a_rle_crop_3959189967_0.png treat image : temp/1758012628_2382335_1383857293_42580d9cc876b1d0e3cbdf09be39581a_rle_crop_3959189968_0.png treat image : temp/1758012628_2382335_1383857290_cbec0d5b20ed990a69183cec0c4ab1e8_rle_crop_3959189969_0.png treat image : temp/1758012628_2382335_1383857290_cbec0d5b20ed990a69183cec0c4ab1e8_rle_crop_3959189970_0.png treat image : temp/1758012628_2382335_1383857290_cbec0d5b20ed990a69183cec0c4ab1e8_rle_crop_3959189972_0.png treat image : temp/1758012628_2382335_1383857230_17a33780cafa82675b16c79fa7691509_rle_crop_3959189973_0.png treat image : temp/1758012628_2382335_1383857230_17a33780cafa82675b16c79fa7691509_rle_crop_3959189975_0.png treat image : temp/1758012628_2382335_1383857212_6ade15aabe5e48ce646a82d65dcebc11_rle_crop_3959189977_0.png treat image : temp/1758012628_2382335_1383857212_6ade15aabe5e48ce646a82d65dcebc11_rle_crop_3959189978_0.png treat image : temp/1758012628_2382335_1383857205_189696696861316c86f30f4c5d9dc49c_rle_crop_3959189979_0.png treat image : temp/1758012628_2382335_1383857205_189696696861316c86f30f4c5d9dc49c_rle_crop_3959189980_0.png treat image : temp/1758012628_2382335_1383857087_3c575ea960d10de2c22e9a6c105fa8d9_rle_crop_3959189982_0.png treat image : temp/1758012628_2382335_1383857057_9e5bc49736be56145f03fcba63b3009e_rle_crop_3959189984_0.png treat image : temp/1758012628_2382335_1383857036_ed73ef97ded6b20adeb7447a3ab3594e_rle_crop_3959189985_0.png treat image : temp/1758012628_2382335_1383857036_ed73ef97ded6b20adeb7447a3ab3594e_rle_crop_3959189987_0.png treat image : temp/1758012628_2382335_1383857004_bfc21aa54529932c8c9be3b961ac3af9_rle_crop_3959189991_0.png treat image : temp/1758012628_2382335_1383856966_4f6256cbaac2ab301a0299658a3eff72_rle_crop_3959189996_0.png treat image : temp/1758012628_2382335_1383856964_7db45cf02fd6936ca13db2bfaa5b8676_rle_crop_3959189998_0.png treat image : temp/1758012628_2382335_1383856960_428e12d776726fb3780bc43ef9acb6b9_rle_crop_3959190000_0.png treat image : temp/1758012628_2382335_1383856960_428e12d776726fb3780bc43ef9acb6b9_rle_crop_3959190001_0.png treat image : temp/1758012628_2382335_1383856958_f3690a961f29813e685359942a14434c_rle_crop_3959190005_0.png treat image : temp/1758012628_2382335_1383856843_0aa9554850cb5a4fb66d6346c9baaf00_rle_crop_3959190007_0.png treat image : temp/1758012628_2382335_1383856843_0aa9554850cb5a4fb66d6346c9baaf00_rle_crop_3959190008_0.png treat image : temp/1758012628_2382335_1383856755_a1a0967ac201797033d5f3244eae48cd_rle_crop_3959190010_0.png treat image : temp/1758012628_2382335_1383856746_cd19b7399ed17fbb26ddc60a61821dd5_rle_crop_3959190013_0.png treat image : temp/1758012628_2382335_1383856746_cd19b7399ed17fbb26ddc60a61821dd5_rle_crop_3959190014_0.png treat image : temp/1758012628_2382335_1383857486_41de7e88f7bfe99a9e3eb34680d89ada_rle_crop_3959189952_0.png treat image : temp/1758012628_2382335_1383857460_e03ca3e060237698488e24b27d55444d_rle_crop_3959189958_0.png treat image : temp/1758012628_2382335_1383857460_e03ca3e060237698488e24b27d55444d_rle_crop_3959189959_0.png treat image : temp/1758012628_2382335_1383856958_f3690a961f29813e685359942a14434c_rle_crop_3959190006_0.png treat image : temp/1758012628_2382335_1383857036_ed73ef97ded6b20adeb7447a3ab3594e_rle_crop_3959189986_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 101 time used for this insertion : 0.018529653549194336 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 101 time used for this insertion : 0.04173088073730469 save missing photos in datou_result : time spend for datou_step_exec : 7.365871906280518 time spend to save output : 0.07114434242248535 total time spend for step 7 : 7.437016248703003 step8:velours_tree Tue Sep 16 10:53:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.1080169677734375 time spend to save output : 5.245208740234375e-05 total time spend for step 8 : 0.10806941986083984 step9:send_mail_cod Tue Sep 16 10:53:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26882772_16-09-2025_10_53_00.pdf 26886919 imagette268869191758012780 26886920 imagette268869201758012780 26886921 change filename to text .change filename to text .change filename to text .change filename to text .imagette268869211758012780 26886922 imagette268869221758012780 26886923 imagette268869231758012780 26886925 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette268869251758012780 26886926 change filename to text .change filename to text .change filename to text .imagette268869261758012781 26886927 change filename to text .imagette268869271758012781 26886928 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette268869281758012781 26886929 imagette268869291758012783 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26882772 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26886919,26886920,26886921,26886922,26886923,26886924,26886925,26886926,26886927,26886928,26886929?tags=metal,mal_croppe,autre,flou,background,environnement,papier,carton,pet_fonce,pet_clair,pehd args[1383857531] : ((1383857531, -2.452282176255973, 492609224), (1383857531, 0.5356914256924321, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383857489] : ((1383857489, -2.7216812208180823, 492609224), (1383857489, 0.4672419317684362, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383857486] : ((1383857486, -2.922380398539223, 492609224), (1383857486, 0.6097035671135542, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383857483] : ((1383857483, -2.5340998162354342, 492609224), (1383857483, 0.33025700091747157, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383857479] : ((1383857479, -4.078931964332263, 492609224), (1383857479, 0.3531769945083177, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383857460] : ((1383857460, -1.5609320652355387, 492688767), (1383857460, 0.5639937006307206, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383857315] : ((1383857315, -2.7244152530164474, 492609224), (1383857315, 0.5135400268341835, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383857305] : ((1383857305, -1.639089984812483, 492688767), (1383857305, 0.45012246947837126, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383857301] : ((1383857301, -2.3476571450212758, 492609224), (1383857301, 0.5736124143244383, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383857297] : ((1383857297, -2.6315396816584475, 492609224), (1383857297, 0.48641696636232884, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383857293] : ((1383857293, -2.1421031405475723, 492609224), (1383857293, 0.6527823596338433, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383857290] : ((1383857290, -2.650208608921909, 492609224), (1383857290, 0.4709844715027429, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383857230] : ((1383857230, -2.976566474492597, 492609224), (1383857230, 0.4130195387049118, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383857220] : ((1383857220, -1.6670236255010757, 492688767), (1383857220, 0.4635906486674201, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383857212] : ((1383857212, -2.7578970791697714, 492609224), (1383857212, 0.4870379160247769, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383857205] : ((1383857205, -2.841765855921897, 492609224), (1383857205, 0.45001446048562216, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383857087] : ((1383857087, -2.2289034730547845, 492609224), (1383857087, 0.7444992996162657, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383857057] : ((1383857057, -2.484904755026112, 492609224), (1383857057, 0.5115278671344047, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383857046] : ((1383857046, -2.4439239453543906, 492609224), (1383857046, 0.5732949779337323, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383857036] : ((1383857036, -1.5541625268846242, 492688767), (1383857036, 0.47375918208466306, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383857022] : ((1383857022, -2.707196797289637, 492609224), (1383857022, 0.3555651885016353, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383857004] : ((1383857004, -4.17372000924225, 492609224), (1383857004, 0.3047162787987128, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383856968] : ((1383856968, -2.7735854229531207, 492609224), (1383856968, 0.48896945900690103, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383856966] : ((1383856966, -1.9649904399465508, 492688767), (1383856966, 0.4622400365390697, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383856964] : ((1383856964, -2.6943481434380288, 492609224), (1383856964, 0.43033308487428495, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383856962] : ((1383856962, -2.9275815314058535, 492609224), (1383856962, 0.5910337657066406, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383856960] : ((1383856960, -2.6630809037558345, 492609224), (1383856960, 0.6822061701326927, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383856958] : ((1383856958, -2.819529265287474, 492609224), (1383856958, 0.8338334908104155, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383856843] : ((1383856843, -3.4173628163698946, 492609224), (1383856843, 0.4255335911166591, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383856755] : ((1383856755, -3.0038929828777037, 492609224), (1383856755, 0.7432194719215647, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com args[1383856746] : ((1383856746, -0.9359503559345068, 492688767), (1383856746, 0.3609018314430326, 2107752395), '0.0553948408253684') We are sending mail with results at report@fotonower.com refus_total : 0.0553948408253684 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26882772 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26882772_16-09-2025_10_53_00.pdf results_Auto_P26882772_16-09-2025_10_53_00.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26882772_16-09-2025_10_53_00.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26882772','results_Auto_P26882772_16-09-2025_10_53_00.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26882772_16-09-2025_10_53_00.pdf','pdf','','0.4','0.0553948408253684') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26882772

https://www.fotonower.com/image?json=false&list_photos_id=1383857531
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383857489
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383857486
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383857483
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383857479
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383857460
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383857315
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383857305
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383857301
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383857297
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383857293
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383857290
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383857230
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383857220
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383857212
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383857205
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383857087
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383857057
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383857046
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383857036
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383857022
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383857004
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383856968
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383856966
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383856964
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383856962
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383856960
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383856958
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383856843
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383856755
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383856746
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 5.54%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/26886921?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26886925?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26886926?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/26886927?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26886928?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26882772_16-09-2025_10_53_00.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26886919,26886920,26886921,26886922,26886923,26886924,26886925,26886926,26886927,26886928,26886929?tags=metal,mal_croppe,autre,flou,background,environnement,papier,carton,pet_fonce,pet_clair,pehd.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 16 Sep 2025 08:53:06 GMT Content-Length: 0 Connection: close X-Message-Id: hZyDNSznTX-Z-UzZZt7D6g Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1383857531, 1383857489, 1383857486, 1383857483, 1383857479, 1383857460, 1383857315, 1383857305, 1383857301, 1383857297, 1383857293, 1383857290, 1383857230, 1383857220, 1383857212, 1383857205, 1383857087, 1383857057, 1383857046, 1383857036, 1383857022, 1383857004, 1383856968, 1383856966, 1383856964, 1383856962, 1383856960, 1383856958, 1383856843, 1383856755, 1383856746] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857531', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857489', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857486', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857483', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857479', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857460', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857315', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857305', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857301', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857297', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857293', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857290', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857230', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857220', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857212', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857205', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857087', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857057', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857046', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857036', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857022', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857004', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856968', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856966', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856964', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856962', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856960', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856958', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856843', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856755', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856746', None, None, None, None, None, '3726864') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 31 time used for this insertion : 0.0379638671875 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.048891305923462 time spend to save output : 0.038396358489990234 total time spend for step 9 : 6.087287664413452 step10:split_time_score Tue Sep 16 10:53:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('08', 31),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 16092025 26882772 Nombre de photos uploadées : 31 / 23040 (0%) 16092025 26882772 Nombre de photos taguées (types de déchets): 0 / 31 (0%) 16092025 26882772 Nombre de photos taguées (volume) : 0 / 31 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 4.5299530029296875e-06 ??????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0013277530670166016 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20310163497924805 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.1122128041031227 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26882766_16-09-2025_09_52_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26882766 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26882766 AND mptpi.`type`=3594 To do Qualite : 0.1705833654835391 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26882768_16-09-2025_09_41_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26882768 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26882768 AND mptpi.`type`=3594 To do Qualite : 0.05712583188657407 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26882771_16-09-2025_10_31_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26882771 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26882771 AND mptpi.`type`=3594 To do Qualite : 0.0553948408253684 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26882772_16-09-2025_10_53_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26882772 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26882772 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'16092025': {'nb_upload': 31, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1383857531, 1383857489, 1383857486, 1383857483, 1383857479, 1383857460, 1383857315, 1383857305, 1383857301, 1383857297, 1383857293, 1383857290, 1383857230, 1383857220, 1383857212, 1383857205, 1383857087, 1383857057, 1383857046, 1383857036, 1383857022, 1383857004, 1383856968, 1383856966, 1383856964, 1383856962, 1383856960, 1383856958, 1383856843, 1383856755, 1383856746] Looping around the photos to save general results len do output : 1 /26882772Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857531', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857489', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857486', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857483', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857479', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857460', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857315', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857305', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857301', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857297', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857293', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857290', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857230', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857220', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857212', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857205', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857087', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857057', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857046', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857036', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857022', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383857004', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856968', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856966', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856964', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856962', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856960', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856958', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856843', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856755', None, None, None, None, None, '3726864') ('3318', None, None, None, None, None, None, None, '3726864') ('3318', '26882772', '1383856746', None, None, None, None, None, '3726864') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 32 time used for this insertion : 0.021260738372802734 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.6375231742858887 time spend to save output : 0.021602153778076172 total time spend for step 10 : 0.6591253280639648 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 31 set_done_treatment 87.78user 39.84system 2:42.57elapsed 78%CPU (0avgtext+0avgdata 2991360maxresident)k 685208inputs+35624outputs (6627major+2792063minor)pagefaults 0swaps