python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1919127 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3746750'] with mtr_portfolio_ids : ['27037771'] and first list_photo_ids : [] new path : /proc/1919127/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 22 ; length of list_pids : 22 ; length of list_args : 22 time to download the photos : 3.391413927078247 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Sep 19 11:00:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10590 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-19 11:00:35.365031: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-19 11:00:35.392498: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-19 11:00:35.394572: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f662c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-19 11:00:35.394633: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-19 11:00:35.398715: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-19 11:00:35.534456: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2312f2f0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-19 11:00:35.534505: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-19 11:00:35.535490: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-19 11:00:35.535779: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-19 11:00:35.538049: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-19 11:00:35.540294: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-19 11:00:35.540713: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-19 11:00:35.543155: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-19 11:00:35.544289: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-19 11:00:35.549369: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-19 11:00:35.551026: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-19 11:00:35.551129: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-19 11:00:35.551932: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-19 11:00:35.551949: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-19 11:00:35.551958: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-19 11:00:35.553893: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9665 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-19 11:00:35.871747: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-19 11:00:35.871860: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-19 11:00:35.871892: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-19 11:00:35.871921: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-19 11:00:35.871950: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-19 11:00:35.871977: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-19 11:00:35.872012: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-19 11:00:35.872048: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-19 11:00:35.874240: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-19 11:00:35.875835: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-19 11:00:35.875866: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-19 11:00:35.875881: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-19 11:00:35.875895: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-19 11:00:35.875909: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-19 11:00:35.875923: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-19 11:00:35.875936: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-19 11:00:35.875950: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-19 11:00:35.877252: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-19 11:00:35.877281: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-19 11:00:35.877290: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-19 11:00:35.877298: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-19 11:00:35.878617: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9665 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-19 11:00:45.458738: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-19 11:00:45.715576: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 22 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 15 Detection mask done ! Trying to reset tf kernel 1920134 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 328 tf kernel not reseted sub process len(results) : 22 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 22 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5617 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0002808570861816406 nb_pixel_total : 6962 time to create 1 rle with old method : 0.010395050048828125 length of segment : 109 time for calcul the mask position with numpy : 0.00029158592224121094 nb_pixel_total : 10565 time to create 1 rle with old method : 0.01275014877319336 length of segment : 175 time for calcul the mask position with numpy : 0.00013136863708496094 nb_pixel_total : 2730 time to create 1 rle with old method : 0.004227638244628906 length of segment : 72 time for calcul the mask position with numpy : 0.0001823902130126953 nb_pixel_total : 2535 time to create 1 rle with old method : 0.003167390823364258 length of segment : 76 time for calcul the mask position with numpy : 0.0002512931823730469 nb_pixel_total : 4899 time to create 1 rle with old method : 0.006142854690551758 length of segment : 94 time for calcul the mask position with numpy : 0.00024271011352539062 nb_pixel_total : 5916 time to create 1 rle with old method : 0.00738978385925293 length of segment : 89 time for calcul the mask position with numpy : 0.002005338668823242 nb_pixel_total : 55891 time to create 1 rle with old method : 0.08656048774719238 length of segment : 177 time for calcul the mask position with numpy : 0.0005004405975341797 nb_pixel_total : 9536 time to create 1 rle with old method : 0.011263847351074219 length of segment : 179 time for calcul the mask position with numpy : 0.00023436546325683594 nb_pixel_total : 5075 time to create 1 rle with old method : 0.006390571594238281 length of segment : 78 time for calcul the mask position with numpy : 0.0002028942108154297 nb_pixel_total : 9695 time to create 1 rle with old method : 0.011749744415283203 length of segment : 130 time for calcul the mask position with numpy : 0.00018286705017089844 nb_pixel_total : 3399 time to create 1 rle with old method : 0.004254579544067383 length of segment : 90 time for calcul the mask position with numpy : 0.0002613067626953125 nb_pixel_total : 11236 time to create 1 rle with old method : 0.013775348663330078 length of segment : 102 time for calcul the mask position with numpy : 0.0004525184631347656 nb_pixel_total : 9489 time to create 1 rle with old method : 0.011475801467895508 length of segment : 170 time for calcul the mask position with numpy : 0.00021195411682128906 nb_pixel_total : 4804 time to create 1 rle with old method : 0.005888462066650391 length of segment : 99 time for calcul the mask position with numpy : 0.00041222572326660156 nb_pixel_total : 1919 time to create 1 rle with old method : 0.0027892589569091797 length of segment : 110 time for calcul the mask position with numpy : 0.00021004676818847656 nb_pixel_total : 8731 time to create 1 rle with old method : 0.010609865188598633 length of segment : 106 time for calcul the mask position with numpy : 0.00012922286987304688 nb_pixel_total : 4251 time to create 1 rle with old method : 0.005417823791503906 length of segment : 75 time for calcul the mask position with numpy : 0.00041222572326660156 nb_pixel_total : 9587 time to create 1 rle with old method : 0.011585712432861328 length of segment : 171 time for calcul the mask position with numpy : 0.00037741661071777344 nb_pixel_total : 8940 time to create 1 rle with old method : 0.010459423065185547 length of segment : 212 time for calcul the mask position with numpy : 0.00031828880310058594 nb_pixel_total : 10305 time to create 1 rle with old method : 0.012696027755737305 length of segment : 176 time for calcul the mask position with numpy : 0.00016546249389648438 nb_pixel_total : 7097 time to create 1 rle with old method : 0.008825540542602539 length of segment : 114 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 1688 time to create 1 rle with old method : 0.002170562744140625 length of segment : 39 time for calcul the mask position with numpy : 0.0001304149627685547 nb_pixel_total : 5717 time to create 1 rle with old method : 0.006968259811401367 length of segment : 124 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 2212 time to create 1 rle with old method : 0.0028069019317626953 length of segment : 42 time for calcul the mask position with numpy : 0.00013327598571777344 nb_pixel_total : 4231 time to create 1 rle with old method : 0.0052149295806884766 length of segment : 91 time for calcul the mask position with numpy : 0.00023031234741210938 nb_pixel_total : 9898 time to create 1 rle with old method : 0.012313127517700195 length of segment : 113 time for calcul the mask position with numpy : 0.00026702880859375 nb_pixel_total : 4281 time to create 1 rle with old method : 0.008381366729736328 length of segment : 75 time for calcul the mask position with numpy : 0.00012302398681640625 nb_pixel_total : 2114 time to create 1 rle with old method : 0.0027277469635009766 length of segment : 45 time for calcul the mask position with numpy : 0.00012040138244628906 nb_pixel_total : 3923 time to create 1 rle with old method : 0.004957675933837891 length of segment : 89 time for calcul the mask position with numpy : 0.0001513957977294922 nb_pixel_total : 6326 time to create 1 rle with old method : 0.008014678955078125 length of segment : 89 time for calcul the mask position with numpy : 0.0002627372741699219 nb_pixel_total : 10519 time to create 1 rle with old method : 0.012869596481323242 length of segment : 119 time for calcul the mask position with numpy : 0.0017404556274414062 nb_pixel_total : 88365 time to create 1 rle with old method : 0.11189961433410645 length of segment : 489 time for calcul the mask position with numpy : 0.000316619873046875 nb_pixel_total : 18858 time to create 1 rle with old method : 0.02253437042236328 length of segment : 130 time for calcul the mask position with numpy : 0.0002701282501220703 nb_pixel_total : 16790 time to create 1 rle with old method : 0.02029561996459961 length of segment : 139 time for calcul the mask position with numpy : 0.00027441978454589844 nb_pixel_total : 6681 time to create 1 rle with old method : 0.00809788703918457 length of segment : 93 time for calcul the mask position with numpy : 0.0003490447998046875 nb_pixel_total : 16723 time to create 1 rle with old method : 0.019959449768066406 length of segment : 242 time for calcul the mask position with numpy : 0.0002658367156982422 nb_pixel_total : 8797 time to create 1 rle with old method : 0.010503768920898438 length of segment : 178 time for calcul the mask position with numpy : 0.0002110004425048828 nb_pixel_total : 10845 time to create 1 rle with old method : 0.013368606567382812 length of segment : 123 time for calcul the mask position with numpy : 0.00019359588623046875 nb_pixel_total : 3098 time to create 1 rle with old method : 0.004044294357299805 length of segment : 59 time for calcul the mask position with numpy : 0.0003821849822998047 nb_pixel_total : 8434 time to create 1 rle with old method : 0.010251998901367188 length of segment : 112 time for calcul the mask position with numpy : 0.0004553794860839844 nb_pixel_total : 11152 time to create 1 rle with old method : 0.013379335403442383 length of segment : 181 time for calcul the mask position with numpy : 0.00069427490234375 nb_pixel_total : 16734 time to create 1 rle with old method : 0.020068645477294922 length of segment : 228 time for calcul the mask position with numpy : 0.00041604042053222656 nb_pixel_total : 17733 time to create 1 rle with old method : 0.021578550338745117 length of segment : 142 time for calcul the mask position with numpy : 0.0004820823669433594 nb_pixel_total : 18270 time to create 1 rle with old method : 0.022032737731933594 length of segment : 266 time for calcul the mask position with numpy : 0.0004711151123046875 nb_pixel_total : 22744 time to create 1 rle with old method : 0.0270078182220459 length of segment : 270 time for calcul the mask position with numpy : 0.00011730194091796875 nb_pixel_total : 3986 time to create 1 rle with old method : 0.005044698715209961 length of segment : 107 time for calcul the mask position with numpy : 0.00021505355834960938 nb_pixel_total : 8529 time to create 1 rle with old method : 0.010550737380981445 length of segment : 82 time for calcul the mask position with numpy : 0.0002129077911376953 nb_pixel_total : 9415 time to create 1 rle with old method : 0.011307954788208008 length of segment : 173 time for calcul the mask position with numpy : 0.0003895759582519531 nb_pixel_total : 27116 time to create 1 rle with old method : 0.032187700271606445 length of segment : 194 time for calcul the mask position with numpy : 0.0007207393646240234 nb_pixel_total : 50675 time to create 1 rle with old method : 0.05891060829162598 length of segment : 290 time for calcul the mask position with numpy : 0.001346588134765625 nb_pixel_total : 87377 time to create 1 rle with old method : 0.10632634162902832 length of segment : 267 time for calcul the mask position with numpy : 0.00026416778564453125 nb_pixel_total : 13225 time to create 1 rle with old method : 0.01620173454284668 length of segment : 120 time for calcul the mask position with numpy : 0.0006673336029052734 nb_pixel_total : 49372 time to create 1 rle with old method : 0.05800652503967285 length of segment : 298 time for calcul the mask position with numpy : 0.00021457672119140625 nb_pixel_total : 12084 time to create 1 rle with old method : 0.01453852653503418 length of segment : 162 time for calcul the mask position with numpy : 0.00024056434631347656 nb_pixel_total : 10525 time to create 1 rle with old method : 0.01269388198852539 length of segment : 180 time for calcul the mask position with numpy : 0.00017070770263671875 nb_pixel_total : 8900 time to create 1 rle with old method : 0.011081695556640625 length of segment : 153 time for calcul the mask position with numpy : 0.0013918876647949219 nb_pixel_total : 106315 time to create 1 rle with old method : 0.12528705596923828 length of segment : 519 time for calcul the mask position with numpy : 0.00029850006103515625 nb_pixel_total : 19266 time to create 1 rle with old method : 0.02322840690612793 length of segment : 127 time for calcul the mask position with numpy : 0.00010180473327636719 nb_pixel_total : 4303 time to create 1 rle with old method : 0.005635976791381836 length of segment : 58 time for calcul the mask position with numpy : 0.00011181831359863281 nb_pixel_total : 4804 time to create 1 rle with old method : 0.005902290344238281 length of segment : 83 time for calcul the mask position with numpy : 0.00015616416931152344 nb_pixel_total : 10165 time to create 1 rle with old method : 0.012087345123291016 length of segment : 141 time for calcul the mask position with numpy : 0.00022864341735839844 nb_pixel_total : 10249 time to create 1 rle with old method : 0.01235198974609375 length of segment : 173 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 2760 time to create 1 rle with old method : 0.0034711360931396484 length of segment : 60 time for calcul the mask position with numpy : 0.00013446807861328125 nb_pixel_total : 6603 time to create 1 rle with old method : 0.008163213729858398 length of segment : 82 time for calcul the mask position with numpy : 0.00013399124145507812 nb_pixel_total : 6389 time to create 1 rle with old method : 0.007950782775878906 length of segment : 100 time for calcul the mask position with numpy : 8.893013000488281e-05 nb_pixel_total : 4292 time to create 1 rle with old method : 0.005234718322753906 length of segment : 60 time for calcul the mask position with numpy : 0.0017008781433105469 nb_pixel_total : 109687 time to create 1 rle with old method : 0.13414764404296875 length of segment : 547 time for calcul the mask position with numpy : 0.0004222393035888672 nb_pixel_total : 17643 time to create 1 rle with old method : 0.021634578704833984 length of segment : 210 time for calcul the mask position with numpy : 0.00021791458129882812 nb_pixel_total : 10104 time to create 1 rle with old method : 0.012309551239013672 length of segment : 149 time for calcul the mask position with numpy : 0.00013399124145507812 nb_pixel_total : 5544 time to create 1 rle with old method : 0.00696563720703125 length of segment : 95 time for calcul the mask position with numpy : 0.00011563301086425781 nb_pixel_total : 4463 time to create 1 rle with old method : 0.005654096603393555 length of segment : 82 time for calcul the mask position with numpy : 0.0001704692840576172 nb_pixel_total : 7968 time to create 1 rle with old method : 0.009897947311401367 length of segment : 122 time for calcul the mask position with numpy : 0.00018739700317382812 nb_pixel_total : 9859 time to create 1 rle with old method : 0.011903524398803711 length of segment : 128 time for calcul the mask position with numpy : 0.00010061264038085938 nb_pixel_total : 2128 time to create 1 rle with old method : 0.0027167797088623047 length of segment : 52 time for calcul the mask position with numpy : 0.00015091896057128906 nb_pixel_total : 2762 time to create 1 rle with old method : 0.0036144256591796875 length of segment : 54 time for calcul the mask position with numpy : 0.0029888153076171875 nb_pixel_total : 89649 time to create 1 rle with old method : 0.10498952865600586 length of segment : 473 time for calcul the mask position with numpy : 0.001249551773071289 nb_pixel_total : 34096 time to create 1 rle with old method : 0.04026174545288086 length of segment : 296 time for calcul the mask position with numpy : 0.0001571178436279297 nb_pixel_total : 1850 time to create 1 rle with old method : 0.002360105514526367 length of segment : 47 time for calcul the mask position with numpy : 0.00011444091796875 nb_pixel_total : 3796 time to create 1 rle with old method : 0.004647254943847656 length of segment : 106 time for calcul the mask position with numpy : 0.0002384185791015625 nb_pixel_total : 13508 time to create 1 rle with old method : 0.016356229782104492 length of segment : 108 time for calcul the mask position with numpy : 0.0001239776611328125 nb_pixel_total : 4319 time to create 1 rle with old method : 0.005274534225463867 length of segment : 102 time for calcul the mask position with numpy : 0.00010371208190917969 nb_pixel_total : 5548 time to create 1 rle with old method : 0.006909847259521484 length of segment : 67 time for calcul the mask position with numpy : 0.0002040863037109375 nb_pixel_total : 9238 time to create 1 rle with old method : 0.011144638061523438 length of segment : 127 time for calcul the mask position with numpy : 0.015316247940063477 nb_pixel_total : 940669 time to create 1 rle with new method : 0.03001689910888672 length of segment : 1508 time for calcul the mask position with numpy : 0.00024390220642089844 nb_pixel_total : 9159 time to create 1 rle with old method : 0.011256217956542969 length of segment : 170 time for calcul the mask position with numpy : 0.0002970695495605469 nb_pixel_total : 18070 time to create 1 rle with old method : 0.021750688552856445 length of segment : 150 time for calcul the mask position with numpy : 0.00025010108947753906 nb_pixel_total : 11255 time to create 1 rle with old method : 0.013514041900634766 length of segment : 186 time for calcul the mask position with numpy : 0.00011730194091796875 nb_pixel_total : 5541 time to create 1 rle with old method : 0.006906270980834961 length of segment : 81 time for calcul the mask position with numpy : 0.0001990795135498047 nb_pixel_total : 10646 time to create 1 rle with old method : 0.012995481491088867 length of segment : 130 time for calcul the mask position with numpy : 0.000125885009765625 nb_pixel_total : 5686 time to create 1 rle with old method : 0.007038116455078125 length of segment : 87 time for calcul the mask position with numpy : 0.00010991096496582031 nb_pixel_total : 4597 time to create 1 rle with old method : 0.005590200424194336 length of segment : 139 time for calcul the mask position with numpy : 0.0006263256072998047 nb_pixel_total : 31151 time to create 1 rle with old method : 0.05144500732421875 length of segment : 355 time spent for convertir_results : 4.53693699836731 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 92 chid ids of type : 3594 Number RLEs to save : 15082 save missing photos in datou_result : time spend for datou_step_exec : 35.87549662590027 time spend to save output : 0.9384799003601074 total time spend for step 1 : 36.813976526260376 step2:crop_condition Fri Sep 19 11:01:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 22 ! batch 1 Loaded 92 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 50 About to insert : list_path_to_insert length 50 new photo from crops ! About to upload 50 photos upload in portfolio : 3736932 init cache_photo without model_param we have 50 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758272473_1919127 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 50 photos in the portfolio 3736932 time of upload the photos Elapsed time : 18.524492263793945 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3736932 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758272492_1919127 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 8 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.368175983428955 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758272495_1919127 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1046063899993896 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 26 About to insert : list_path_to_insert length 26 new photo from crops ! About to upload 26 photos upload in portfolio : 3736932 init cache_photo without model_param we have 26 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758272503_1919127 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 26 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.763159990310669 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758272511_1919127 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6790006160736084 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758272512_1919127 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0271573066711426 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1385033802, 1385033801, 1385033800, 1385033798, 1385033711, 1385033706, 1385033682, 1385033668, 1385033667, 1385033651, 1385033484, 1385033457, 1385033431, 1385033404, 1385033377, 1385033350, 1385033219, 1385033213, 1385033212, 1385033210, 1385033209, 1385033207] Looping around the photos to save general results len do output : 92 /1385042353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385042602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033802', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033801', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033800', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033798', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033711', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033706', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033682', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033668', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033667', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033651', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033484', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033457', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033431', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033404', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033377', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033350', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033219', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033213', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033212', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033210', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033209', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033207', None, None, None, None, None, '3746750') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 298 time used for this insertion : 0.02667379379272461 save_final save missing photos in datou_result : time spend for datou_step_exec : 44.237725257873535 time spend to save output : 0.03054070472717285 total time spend for step 2 : 44.26826596260071 step3:rle_unique_nms_with_priority Fri Sep 19 11:01:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 92 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.667280912399292 time for calcul the mask position with numpy : 0.19386982917785645 nb_pixel_total : 2053343 time to create 1 rle with new method : 0.09829378128051758 time for calcul the mask position with numpy : 0.006116151809692383 nb_pixel_total : 2730 time to create 1 rle with old method : 0.003079652786254883 time for calcul the mask position with numpy : 0.005969047546386719 nb_pixel_total : 10565 time to create 1 rle with old method : 0.011941909790039062 time for calcul the mask position with numpy : 0.006306886672973633 nb_pixel_total : 6962 time to create 1 rle with old method : 0.007950067520141602 create new chi : 0.34357142448425293 time to delete rle : 0.017841339111328125 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1792 TO DO : save crop sub photo not yet done ! save time : 0.15848326683044434 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.2854921817779541 time for calcul the mask position with numpy : 0.22092270851135254 nb_pixel_total : 2060250 time to create 1 rle with new method : 0.2276475429534912 time for calcul the mask position with numpy : 0.0061419010162353516 nb_pixel_total : 5916 time to create 1 rle with old method : 0.006627559661865234 time for calcul the mask position with numpy : 0.006234884262084961 nb_pixel_total : 4899 time to create 1 rle with old method : 0.005524396896362305 time for calcul the mask position with numpy : 0.005973100662231445 nb_pixel_total : 2535 time to create 1 rle with old method : 0.0028793811798095703 create new chi : 0.4906466007232666 time to delete rle : 0.0002751350402832031 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1598 TO DO : save crop sub photo not yet done ! save time : 0.1464369297027588 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.10171675682067871 time for calcul the mask position with numpy : 0.1870746612548828 nb_pixel_total : 1995889 time to create 1 rle with new method : 0.22006821632385254 time for calcul the mask position with numpy : 0.006285429000854492 nb_pixel_total : 7209 time to create 1 rle with old method : 0.00806879997253418 time for calcul the mask position with numpy : 0.005728006362915039 nb_pixel_total : 5075 time to create 1 rle with old method : 0.0054967403411865234 time for calcul the mask position with numpy : 0.006145477294921875 nb_pixel_total : 9536 time to create 1 rle with old method : 0.010457277297973633 time for calcul the mask position with numpy : 0.006379127502441406 nb_pixel_total : 55891 time to create 1 rle with old method : 0.06276679039001465 create new chi : 0.5271382331848145 time to delete rle : 0.0003368854522705078 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 2141 TO DO : save crop sub photo not yet done ! save time : 0.17141246795654297 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.0486299991607666 time for calcul the mask position with numpy : 0.01918196678161621 nb_pixel_total : 2049476 time to create 1 rle with new method : 0.07734322547912598 time for calcul the mask position with numpy : 0.005937814712524414 nb_pixel_total : 9489 time to create 1 rle with old method : 0.010735034942626953 time for calcul the mask position with numpy : 0.006011486053466797 nb_pixel_total : 11236 time to create 1 rle with old method : 0.012596845626831055 time for calcul the mask position with numpy : 0.006051778793334961 nb_pixel_total : 3399 time to create 1 rle with old method : 0.0037622451782226562 create new chi : 0.1484673023223877 time to delete rle : 0.0002906322479248047 batch 1 Loaded 7 chid ids of type : 3594 +++++++Number RLEs to save : 1804 TO DO : save crop sub photo not yet done ! save time : 0.15115737915039062 nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 0.3022787570953369 time for calcul the mask position with numpy : 0.1939563751220703 nb_pixel_total : 2053895 time to create 1 rle with new method : 0.07943224906921387 time for calcul the mask position with numpy : 0.005990266799926758 nb_pixel_total : 4251 time to create 1 rle with old method : 0.004858970642089844 time for calcul the mask position with numpy : 0.0063207149505615234 nb_pixel_total : 8731 time to create 1 rle with old method : 0.009793519973754883 time for calcul the mask position with numpy : 0.006062030792236328 nb_pixel_total : 1919 time to create 1 rle with old method : 0.002367734909057617 time for calcul the mask position with numpy : 0.0060939788818359375 nb_pixel_total : 4804 time to create 1 rle with old method : 0.005439043045043945 create new chi : 0.33057546615600586 time to delete rle : 0.0002963542938232422 batch 1 Loaded 9 chid ids of type : 3594 ++++++++++Number RLEs to save : 1860 TO DO : save crop sub photo not yet done ! save time : 0.161376953125 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.039440155029296875 time for calcul the mask position with numpy : 0.2732357978820801 nb_pixel_total : 2055073 time to create 1 rle with new method : 0.07321929931640625 time for calcul the mask position with numpy : 0.006361484527587891 nb_pixel_total : 8940 time to create 1 rle with old method : 0.009964704513549805 time for calcul the mask position with numpy : 0.006314754486083984 nb_pixel_total : 9587 time to create 1 rle with old method : 0.010753631591796875 create new chi : 0.38883543014526367 time to delete rle : 0.0003314018249511719 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1846 TO DO : save crop sub photo not yet done ! save time : 0.15634560585021973 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 0.3234691619873047 time for calcul the mask position with numpy : 0.18256449699401855 nb_pixel_total : 2032594 time to create 1 rle with new method : 0.2460007667541504 time for calcul the mask position with numpy : 0.00621485710144043 nb_pixel_total : 9898 time to create 1 rle with old method : 0.011484146118164062 time for calcul the mask position with numpy : 0.006058454513549805 nb_pixel_total : 4170 time to create 1 rle with old method : 0.004774570465087891 time for calcul the mask position with numpy : 0.005698204040527344 nb_pixel_total : 2131 time to create 1 rle with old method : 0.002344846725463867 time for calcul the mask position with numpy : 0.006445646286010742 nb_pixel_total : 5717 time to create 1 rle with old method : 0.006674051284790039 time for calcul the mask position with numpy : 0.005889177322387695 nb_pixel_total : 1688 time to create 1 rle with old method : 0.0018634796142578125 time for calcul the mask position with numpy : 0.005921363830566406 nb_pixel_total : 7097 time to create 1 rle with old method : 0.008021354675292969 time for calcul the mask position with numpy : 0.006655454635620117 nb_pixel_total : 10305 time to create 1 rle with old method : 0.01209259033203125 create new chi : 0.5286707878112793 time to delete rle : 0.0004038810729980469 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 2443 TO DO : save crop sub photo not yet done ! save time : 0.1842179298400879 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 0.23327946662902832 time for calcul the mask position with numpy : 0.055625200271606445 nb_pixel_total : 1915743 time to create 1 rle with new method : 0.2679016590118408 time for calcul the mask position with numpy : 0.006575822830200195 nb_pixel_total : 6681 time to create 1 rle with old method : 0.007671356201171875 time for calcul the mask position with numpy : 0.006049633026123047 nb_pixel_total : 16790 time to create 1 rle with old method : 0.019322872161865234 time for calcul the mask position with numpy : 0.006146430969238281 nb_pixel_total : 18858 time to create 1 rle with old method : 0.021538972854614258 time for calcul the mask position with numpy : 0.0066356658935546875 nb_pixel_total : 88365 time to create 1 rle with old method : 0.09964108467102051 time for calcul the mask position with numpy : 0.009751081466674805 nb_pixel_total : 10519 time to create 1 rle with old method : 0.01204681396484375 time for calcul the mask position with numpy : 0.010121345520019531 nb_pixel_total : 6326 time to create 1 rle with old method : 0.007300615310668945 time for calcul the mask position with numpy : 0.009923219680786133 nb_pixel_total : 3923 time to create 1 rle with old method : 0.004570484161376953 time for calcul the mask position with numpy : 0.009721517562866211 nb_pixel_total : 2114 time to create 1 rle with old method : 0.0023310184478759766 time for calcul the mask position with numpy : 0.010154962539672852 nb_pixel_total : 4281 time to create 1 rle with old method : 0.004766225814819336 create new chi : 0.5878067016601562 time to delete rle : 0.0005733966827392578 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 3616 TO DO : save crop sub photo not yet done ! save time : 0.27173519134521484 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.07395243644714355 time for calcul the mask position with numpy : 0.018999338150024414 nb_pixel_total : 2037235 time to create 1 rle with new method : 0.028461456298828125 time for calcul the mask position with numpy : 0.005837678909301758 nb_pixel_total : 10845 time to create 1 rle with old method : 0.012489557266235352 time for calcul the mask position with numpy : 0.005894899368286133 nb_pixel_total : 8797 time to create 1 rle with old method : 0.010132074356079102 time for calcul the mask position with numpy : 0.006064653396606445 nb_pixel_total : 16723 time to create 1 rle with old method : 0.019704103469848633 create new chi : 0.10794186592102051 time to delete rle : 0.00032806396484375 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 2166 TO DO : save crop sub photo not yet done ! save time : 0.17633557319641113 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.039075613021850586 time for calcul the mask position with numpy : 0.019036531448364258 nb_pixel_total : 2070502 time to create 1 rle with new method : 0.030385255813598633 time for calcul the mask position with numpy : 0.007170438766479492 nb_pixel_total : 3098 time to create 1 rle with old method : 0.0035552978515625 create new chi : 0.06040811538696289 time to delete rle : 0.00020575523376464844 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1198 TO DO : save crop sub photo not yet done ! save time : 0.12038040161132812 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 1.0085759162902832 time for calcul the mask position with numpy : 0.1332387924194336 nb_pixel_total : 1994920 time to create 1 rle with new method : 0.25846266746520996 time for calcul the mask position with numpy : 0.0072939395904541016 nb_pixel_total : 6357 time to create 1 rle with old method : 0.008916616439819336 time for calcul the mask position with numpy : 0.0076334476470947266 nb_pixel_total : 18270 time to create 1 rle with old method : 0.023138046264648438 time for calcul the mask position with numpy : 0.006577730178833008 nb_pixel_total : 17733 time to create 1 rle with old method : 0.020682334899902344 time for calcul the mask position with numpy : 0.006608247756958008 nb_pixel_total : 16734 time to create 1 rle with old method : 0.019160985946655273 time for calcul the mask position with numpy : 0.007021665573120117 nb_pixel_total : 11152 time to create 1 rle with old method : 0.013031005859375 time for calcul the mask position with numpy : 0.006452798843383789 nb_pixel_total : 8434 time to create 1 rle with old method : 0.009941816329956055 create new chi : 0.5402288436889648 time to delete rle : 0.000591278076171875 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 3390 TO DO : save crop sub photo not yet done ! save time : 0.24875760078430176 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05269193649291992 time for calcul the mask position with numpy : 0.02080821990966797 nb_pixel_total : 2051670 time to create 1 rle with new method : 0.17153334617614746 time for calcul the mask position with numpy : 0.007396697998046875 nb_pixel_total : 9415 time to create 1 rle with old method : 0.01120138168334961 time for calcul the mask position with numpy : 0.006951093673706055 nb_pixel_total : 8529 time to create 1 rle with old method : 0.010200023651123047 time for calcul the mask position with numpy : 0.00675654411315918 nb_pixel_total : 3986 time to create 1 rle with old method : 0.004796743392944336 create new chi : 0.24776935577392578 time to delete rle : 0.0003712177276611328 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 1804 TO DO : save crop sub photo not yet done ! save time : 0.15214133262634277 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.3117351531982422 time for calcul the mask position with numpy : 0.13111042976379395 nb_pixel_total : 1883343 time to create 1 rle with new method : 0.40734052658081055 time for calcul the mask position with numpy : 0.006242513656616211 nb_pixel_total : 10747 time to create 1 rle with old method : 0.01244044303894043 time for calcul the mask position with numpy : 0.006161928176879883 nb_pixel_total : 1137 time to create 1 rle with old method : 0.0014240741729736328 time for calcul the mask position with numpy : 0.0058863162994384766 nb_pixel_total : 13205 time to create 1 rle with old method : 0.015315532684326172 time for calcul the mask position with numpy : 0.00635838508605957 nb_pixel_total : 87377 time to create 1 rle with old method : 0.10093402862548828 time for calcul the mask position with numpy : 0.0062444210052490234 nb_pixel_total : 50675 time to create 1 rle with old method : 0.05939483642578125 time for calcul the mask position with numpy : 0.00754857063293457 nb_pixel_total : 27116 time to create 1 rle with old method : 0.03349447250366211 create new chi : 0.8099052906036377 time to delete rle : 0.0008020401000976562 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 3228 TO DO : save crop sub photo not yet done ! save time : 0.24800777435302734 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.06405115127563477 time for calcul the mask position with numpy : 0.021596908569335938 nb_pixel_total : 1928594 time to create 1 rle with new method : 0.11373591423034668 time for calcul the mask position with numpy : 0.006457090377807617 nb_pixel_total : 19266 time to create 1 rle with old method : 0.022482872009277344 time for calcul the mask position with numpy : 0.006582736968994141 nb_pixel_total : 106315 time to create 1 rle with old method : 0.12496137619018555 time for calcul the mask position with numpy : 0.0065288543701171875 nb_pixel_total : 8900 time to create 1 rle with old method : 0.010509252548217773 time for calcul the mask position with numpy : 0.006439685821533203 nb_pixel_total : 10525 time to create 1 rle with old method : 0.012293577194213867 create new chi : 0.339719295501709 time to delete rle : 0.0006542205810546875 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 3038 TO DO : save crop sub photo not yet done ! save time : 0.2542762756347656 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.07973456382751465 time for calcul the mask position with numpy : 0.24214577674865723 nb_pixel_total : 2054328 time to create 1 rle with new method : 0.20583009719848633 time for calcul the mask position with numpy : 0.006392955780029297 nb_pixel_total : 10165 time to create 1 rle with old method : 0.011853933334350586 time for calcul the mask position with numpy : 0.00609588623046875 nb_pixel_total : 4804 time to create 1 rle with old method : 0.0056209564208984375 time for calcul the mask position with numpy : 0.006158351898193359 nb_pixel_total : 4303 time to create 1 rle with old method : 0.005127429962158203 create new chi : 0.4999716281890869 time to delete rle : 0.000301361083984375 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1644 TO DO : save crop sub photo not yet done ! save time : 0.14677119255065918 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.0499119758605957 time for calcul the mask position with numpy : 0.07087087631225586 nb_pixel_total : 2053988 time to create 1 rle with new method : 0.12215089797973633 time for calcul the mask position with numpy : 0.0065860748291015625 nb_pixel_total : 6603 time to create 1 rle with old method : 0.0077724456787109375 time for calcul the mask position with numpy : 0.006314754486083984 nb_pixel_total : 2760 time to create 1 rle with old method : 0.0032503604888916016 time for calcul the mask position with numpy : 0.006387233734130859 nb_pixel_total : 10249 time to create 1 rle with old method : 0.011994600296020508 create new chi : 0.24703168869018555 time to delete rle : 0.0003097057342529297 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1710 TO DO : save crop sub photo not yet done ! save time : 0.14298319816589355 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 1.125276803970337 time for calcul the mask position with numpy : 0.20782899856567383 nb_pixel_total : 1895523 time to create 1 rle with new method : 0.08501887321472168 time for calcul the mask position with numpy : 0.006209850311279297 nb_pixel_total : 2128 time to create 1 rle with old method : 0.002538919448852539 time for calcul the mask position with numpy : 0.006094455718994141 nb_pixel_total : 9859 time to create 1 rle with old method : 0.011769294738769531 time for calcul the mask position with numpy : 0.006216526031494141 nb_pixel_total : 7968 time to create 1 rle with old method : 0.009305238723754883 time for calcul the mask position with numpy : 0.006185293197631836 nb_pixel_total : 4463 time to create 1 rle with old method : 0.005228281021118164 time for calcul the mask position with numpy : 0.0066187381744384766 nb_pixel_total : 5544 time to create 1 rle with old method : 0.007391691207885742 time for calcul the mask position with numpy : 0.006758689880371094 nb_pixel_total : 10104 time to create 1 rle with old method : 0.011594057083129883 time for calcul the mask position with numpy : 0.0064280033111572266 nb_pixel_total : 17643 time to create 1 rle with old method : 0.02088475227355957 time for calcul the mask position with numpy : 0.007227897644042969 nb_pixel_total : 109687 time to create 1 rle with old method : 0.1244056224822998 time for calcul the mask position with numpy : 0.007416725158691406 nb_pixel_total : 4292 time to create 1 rle with old method : 0.00508427619934082 time for calcul the mask position with numpy : 0.00786280632019043 nb_pixel_total : 6389 time to create 1 rle with old method : 0.00800013542175293 create new chi : 0.5769314765930176 time to delete rle : 0.0006973743438720703 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++Number RLEs to save : 4156 TO DO : save crop sub photo not yet done ! save time : 0.3078286647796631 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.061151742935180664 time for calcul the mask position with numpy : 0.02078700065612793 nb_pixel_total : 1945243 time to create 1 rle with new method : 0.03174018859863281 time for calcul the mask position with numpy : 0.00789022445678711 nb_pixel_total : 1850 time to create 1 rle with old method : 0.003025054931640625 time for calcul the mask position with numpy : 0.008595466613769531 nb_pixel_total : 34096 time to create 1 rle with old method : 0.04871010780334473 time for calcul the mask position with numpy : 0.007340192794799805 nb_pixel_total : 89649 time to create 1 rle with old method : 0.11896109580993652 time for calcul the mask position with numpy : 0.006165027618408203 nb_pixel_total : 2762 time to create 1 rle with old method : 0.0032672882080078125 create new chi : 0.2570936679840088 time to delete rle : 0.0005092620849609375 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2820 TO DO : save crop sub photo not yet done ! save time : 0.21190166473388672 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05611872673034668 time for calcul the mask position with numpy : 0.023247241973876953 nb_pixel_total : 2051977 time to create 1 rle with new method : 0.039263010025024414 time for calcul the mask position with numpy : 0.007908105850219727 nb_pixel_total : 4319 time to create 1 rle with old method : 0.005478858947753906 time for calcul the mask position with numpy : 0.007092952728271484 nb_pixel_total : 13508 time to create 1 rle with old method : 0.017000436782836914 time for calcul the mask position with numpy : 0.007206439971923828 nb_pixel_total : 3796 time to create 1 rle with old method : 0.004533290863037109 create new chi : 0.11214280128479004 time to delete rle : 0.0003230571746826172 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1712 TO DO : save crop sub photo not yet done ! save time : 0.14822673797607422 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.05989360809326172 time for calcul the mask position with numpy : 0.014232158660888672 nb_pixel_total : 1118153 time to create 1 rle with new method : 0.09138035774230957 time for calcul the mask position with numpy : 0.013785600662231445 nb_pixel_total : 940661 time to create 1 rle with new method : 0.15286612510681152 time for calcul the mask position with numpy : 0.00612640380859375 nb_pixel_total : 9238 time to create 1 rle with old method : 0.010820388793945312 time for calcul the mask position with numpy : 0.005986452102661133 nb_pixel_total : 5548 time to create 1 rle with old method : 0.006610870361328125 create new chi : 0.30988407135009766 time to delete rle : 0.0007123947143554688 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 4480 TO DO : save crop sub photo not yet done ! save time : 0.29157543182373047 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.06374454498291016 time for calcul the mask position with numpy : 0.19755983352661133 nb_pixel_total : 2046371 time to create 1 rle with new method : 0.14154672622680664 time for calcul the mask position with numpy : 0.006285429000854492 nb_pixel_total : 18070 time to create 1 rle with old method : 0.020816326141357422 time for calcul the mask position with numpy : 0.006657838821411133 nb_pixel_total : 9159 time to create 1 rle with old method : 0.010907649993896484 create new chi : 0.39298057556152344 time to delete rle : 0.00028634071350097656 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 1720 TO DO : save crop sub photo not yet done ! save time : 0.1436316967010498 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 0.3270301818847656 time for calcul the mask position with numpy : 0.22420883178710938 nb_pixel_total : 2004724 time to create 1 rle with new method : 0.21974968910217285 time for calcul the mask position with numpy : 0.006606578826904297 nb_pixel_total : 31151 time to create 1 rle with old method : 0.036086320877075195 time for calcul the mask position with numpy : 0.0061070919036865234 nb_pixel_total : 4597 time to create 1 rle with old method : 0.00545954704284668 time for calcul the mask position with numpy : 0.0067408084869384766 nb_pixel_total : 5686 time to create 1 rle with old method : 0.006658077239990234 time for calcul the mask position with numpy : 0.006052494049072266 nb_pixel_total : 10646 time to create 1 rle with old method : 0.012951374053955078 time for calcul the mask position with numpy : 0.006926774978637695 nb_pixel_total : 5541 time to create 1 rle with old method : 0.006545543670654297 time for calcul the mask position with numpy : 0.007035255432128906 nb_pixel_total : 11255 time to create 1 rle with old method : 0.013258695602416992 create new chi : 0.5751445293426514 time to delete rle : 0.0005595684051513672 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 3036 TO DO : save crop sub photo not yet done ! save time : 0.23416805267333984 map_output_result : {1385033802: (0.0, 'Should be the crop_list due to order', 0), 1385033801: (0.0, 'Should be the crop_list due to order', 0), 1385033800: (0.0, 'Should be the crop_list due to order', 0), 1385033798: (0.0, 'Should be the crop_list due to order', 0), 1385033711: (0.0, 'Should be the crop_list due to order', 0), 1385033706: (0.0, 'Should be the crop_list due to order', 0), 1385033682: (0.0, 'Should be the crop_list due to order', 0), 1385033668: (0.0, 'Should be the crop_list due to order', 0), 1385033667: (0.0, 'Should be the crop_list due to order', 0), 1385033651: (0.0, 'Should be the crop_list due to order', 0), 1385033484: (0.0, 'Should be the crop_list due to order', 0), 1385033457: (0.0, 'Should be the crop_list due to order', 0), 1385033431: (0.0, 'Should be the crop_list due to order', 0), 1385033404: (0.0, 'Should be the crop_list due to order', 0), 1385033377: (0.0, 'Should be the crop_list due to order', 0), 1385033350: (0.0, 'Should be the crop_list due to order', 0), 1385033219: (0.0, 'Should be the crop_list due to order', 0), 1385033213: (0.0, 'Should be the crop_list due to order', 0), 1385033212: (0.0, 'Should be the crop_list due to order', 0), 1385033210: (0.0, 'Should be the crop_list due to order', 0), 1385033209: (0.0, 'Should be the crop_list due to order', 0), 1385033207: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1385033802, 1385033801, 1385033800, 1385033798, 1385033711, 1385033706, 1385033682, 1385033668, 1385033667, 1385033651, 1385033484, 1385033457, 1385033431, 1385033404, 1385033377, 1385033350, 1385033219, 1385033213, 1385033212, 1385033210, 1385033209, 1385033207] Looping around the photos to save general results len do output : 22 /1385033802.Didn't retrieve data . /1385033801.Didn't retrieve data . /1385033800.Didn't retrieve data . /1385033798.Didn't retrieve data . /1385033711.Didn't retrieve data . /1385033706.Didn't retrieve data . /1385033682.Didn't retrieve data . /1385033668.Didn't retrieve data . /1385033667.Didn't retrieve data . /1385033651.Didn't retrieve data . /1385033484.Didn't retrieve data . /1385033457.Didn't retrieve data . /1385033431.Didn't retrieve data . /1385033404.Didn't retrieve data . /1385033377.Didn't retrieve data . /1385033350.Didn't retrieve data . /1385033219.Didn't retrieve data . /1385033213.Didn't retrieve data . /1385033212.Didn't retrieve data . /1385033210.Didn't retrieve data . /1385033209.Didn't retrieve data . /1385033207.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033802', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033801', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033800', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033798', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033711', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033706', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033682', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033668', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033667', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033651', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033484', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033457', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033431', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033404', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033377', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033350', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033219', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033213', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033212', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033210', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033209', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033207', None, None, None, None, None, '3746750') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 66 time used for this insertion : 0.022540807723999023 save_final save missing photos in datou_result : time spend for datou_step_exec : 18.777838468551636 time spend to save output : 0.023321866989135742 total time spend for step 3 : 18.80116033554077 step4:ventilate_hashtags_in_portfolio Fri Sep 19 11:02:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 27037771 get user id for portfolio 27037771 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27037771 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','carton','flou','pet_clair','pet_fonce','mal_croppe','papier','environnement','background','metal','pehd')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27037771 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','carton','flou','pet_clair','pet_fonce','mal_croppe','papier','environnement','background','metal','pehd')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27037771 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','carton','flou','pet_clair','pet_fonce','mal_croppe','papier','environnement','background','metal','pehd')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/27038100,27038101,27038102,27038103,27038104,27038105,27038106,27038107,27038108,27038109,27038110?tags=autre,carton,flou,pet_clair,pet_fonce,mal_croppe,papier,environnement,background,metal,pehd Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1385033802, 1385033801, 1385033800, 1385033798, 1385033711, 1385033706, 1385033682, 1385033668, 1385033667, 1385033651, 1385033484, 1385033457, 1385033431, 1385033404, 1385033377, 1385033350, 1385033219, 1385033213, 1385033212, 1385033210, 1385033209, 1385033207] Looping around the photos to save general results len do output : 1 /27037771. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033802', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033801', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033800', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033798', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033711', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033706', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033682', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033668', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033667', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033651', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033484', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033457', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033431', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033404', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033377', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033350', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033219', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033213', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033212', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033210', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033209', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033207', None, None, None, None, None, '3746750') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 23 time used for this insertion : 0.015188932418823242 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.7906398773193359 time spend to save output : 0.015566110610961914 total time spend for step 4 : 0.8062059879302979 step5:final Fri Sep 19 11:02:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1385033802: ('0.049680090838945035',), 1385033801: ('0.049680090838945035',), 1385033800: ('0.049680090838945035',), 1385033798: ('0.049680090838945035',), 1385033711: ('0.049680090838945035',), 1385033706: ('0.049680090838945035',), 1385033682: ('0.049680090838945035',), 1385033668: ('0.049680090838945035',), 1385033667: ('0.049680090838945035',), 1385033651: ('0.049680090838945035',), 1385033484: ('0.049680090838945035',), 1385033457: ('0.049680090838945035',), 1385033431: ('0.049680090838945035',), 1385033404: ('0.049680090838945035',), 1385033377: ('0.049680090838945035',), 1385033350: ('0.049680090838945035',), 1385033219: ('0.049680090838945035',), 1385033213: ('0.049680090838945035',), 1385033212: ('0.049680090838945035',), 1385033210: ('0.049680090838945035',), 1385033209: ('0.049680090838945035',), 1385033207: ('0.049680090838945035',)} new output for save of step final : {1385033802: ('0.049680090838945035',), 1385033801: ('0.049680090838945035',), 1385033800: ('0.049680090838945035',), 1385033798: ('0.049680090838945035',), 1385033711: ('0.049680090838945035',), 1385033706: ('0.049680090838945035',), 1385033682: ('0.049680090838945035',), 1385033668: ('0.049680090838945035',), 1385033667: ('0.049680090838945035',), 1385033651: ('0.049680090838945035',), 1385033484: ('0.049680090838945035',), 1385033457: ('0.049680090838945035',), 1385033431: ('0.049680090838945035',), 1385033404: ('0.049680090838945035',), 1385033377: ('0.049680090838945035',), 1385033350: ('0.049680090838945035',), 1385033219: ('0.049680090838945035',), 1385033213: ('0.049680090838945035',), 1385033212: ('0.049680090838945035',), 1385033210: ('0.049680090838945035',), 1385033209: ('0.049680090838945035',), 1385033207: ('0.049680090838945035',)} [1385033802, 1385033801, 1385033800, 1385033798, 1385033711, 1385033706, 1385033682, 1385033668, 1385033667, 1385033651, 1385033484, 1385033457, 1385033431, 1385033404, 1385033377, 1385033350, 1385033219, 1385033213, 1385033212, 1385033210, 1385033209, 1385033207] Looping around the photos to save general results len do output : 22 /1385033802.Didn't retrieve data . /1385033801.Didn't retrieve data . /1385033800.Didn't retrieve data . /1385033798.Didn't retrieve data . /1385033711.Didn't retrieve data . /1385033706.Didn't retrieve data . /1385033682.Didn't retrieve data . /1385033668.Didn't retrieve data . /1385033667.Didn't retrieve data . /1385033651.Didn't retrieve data . /1385033484.Didn't retrieve data . /1385033457.Didn't retrieve data . /1385033431.Didn't retrieve data . /1385033404.Didn't retrieve data . /1385033377.Didn't retrieve data . /1385033350.Didn't retrieve data . /1385033219.Didn't retrieve data . /1385033213.Didn't retrieve data . /1385033212.Didn't retrieve data . /1385033210.Didn't retrieve data . /1385033209.Didn't retrieve data . /1385033207.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033802', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033801', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033800', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033798', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033711', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033706', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033682', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033668', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033667', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033651', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033484', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033457', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033431', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033404', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033377', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033350', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033219', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033213', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033212', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033210', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033209', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033207', None, None, None, None, None, '3746750') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 66 time used for this insertion : 0.01497197151184082 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12193632125854492 time spend to save output : 0.016011714935302734 total time spend for step 5 : 0.13794803619384766 step6:blur_detection Fri Sep 19 11:02:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1758272429_1919127_1385033802_ade8c0325cc5a03ba67d21ab0938f865.jpg resize: (1080, 1920) 1385033802 -0.6697805393510666 treat image : temp/1758272429_1919127_1385033801_0cae4a1e203de53d7b225a3fdbd1d6df.jpg resize: (1080, 1920) 1385033801 0.9956318962418534 treat image : temp/1758272429_1919127_1385033800_881e55735e3101fcb17240407f75b5cd.jpg resize: (1080, 1920) 1385033800 -3.238784939014737 treat image : temp/1758272429_1919127_1385033798_5b000941204303b5a7384ccdaa6cfc8c.jpg resize: (1080, 1920) 1385033798 -0.7230108759308328 treat image : temp/1758272429_1919127_1385033711_30eec6201dd699ba3dd352304a0fc47b.jpg resize: (1080, 1920) 1385033711 -0.14959912353230542 treat image : temp/1758272429_1919127_1385033706_4914e986d4f38569eded47d522278f71.jpg resize: (1080, 1920) 1385033706 0.9414925624743676 treat image : temp/1758272429_1919127_1385033682_03a12ee28db1d0e5a03cf45ff7105b58.jpg resize: (1080, 1920) 1385033682 0.31513292775735097 treat image : temp/1758272429_1919127_1385033668_441bcbba0ae520e2de0165ce4563d782.jpg resize: (1080, 1920) 1385033668 -0.05776326332725409 treat image : temp/1758272429_1919127_1385033667_4130dbc7c19144d4d53f1d2a8bda0c1e.jpg resize: (1080, 1920) 1385033667 -0.47328535034490543 treat image : temp/1758272429_1919127_1385033651_74e1d48bf586c01039f9d5030cb877f7.jpg resize: (1080, 1920) 1385033651 0.05832973036957455 treat image : temp/1758272429_1919127_1385033484_7953613bd2d2dae2aad107124aaa65bf.jpg resize: (1080, 1920) 1385033484 0.5582344637333662 treat image : temp/1758272429_1919127_1385033457_41da97dbe0aa1aa4b180fddc13c8173c.jpg resize: (1080, 1920) 1385033457 -0.48913323455865876 treat image : temp/1758272429_1919127_1385033431_7658558ea46862ba2a1b35c804cc7820.jpg resize: (1080, 1920) 1385033431 0.2872158509498353 treat image : temp/1758272429_1919127_1385033404_2d44188b08b6575708a5685b16f27cc5.jpg resize: (1080, 1920) 1385033404 -0.6477487576927415 treat image : temp/1758272429_1919127_1385033377_d0dbc7f466e2c99de5b6055dbfa91ab0.jpg resize: (1080, 1920) 1385033377 0.6275653022924151 treat image : temp/1758272429_1919127_1385033350_2f9f58b124f2cbcbe17086f169bbc4e0.jpg resize: (1080, 1920) 1385033350 -0.14931577860054496 treat image : temp/1758272429_1919127_1385033219_f4a50b3fba27d870ee417dfbb74e9e0f.jpg resize: (1080, 1920) 1385033219 -0.25001694108242534 treat image : temp/1758272429_1919127_1385033213_a2857e2266658426473fe27e99551508.jpg resize: (1080, 1920) 1385033213 -0.15439418233635152 treat image : temp/1758272429_1919127_1385033212_9dc9f83b1b0555363ceb98720c2e0c46.jpg resize: (1080, 1920) 1385033212 -0.20788116086517164 treat image : temp/1758272429_1919127_1385033210_cab0e2b785d96542c4082a5a0a056e2e.jpg resize: (1080, 1920) 1385033210 0.22874884854269384 treat image : temp/1758272429_1919127_1385033209_792c3fdc0417a62f35b877631a650209.jpg resize: (1080, 1920) 1385033209 0.8424801319873088 treat image : temp/1758272429_1919127_1385033207_729299b062f96095b72a1dddcb6d1634.jpg resize: (1080, 1920) 1385033207 -0.5811364850818128 treat image : temp/1758272429_1919127_1385033802_ade8c0325cc5a03ba67d21ab0938f865_rle_crop_3967557309_0.png resize: (109, 105) 1385042353 -1.8259401805961466 treat image : temp/1758272429_1919127_1385033802_ade8c0325cc5a03ba67d21ab0938f865_rle_crop_3967557310_0.png resize: (175, 110) 1385042354 -0.5788616747095277 treat image : temp/1758272429_1919127_1385033801_0cae4a1e203de53d7b225a3fdbd1d6df_rle_crop_3967557313_0.png resize: (89, 86) 1385042355 -1.430831750013428 treat image : temp/1758272429_1919127_1385033800_881e55735e3101fcb17240407f75b5cd_rle_crop_3967557315_0.png resize: (175, 482) 1385042357 -3.526733913281908 treat image : temp/1758272429_1919127_1385033800_881e55735e3101fcb17240407f75b5cd_rle_crop_3967557316_0.png resize: (179, 101) 1385042358 -1.710061502819187 treat image : temp/1758272429_1919127_1385033798_5b000941204303b5a7384ccdaa6cfc8c_rle_crop_3967557319_0.png resize: (68, 80) 1385042359 -0.43709225877056923 treat image : temp/1758272429_1919127_1385033798_5b000941204303b5a7384ccdaa6cfc8c_rle_crop_3967557321_0.png resize: (170, 104) 1385042361 -1.4455357983669685 treat image : temp/1758272429_1919127_1385033711_30eec6201dd699ba3dd352304a0fc47b_rle_crop_3967557322_0.png resize: (93, 87) 1385042362 -2.73231566031235 treat image : temp/1758272429_1919127_1385033711_30eec6201dd699ba3dd352304a0fc47b_rle_crop_3967557323_0.png resize: (173, 155) 1385042364 1.3248289841561327 treat image : temp/1758272429_1919127_1385033711_30eec6201dd699ba3dd352304a0fc47b_rle_crop_3967557324_0.png resize: (106, 104) 1385042365 0.37660571372016677 treat image : temp/1758272429_1919127_1385033711_30eec6201dd699ba3dd352304a0fc47b_rle_crop_3967557325_0.png resize: (62, 123) 1385042366 -1.8461212292255607 treat image : temp/1758272429_1919127_1385033706_4914e986d4f38569eded47d522278f71_rle_crop_3967557326_0.png resize: (171, 111) 1385042367 -1.4063851284857454 treat image : temp/1758272429_1919127_1385033682_03a12ee28db1d0e5a03cf45ff7105b58_rle_crop_3967557328_0.png resize: (176, 108) 1385042369 -0.6041705671875675 treat image : temp/1758272429_1919127_1385033682_03a12ee28db1d0e5a03cf45ff7105b58_rle_crop_3967557330_0.png resize: (38, 55) 1385042370 20.0 treat image : temp/1758272429_1919127_1385033682_03a12ee28db1d0e5a03cf45ff7105b58_rle_crop_3967557332_0.png resize: (40, 68) 1385042371 -2.8967781064944145 treat image : temp/1758272429_1919127_1385033682_03a12ee28db1d0e5a03cf45ff7105b58_rle_crop_3967557334_0.png resize: (111, 141) 1385042373 -0.9403830151849953 treat image : temp/1758272429_1919127_1385033668_441bcbba0ae520e2de0165ce4563d782_rle_crop_3967557335_0.png resize: (75, 74) 1385042374 0.8166392450501802 treat image : temp/1758272429_1919127_1385033668_441bcbba0ae520e2de0165ce4563d782_rle_crop_3967557336_0.png resize: (44, 65) 1385042375 2.645890455639581 treat image : temp/1758272429_1919127_1385033668_441bcbba0ae520e2de0165ce4563d782_rle_crop_3967557337_0.png resize: (88, 68) 1385042377 -0.7528030591851804 treat image : temp/1758272429_1919127_1385033668_441bcbba0ae520e2de0165ce4563d782_rle_crop_3967557339_0.png resize: (118, 165) 1385042378 -2.232149496182176 treat image : temp/1758272429_1919127_1385033668_441bcbba0ae520e2de0165ce4563d782_rle_crop_3967557342_0.png resize: (137, 191) 1385042379 3.3000057401762346 treat image : temp/1758272429_1919127_1385033668_441bcbba0ae520e2de0165ce4563d782_rle_crop_3967557343_0.png resize: (93, 87) 1385042381 0.8116109288502734 treat image : temp/1758272429_1919127_1385033667_4130dbc7c19144d4d53f1d2a8bda0c1e_rle_crop_3967557344_0.png resize: (206, 135) 1385042382 -1.9709456191726575 treat image : temp/1758272429_1919127_1385033667_4130dbc7c19144d4d53f1d2a8bda0c1e_rle_crop_3967557345_0.png resize: (178, 104) 1385042384 -1.8206382509046581 treat image : temp/1758272429_1919127_1385033484_7953613bd2d2dae2aad107124aaa65bf_rle_crop_3967557349_0.png resize: (181, 107) 1385042385 -0.5443729607816394 treat image : temp/1758272429_1919127_1385033484_7953613bd2d2dae2aad107124aaa65bf_rle_crop_3967557350_0.png resize: (213, 151) 1385042386 -0.8301015242769846 treat image : temp/1758272429_1919127_1385033457_41da97dbe0aa1aa4b180fddc13c8173c_rle_crop_3967557355_0.png resize: (80, 136) 1385042388 0.41082109978181125 treat image : temp/1758272429_1919127_1385033457_41da97dbe0aa1aa4b180fddc13c8173c_rle_crop_3967557356_0.png resize: (173, 88) 1385042389 -0.3531042778602584 treat image : temp/1758272429_1919127_1385033431_7658558ea46862ba2a1b35c804cc7820_rle_crop_3967557359_0.png resize: (212, 666) 1385042390 -1.51377529461187 treat image : temp/1758272429_1919127_1385033431_7658558ea46862ba2a1b35c804cc7820_rle_crop_3967557360_0.png resize: (120, 131) 1385042392 5.024290960950439 treat image : temp/1758272429_1919127_1385033431_7658558ea46862ba2a1b35c804cc7820_rle_crop_3967557361_0.png resize: (298, 252) 1385042393 -0.2146115015417416 treat image : temp/1758272429_1919127_1385033431_7658558ea46862ba2a1b35c804cc7820_rle_crop_3967557362_0.png resize: (124, 128) 1385042394 0.19922648041573973 treat image : temp/1758272429_1919127_1385033404_2d44188b08b6575708a5685b16f27cc5_rle_crop_3967557363_0.png resize: (180, 113) 1385042396 -1.073938060098566 treat image : temp/1758272429_1919127_1385033350_2f9f58b124f2cbcbe17086f169bbc4e0_rle_crop_3967557370_0.png resize: (173, 107) 1385042398 -0.5666656929328265 treat image : temp/1758272429_1919127_1385033350_2f9f58b124f2cbcbe17086f169bbc4e0_rle_crop_3967557372_0.png resize: (82, 115) 1385042400 -1.5506523227019455 treat image : temp/1758272429_1919127_1385033219_f4a50b3fba27d870ee417dfbb74e9e0f_rle_crop_3967557373_0.png resize: (100, 86) 1385042403 -0.2849221778701542 treat image : temp/1758272429_1919127_1385033219_f4a50b3fba27d870ee417dfbb74e9e0f_rle_crop_3967557374_0.png resize: (60, 88) 1385042404 0.927944318969964 treat image : temp/1758272429_1919127_1385033219_f4a50b3fba27d870ee417dfbb74e9e0f_rle_crop_3967557378_0.png resize: (83, 100) 1385042405 -1.5769780177910957 treat image : temp/1758272429_1919127_1385033219_f4a50b3fba27d870ee417dfbb74e9e0f_rle_crop_3967557380_0.png resize: (122, 117) 1385042408 -1.4714805695371749 treat image : temp/1758272429_1919127_1385033219_f4a50b3fba27d870ee417dfbb74e9e0f_rle_crop_3967557381_0.png resize: (128, 132) 1385042409 -1.289422695246547 treat image : temp/1758272429_1919127_1385033219_f4a50b3fba27d870ee417dfbb74e9e0f_rle_crop_3967557382_0.png resize: (51, 57) 1385042410 1.8494488488969236 treat image : temp/1758272429_1919127_1385033213_a2857e2266658426473fe27e99551508_rle_crop_3967557383_0.png resize: (53, 74) 1385042412 -0.7458352762661704 treat image : temp/1758272429_1919127_1385033212_9dc9f83b1b0555363ceb98720c2e0c46_rle_crop_3967557387_0.png resize: (106, 58) 1385042413 -0.6632788250013116 treat image : temp/1758272429_1919127_1385033212_9dc9f83b1b0555363ceb98720c2e0c46_rle_crop_3967557389_0.png resize: (102, 71) 1385042414 -1.3771925091684656 treat image : temp/1758272429_1919127_1385033210_cab0e2b785d96542c4082a5a0a056e2e_rle_crop_3967557391_0.png resize: (119, 121) 1385042416 -0.31494144403555047 treat image : temp/1758272429_1919127_1385033209_792c3fdc0417a62f35b877631a650209_rle_crop_3967557393_0.png resize: (170, 104) 1385042417 -1.6326960192717688 treat image : temp/1758272429_1919127_1385033209_792c3fdc0417a62f35b877631a650209_rle_crop_3967557394_0.png resize: (137, 166) 1385042418 -0.3385936560956814 treat image : temp/1758272429_1919127_1385033207_729299b062f96095b72a1dddcb6d1634_rle_crop_3967557395_0.png resize: (185, 106) 1385042420 -0.4897830323934117 treat image : temp/1758272429_1919127_1385033207_729299b062f96095b72a1dddcb6d1634_rle_crop_3967557397_0.png resize: (127, 116) 1385042421 -0.9619078097733348 treat image : temp/1758272429_1919127_1385033207_729299b062f96095b72a1dddcb6d1634_rle_crop_3967557398_0.png resize: (87, 100) 1385042422 -1.4053775337336087 treat image : temp/1758272429_1919127_1385033801_0cae4a1e203de53d7b225a3fdbd1d6df_rle_crop_3967557312_0.png resize: (76, 47) 1385042439 -0.6517982873729582 treat image : temp/1758272429_1919127_1385033801_0cae4a1e203de53d7b225a3fdbd1d6df_rle_crop_3967557314_0.png resize: (89, 91) 1385042441 -0.8021432951024392 treat image : temp/1758272429_1919127_1385033668_441bcbba0ae520e2de0165ce4563d782_rle_crop_3967557338_0.png resize: (89, 118) 1385042442 -1.7597247870623143 treat image : temp/1758272429_1919127_1385033651_74e1d48bf586c01039f9d5030cb877f7_rle_crop_3967557347_0.png resize: (59, 82) 1385042443 -1.5845136146632692 treat image : temp/1758272429_1919127_1385033484_7953613bd2d2dae2aad107124aaa65bf_rle_crop_3967557348_0.png resize: (112, 106) 1385042445 -1.2950487341620636 treat image : temp/1758272429_1919127_1385033377_d0dbc7f466e2c99de5b6055dbfa91ab0_rle_crop_3967557368_0.png resize: (83, 107) 1385042446 -2.1224384367274807 treat image : temp/1758272429_1919127_1385033377_d0dbc7f466e2c99de5b6055dbfa91ab0_rle_crop_3967557369_0.png resize: (138, 94) 1385042447 -0.009432287050747118 treat image : temp/1758272429_1919127_1385033213_a2857e2266658426473fe27e99551508_rle_crop_3967557386_0.png resize: (47, 52) 1385042449 2.7176930355542273 treat image : temp/1758272429_1919127_1385033798_5b000941204303b5a7384ccdaa6cfc8c_rle_crop_3967557320_0.png resize: (83, 175) 1385042459 -2.0996619503375418 treat image : temp/1758272429_1919127_1385033682_03a12ee28db1d0e5a03cf45ff7105b58_rle_crop_3967557329_0.png resize: (114, 89) 1385042460 -1.3582163392443356 treat image : temp/1758272429_1919127_1385033219_f4a50b3fba27d870ee417dfbb74e9e0f_rle_crop_3967557379_0.png resize: (82, 73) 1385042461 -2.1726554284179262 treat image : temp/1758272429_1919127_1385033207_729299b062f96095b72a1dddcb6d1634_rle_crop_3967557396_0.png resize: (81, 86) 1385042463 0.5824403041758943 treat image : temp/1758272429_1919127_1385033802_ade8c0325cc5a03ba67d21ab0938f865_rle_crop_3967557311_0.png resize: (72, 57) 1385042547 -1.823223874729622 treat image : temp/1758272429_1919127_1385033800_881e55735e3101fcb17240407f75b5cd_rle_crop_3967557318_0.png resize: (129, 125) 1385042548 -3.847510442384141 treat image : temp/1758272429_1919127_1385033706_4914e986d4f38569eded47d522278f71_rle_crop_3967557327_0.png resize: (211, 67) 1385042550 -1.9575547873405077 treat image : temp/1758272429_1919127_1385033682_03a12ee28db1d0e5a03cf45ff7105b58_rle_crop_3967557331_0.png resize: (122, 63) 1385042551 -0.6186468529863753 treat image : temp/1758272429_1919127_1385033682_03a12ee28db1d0e5a03cf45ff7105b58_rle_crop_3967557333_0.png resize: (89, 95) 1385042552 -1.4085181491505414 treat image : temp/1758272429_1919127_1385033668_441bcbba0ae520e2de0165ce4563d782_rle_crop_3967557340_0.png resize: (465, 315) 1385042553 -0.594555776665748 treat image : temp/1758272429_1919127_1385033668_441bcbba0ae520e2de0165ce4563d782_rle_crop_3967557341_0.png resize: (129, 202) 1385042555 -0.6616894064913266 treat image : temp/1758272429_1919127_1385033667_4130dbc7c19144d4d53f1d2a8bda0c1e_rle_crop_3967557346_0.png resize: (123, 117) 1385042556 -1.8588378191019217 treat image : temp/1758272429_1919127_1385033484_7953613bd2d2dae2aad107124aaa65bf_rle_crop_3967557351_0.png resize: (142, 160) 1385042557 -0.8336213590180374 treat image : temp/1758272429_1919127_1385033484_7953613bd2d2dae2aad107124aaa65bf_rle_crop_3967557352_0.png resize: (254, 110) 1385042559 -0.6706805164137194 treat image : temp/1758272429_1919127_1385033484_7953613bd2d2dae2aad107124aaa65bf_rle_crop_3967557353_0.png resize: (270, 169) 1385042560 -1.0324610266240069 treat image : temp/1758272429_1919127_1385033457_41da97dbe0aa1aa4b180fddc13c8173c_rle_crop_3967557354_0.png resize: (78, 80) 1385042561 -2.1770826439379687 treat image : temp/1758272429_1919127_1385033431_7658558ea46862ba2a1b35c804cc7820_rle_crop_3967557357_0.png resize: (192, 178) 1385042563 -1.3920949678054624 treat image : temp/1758272429_1919127_1385033431_7658558ea46862ba2a1b35c804cc7820_rle_crop_3967557358_0.png resize: (289, 262) 1385042564 -0.20611724008928023 treat image : temp/1758272429_1919127_1385033404_2d44188b08b6575708a5685b16f27cc5_rle_crop_3967557364_0.png resize: (111, 144) 1385042565 -2.464352052445277 treat image : temp/1758272429_1919127_1385033404_2d44188b08b6575708a5685b16f27cc5_rle_crop_3967557365_0.png resize: (516, 341) 1385042567 0.10115122205435462 treat image : temp/1758272429_1919127_1385033404_2d44188b08b6575708a5685b16f27cc5_rle_crop_3967557366_0.png resize: (120, 230) 1385042568 -0.655044895981553 treat image : temp/1758272429_1919127_1385033377_d0dbc7f466e2c99de5b6055dbfa91ab0_rle_crop_3967557367_0.png resize: (56, 115) 1385042569 -1.1436768025183188 treat image : temp/1758272429_1919127_1385033350_2f9f58b124f2cbcbe17086f169bbc4e0_rle_crop_3967557371_0.png resize: (60, 59) 1385042571 -1.281536406400468 treat image : temp/1758272429_1919127_1385033219_f4a50b3fba27d870ee417dfbb74e9e0f_rle_crop_3967557375_0.png resize: (543, 336) 1385042572 0.11751966315252069 treat image : temp/1758272429_1919127_1385033219_f4a50b3fba27d870ee417dfbb74e9e0f_rle_crop_3967557376_0.png resize: (192, 153) 1385042573 -1.7918170663698008 treat image : temp/1758272429_1919127_1385033213_a2857e2266658426473fe27e99551508_rle_crop_3967557384_0.png resize: (468, 346) 1385042575 -0.43989391520301263 treat image : temp/1758272429_1919127_1385033213_a2857e2266658426473fe27e99551508_rle_crop_3967557385_0.png resize: (296, 264) 1385042576 -0.7126107473053567 treat image : temp/1758272429_1919127_1385033212_9dc9f83b1b0555363ceb98720c2e0c46_rle_crop_3967557388_0.png resize: (101, 168) 1385042577 -0.8141050133521567 treat image : temp/1758272429_1919127_1385033210_cab0e2b785d96542c4082a5a0a056e2e_rle_crop_3967557392_0.png resize: (962, 1261) 1385042579 -0.21709096657383808 treat image : temp/1758272429_1919127_1385033207_729299b062f96095b72a1dddcb6d1634_rle_crop_3967557400_0.png resize: (355, 146) 1385042580 -0.4225228102457139 treat image : temp/1758272429_1919127_1385033207_729299b062f96095b72a1dddcb6d1634_rle_crop_3967557399_0.png resize: (139, 45) 1385042588 0.07922814968973223 treat image : temp/1758272429_1919127_1385033800_881e55735e3101fcb17240407f75b5cd_rle_crop_3967557317_0.png resize: (76, 112) 1385042599 -2.009760362267005 treat image : temp/1758272429_1919127_1385033219_f4a50b3fba27d870ee417dfbb74e9e0f_rle_crop_3967557377_0.png resize: (136, 109) 1385042600 -1.0544470205726344 treat image : temp/1758272429_1919127_1385033210_cab0e2b785d96542c4082a5a0a056e2e_rle_crop_3967557390_0.png resize: (65, 101) 1385042602 2.973615502409281 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 114 time used for this insertion : 0.018967628479003906 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 114 time used for this insertion : 0.03199052810668945 save missing photos in datou_result : time spend for datou_step_exec : 18.280729055404663 time spend to save output : 0.05608725547790527 total time spend for step 6 : 18.33681631088257 step7:brightness Fri Sep 19 11:02:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1758272429_1919127_1385033802_ade8c0325cc5a03ba67d21ab0938f865.jpg treat image : temp/1758272429_1919127_1385033801_0cae4a1e203de53d7b225a3fdbd1d6df.jpg treat image : temp/1758272429_1919127_1385033800_881e55735e3101fcb17240407f75b5cd.jpg treat image : temp/1758272429_1919127_1385033798_5b000941204303b5a7384ccdaa6cfc8c.jpg treat image : temp/1758272429_1919127_1385033711_30eec6201dd699ba3dd352304a0fc47b.jpg treat image : temp/1758272429_1919127_1385033706_4914e986d4f38569eded47d522278f71.jpg treat image : temp/1758272429_1919127_1385033682_03a12ee28db1d0e5a03cf45ff7105b58.jpg treat image : temp/1758272429_1919127_1385033668_441bcbba0ae520e2de0165ce4563d782.jpg treat image : temp/1758272429_1919127_1385033667_4130dbc7c19144d4d53f1d2a8bda0c1e.jpg treat image : temp/1758272429_1919127_1385033651_74e1d48bf586c01039f9d5030cb877f7.jpg treat image : temp/1758272429_1919127_1385033484_7953613bd2d2dae2aad107124aaa65bf.jpg treat image : temp/1758272429_1919127_1385033457_41da97dbe0aa1aa4b180fddc13c8173c.jpg treat image : temp/1758272429_1919127_1385033431_7658558ea46862ba2a1b35c804cc7820.jpg treat image : temp/1758272429_1919127_1385033404_2d44188b08b6575708a5685b16f27cc5.jpg treat image : temp/1758272429_1919127_1385033377_d0dbc7f466e2c99de5b6055dbfa91ab0.jpg treat image : temp/1758272429_1919127_1385033350_2f9f58b124f2cbcbe17086f169bbc4e0.jpg treat image : temp/1758272429_1919127_1385033219_f4a50b3fba27d870ee417dfbb74e9e0f.jpg treat image : temp/1758272429_1919127_1385033213_a2857e2266658426473fe27e99551508.jpg treat image : temp/1758272429_1919127_1385033212_9dc9f83b1b0555363ceb98720c2e0c46.jpg treat image : temp/1758272429_1919127_1385033210_cab0e2b785d96542c4082a5a0a056e2e.jpg treat image : temp/1758272429_1919127_1385033209_792c3fdc0417a62f35b877631a650209.jpg treat image : temp/1758272429_1919127_1385033207_729299b062f96095b72a1dddcb6d1634.jpg treat image : temp/1758272429_1919127_1385033802_ade8c0325cc5a03ba67d21ab0938f865_rle_crop_3967557309_0.png treat image : temp/1758272429_1919127_1385033802_ade8c0325cc5a03ba67d21ab0938f865_rle_crop_3967557310_0.png treat image : temp/1758272429_1919127_1385033801_0cae4a1e203de53d7b225a3fdbd1d6df_rle_crop_3967557313_0.png treat image : temp/1758272429_1919127_1385033800_881e55735e3101fcb17240407f75b5cd_rle_crop_3967557315_0.png treat image : temp/1758272429_1919127_1385033800_881e55735e3101fcb17240407f75b5cd_rle_crop_3967557316_0.png treat image : temp/1758272429_1919127_1385033798_5b000941204303b5a7384ccdaa6cfc8c_rle_crop_3967557319_0.png treat image : temp/1758272429_1919127_1385033798_5b000941204303b5a7384ccdaa6cfc8c_rle_crop_3967557321_0.png treat image : temp/1758272429_1919127_1385033711_30eec6201dd699ba3dd352304a0fc47b_rle_crop_3967557322_0.png treat image : temp/1758272429_1919127_1385033711_30eec6201dd699ba3dd352304a0fc47b_rle_crop_3967557323_0.png treat image : temp/1758272429_1919127_1385033711_30eec6201dd699ba3dd352304a0fc47b_rle_crop_3967557324_0.png treat image : temp/1758272429_1919127_1385033711_30eec6201dd699ba3dd352304a0fc47b_rle_crop_3967557325_0.png treat image : temp/1758272429_1919127_1385033706_4914e986d4f38569eded47d522278f71_rle_crop_3967557326_0.png treat image : temp/1758272429_1919127_1385033682_03a12ee28db1d0e5a03cf45ff7105b58_rle_crop_3967557328_0.png treat image : temp/1758272429_1919127_1385033682_03a12ee28db1d0e5a03cf45ff7105b58_rle_crop_3967557330_0.png treat image : temp/1758272429_1919127_1385033682_03a12ee28db1d0e5a03cf45ff7105b58_rle_crop_3967557332_0.png treat image : temp/1758272429_1919127_1385033682_03a12ee28db1d0e5a03cf45ff7105b58_rle_crop_3967557334_0.png treat image : temp/1758272429_1919127_1385033668_441bcbba0ae520e2de0165ce4563d782_rle_crop_3967557335_0.png treat image : temp/1758272429_1919127_1385033668_441bcbba0ae520e2de0165ce4563d782_rle_crop_3967557336_0.png treat image : temp/1758272429_1919127_1385033668_441bcbba0ae520e2de0165ce4563d782_rle_crop_3967557337_0.png treat image : temp/1758272429_1919127_1385033668_441bcbba0ae520e2de0165ce4563d782_rle_crop_3967557339_0.png treat image : temp/1758272429_1919127_1385033668_441bcbba0ae520e2de0165ce4563d782_rle_crop_3967557342_0.png treat image : temp/1758272429_1919127_1385033668_441bcbba0ae520e2de0165ce4563d782_rle_crop_3967557343_0.png treat image : temp/1758272429_1919127_1385033667_4130dbc7c19144d4d53f1d2a8bda0c1e_rle_crop_3967557344_0.png treat image : temp/1758272429_1919127_1385033667_4130dbc7c19144d4d53f1d2a8bda0c1e_rle_crop_3967557345_0.png treat image : temp/1758272429_1919127_1385033484_7953613bd2d2dae2aad107124aaa65bf_rle_crop_3967557349_0.png treat image : temp/1758272429_1919127_1385033484_7953613bd2d2dae2aad107124aaa65bf_rle_crop_3967557350_0.png treat image : temp/1758272429_1919127_1385033457_41da97dbe0aa1aa4b180fddc13c8173c_rle_crop_3967557355_0.png treat image : temp/1758272429_1919127_1385033457_41da97dbe0aa1aa4b180fddc13c8173c_rle_crop_3967557356_0.png treat image : temp/1758272429_1919127_1385033431_7658558ea46862ba2a1b35c804cc7820_rle_crop_3967557359_0.png treat image : temp/1758272429_1919127_1385033431_7658558ea46862ba2a1b35c804cc7820_rle_crop_3967557360_0.png treat image : temp/1758272429_1919127_1385033431_7658558ea46862ba2a1b35c804cc7820_rle_crop_3967557361_0.png treat image : temp/1758272429_1919127_1385033431_7658558ea46862ba2a1b35c804cc7820_rle_crop_3967557362_0.png treat image : temp/1758272429_1919127_1385033404_2d44188b08b6575708a5685b16f27cc5_rle_crop_3967557363_0.png treat image : temp/1758272429_1919127_1385033350_2f9f58b124f2cbcbe17086f169bbc4e0_rle_crop_3967557370_0.png treat image : temp/1758272429_1919127_1385033350_2f9f58b124f2cbcbe17086f169bbc4e0_rle_crop_3967557372_0.png treat image : temp/1758272429_1919127_1385033219_f4a50b3fba27d870ee417dfbb74e9e0f_rle_crop_3967557373_0.png treat image : temp/1758272429_1919127_1385033219_f4a50b3fba27d870ee417dfbb74e9e0f_rle_crop_3967557374_0.png treat image : temp/1758272429_1919127_1385033219_f4a50b3fba27d870ee417dfbb74e9e0f_rle_crop_3967557378_0.png treat image : temp/1758272429_1919127_1385033219_f4a50b3fba27d870ee417dfbb74e9e0f_rle_crop_3967557380_0.png treat image : temp/1758272429_1919127_1385033219_f4a50b3fba27d870ee417dfbb74e9e0f_rle_crop_3967557381_0.png treat image : temp/1758272429_1919127_1385033219_f4a50b3fba27d870ee417dfbb74e9e0f_rle_crop_3967557382_0.png treat image : temp/1758272429_1919127_1385033213_a2857e2266658426473fe27e99551508_rle_crop_3967557383_0.png treat image : temp/1758272429_1919127_1385033212_9dc9f83b1b0555363ceb98720c2e0c46_rle_crop_3967557387_0.png treat image : temp/1758272429_1919127_1385033212_9dc9f83b1b0555363ceb98720c2e0c46_rle_crop_3967557389_0.png treat image : temp/1758272429_1919127_1385033210_cab0e2b785d96542c4082a5a0a056e2e_rle_crop_3967557391_0.png treat image : temp/1758272429_1919127_1385033209_792c3fdc0417a62f35b877631a650209_rle_crop_3967557393_0.png treat image : temp/1758272429_1919127_1385033209_792c3fdc0417a62f35b877631a650209_rle_crop_3967557394_0.png treat image : temp/1758272429_1919127_1385033207_729299b062f96095b72a1dddcb6d1634_rle_crop_3967557395_0.png treat image : temp/1758272429_1919127_1385033207_729299b062f96095b72a1dddcb6d1634_rle_crop_3967557397_0.png treat image : temp/1758272429_1919127_1385033207_729299b062f96095b72a1dddcb6d1634_rle_crop_3967557398_0.png treat image : temp/1758272429_1919127_1385033801_0cae4a1e203de53d7b225a3fdbd1d6df_rle_crop_3967557312_0.png treat image : temp/1758272429_1919127_1385033801_0cae4a1e203de53d7b225a3fdbd1d6df_rle_crop_3967557314_0.png treat image : temp/1758272429_1919127_1385033668_441bcbba0ae520e2de0165ce4563d782_rle_crop_3967557338_0.png treat image : temp/1758272429_1919127_1385033651_74e1d48bf586c01039f9d5030cb877f7_rle_crop_3967557347_0.png treat image : temp/1758272429_1919127_1385033484_7953613bd2d2dae2aad107124aaa65bf_rle_crop_3967557348_0.png treat image : temp/1758272429_1919127_1385033377_d0dbc7f466e2c99de5b6055dbfa91ab0_rle_crop_3967557368_0.png treat image : temp/1758272429_1919127_1385033377_d0dbc7f466e2c99de5b6055dbfa91ab0_rle_crop_3967557369_0.png treat image : temp/1758272429_1919127_1385033213_a2857e2266658426473fe27e99551508_rle_crop_3967557386_0.png treat image : temp/1758272429_1919127_1385033798_5b000941204303b5a7384ccdaa6cfc8c_rle_crop_3967557320_0.png treat image : temp/1758272429_1919127_1385033682_03a12ee28db1d0e5a03cf45ff7105b58_rle_crop_3967557329_0.png treat image : temp/1758272429_1919127_1385033219_f4a50b3fba27d870ee417dfbb74e9e0f_rle_crop_3967557379_0.png treat image : temp/1758272429_1919127_1385033207_729299b062f96095b72a1dddcb6d1634_rle_crop_3967557396_0.png treat image : temp/1758272429_1919127_1385033802_ade8c0325cc5a03ba67d21ab0938f865_rle_crop_3967557311_0.png treat image : temp/1758272429_1919127_1385033800_881e55735e3101fcb17240407f75b5cd_rle_crop_3967557318_0.png treat image : temp/1758272429_1919127_1385033706_4914e986d4f38569eded47d522278f71_rle_crop_3967557327_0.png treat image : temp/1758272429_1919127_1385033682_03a12ee28db1d0e5a03cf45ff7105b58_rle_crop_3967557331_0.png treat image : temp/1758272429_1919127_1385033682_03a12ee28db1d0e5a03cf45ff7105b58_rle_crop_3967557333_0.png treat image : temp/1758272429_1919127_1385033668_441bcbba0ae520e2de0165ce4563d782_rle_crop_3967557340_0.png treat image : temp/1758272429_1919127_1385033668_441bcbba0ae520e2de0165ce4563d782_rle_crop_3967557341_0.png treat image : temp/1758272429_1919127_1385033667_4130dbc7c19144d4d53f1d2a8bda0c1e_rle_crop_3967557346_0.png treat image : temp/1758272429_1919127_1385033484_7953613bd2d2dae2aad107124aaa65bf_rle_crop_3967557351_0.png treat image : temp/1758272429_1919127_1385033484_7953613bd2d2dae2aad107124aaa65bf_rle_crop_3967557352_0.png treat image : temp/1758272429_1919127_1385033484_7953613bd2d2dae2aad107124aaa65bf_rle_crop_3967557353_0.png treat image : temp/1758272429_1919127_1385033457_41da97dbe0aa1aa4b180fddc13c8173c_rle_crop_3967557354_0.png treat image : temp/1758272429_1919127_1385033431_7658558ea46862ba2a1b35c804cc7820_rle_crop_3967557357_0.png treat image : temp/1758272429_1919127_1385033431_7658558ea46862ba2a1b35c804cc7820_rle_crop_3967557358_0.png treat image : temp/1758272429_1919127_1385033404_2d44188b08b6575708a5685b16f27cc5_rle_crop_3967557364_0.png treat image : temp/1758272429_1919127_1385033404_2d44188b08b6575708a5685b16f27cc5_rle_crop_3967557365_0.png treat image : temp/1758272429_1919127_1385033404_2d44188b08b6575708a5685b16f27cc5_rle_crop_3967557366_0.png treat image : temp/1758272429_1919127_1385033377_d0dbc7f466e2c99de5b6055dbfa91ab0_rle_crop_3967557367_0.png treat image : temp/1758272429_1919127_1385033350_2f9f58b124f2cbcbe17086f169bbc4e0_rle_crop_3967557371_0.png treat image : temp/1758272429_1919127_1385033219_f4a50b3fba27d870ee417dfbb74e9e0f_rle_crop_3967557375_0.png treat image : temp/1758272429_1919127_1385033219_f4a50b3fba27d870ee417dfbb74e9e0f_rle_crop_3967557376_0.png treat image : temp/1758272429_1919127_1385033213_a2857e2266658426473fe27e99551508_rle_crop_3967557384_0.png treat image : temp/1758272429_1919127_1385033213_a2857e2266658426473fe27e99551508_rle_crop_3967557385_0.png treat image : temp/1758272429_1919127_1385033212_9dc9f83b1b0555363ceb98720c2e0c46_rle_crop_3967557388_0.png treat image : temp/1758272429_1919127_1385033210_cab0e2b785d96542c4082a5a0a056e2e_rle_crop_3967557392_0.png treat image : temp/1758272429_1919127_1385033207_729299b062f96095b72a1dddcb6d1634_rle_crop_3967557400_0.png treat image : temp/1758272429_1919127_1385033207_729299b062f96095b72a1dddcb6d1634_rle_crop_3967557399_0.png treat image : temp/1758272429_1919127_1385033800_881e55735e3101fcb17240407f75b5cd_rle_crop_3967557317_0.png treat image : temp/1758272429_1919127_1385033219_f4a50b3fba27d870ee417dfbb74e9e0f_rle_crop_3967557377_0.png treat image : temp/1758272429_1919127_1385033210_cab0e2b785d96542c4082a5a0a056e2e_rle_crop_3967557390_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 114 time used for this insertion : 0.016275405883789062 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 114 time used for this insertion : 0.030863046646118164 save missing photos in datou_result : time spend for datou_step_exec : 5.352969408035278 time spend to save output : 0.05207657814025879 total time spend for step 7 : 5.405045986175537 step8:velours_tree Fri Sep 19 11:02:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09498214721679688 time spend to save output : 5.7697296142578125e-05 total time spend for step 8 : 0.09503984451293945 step9:send_mail_cod Fri Sep 19 11:02:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P27037771_19-09-2025_11_02_37.pdf 27038100 change filename to text .imagette270381001758272557 27038101 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette270381011758272557 27038102 imagette270381021758272557 27038103 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette270381031758272557 27038104 change filename to text .change filename to text .change filename to text .imagette270381041758272559 27038105 imagette270381051758272559 27038106 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette270381061758272559 27038108 imagette270381081758272561 27038109 change filename to text .change filename to text .change filename to text .change filename to text .imagette270381091758272561 27038110 imagette270381101758272561 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=27037771 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/27038100,27038101,27038102,27038103,27038104,27038105,27038106,27038107,27038108,27038109,27038110?tags=autre,carton,flou,pet_clair,pet_fonce,mal_croppe,papier,environnement,background,metal,pehd args[1385033802] : ((1385033802, -0.6697805393510666, 492688767), (1385033802, 0.23976434797771326, 2107752395), '0.049680090838945035') We are sending mail with results at report@fotonower.com args[1385033801] : ((1385033801, 0.9956318962418534, 492688767), (1385033801, 0.37402886223934323, 2107752395), '0.049680090838945035') We are sending mail with results at report@fotonower.com args[1385033800] : ((1385033800, -3.238784939014737, 492609224), (1385033800, 0.35934100018028675, 2107752395), '0.049680090838945035') We are sending mail with results at report@fotonower.com args[1385033798] : ((1385033798, -0.7230108759308328, 492688767), (1385033798, 1.0289830537636304, 2107752395), '0.049680090838945035') We are sending mail with results at report@fotonower.com args[1385033711] : ((1385033711, -0.14959912353230542, 492688767), (1385033711, 0.6044566865646379, 2107752395), '0.049680090838945035') We are sending mail with results at report@fotonower.com args[1385033706] : ((1385033706, 0.9414925624743676, 492688767), (1385033706, 0.867401074647363, 2107752395), '0.049680090838945035') We are sending mail with results at report@fotonower.com args[1385033682] : ((1385033682, 0.31513292775735097, 492688767), (1385033682, 0.6026317644748833, 2107752395), '0.049680090838945035') We are sending mail with results at report@fotonower.com args[1385033668] : ((1385033668, -0.05776326332725409, 492688767), (1385033668, 0.46606268395926126, 2107752395), '0.049680090838945035') We are sending mail with results at report@fotonower.com args[1385033667] : ((1385033667, -0.47328535034490543, 492688767), (1385033667, 0.5169047007446129, 2107752395), '0.049680090838945035') We are sending mail with results at report@fotonower.com args[1385033651] : ((1385033651, 0.05832973036957455, 492688767), (1385033651, 0.5854821582310896, 2107752395), '0.049680090838945035') We are sending mail with results at report@fotonower.com args[1385033484] : ((1385033484, 0.5582344637333662, 492688767), (1385033484, 0.6009328269049317, 2107752395), '0.049680090838945035') We are sending mail with results at report@fotonower.com args[1385033457] : ((1385033457, -0.48913323455865876, 492688767), (1385033457, 0.8080550823281824, 2107752395), '0.049680090838945035') We are sending mail with results at report@fotonower.com args[1385033431] : ((1385033431, 0.2872158509498353, 492688767), (1385033431, 0.9701462246023214, 2107752395), '0.049680090838945035') We are sending mail with results at report@fotonower.com args[1385033404] : ((1385033404, -0.6477487576927415, 492688767), (1385033404, 0.6558751602009475, 2107752395), '0.049680090838945035') We are sending mail with results at report@fotonower.com args[1385033377] : ((1385033377, 0.6275653022924151, 492688767), (1385033377, 0.7627060571689995, 2107752395), '0.049680090838945035') We are sending mail with results at report@fotonower.com args[1385033350] : ((1385033350, -0.14931577860054496, 492688767), (1385033350, 0.6784521342142662, 2107752395), '0.049680090838945035') We are sending mail with results at report@fotonower.com args[1385033219] : ((1385033219, -0.25001694108242534, 492688767), (1385033219, 0.4815732313514023, 2107752395), '0.049680090838945035') We are sending mail with results at report@fotonower.com args[1385033213] : ((1385033213, -0.15439418233635152, 492688767), (1385033213, 0.8146005526470658, 2107752395), '0.049680090838945035') We are sending mail with results at report@fotonower.com args[1385033212] : ((1385033212, -0.20788116086517164, 492688767), (1385033212, 0.747695215968023, 2107752395), '0.049680090838945035') We are sending mail with results at report@fotonower.com args[1385033210] : ((1385033210, 0.22874884854269384, 492688767), (1385033210, 0.6244020507164519, 2107752395), '0.049680090838945035') We are sending mail with results at report@fotonower.com args[1385033209] : ((1385033209, 0.8424801319873088, 492688767), (1385033209, 0.6210814041327805, 2107752395), '0.049680090838945035') We are sending mail with results at report@fotonower.com args[1385033207] : ((1385033207, -0.5811364850818128, 492688767), (1385033207, 0.5347770790099332, 2107752395), '0.049680090838945035') We are sending mail with results at report@fotonower.com refus_total : 0.049680090838945035 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=27037771 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27037771_19-09-2025_11_02_37.pdf results_Auto_P27037771_19-09-2025_11_02_37.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27037771_19-09-2025_11_02_37.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','27037771','results_Auto_P27037771_19-09-2025_11_02_37.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27037771_19-09-2025_11_02_37.pdf','pdf','','0.4','0.049680090838945035') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/27037771

https://www.fotonower.com/image?json=false&list_photos_id=1385033802
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385033801
La photo est trop floue, merci de reprendre une photo.(avec le score = 0.9956318962418534)
https://www.fotonower.com/image?json=false&list_photos_id=1385033800
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385033798
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385033711
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385033706
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385033682
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385033668
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385033667
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385033651
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385033484
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385033457
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385033431
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385033404
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385033377
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385033350
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385033219
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385033213
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385033212
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385033210
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385033209
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385033207
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 4.97%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/27038100?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/27038101?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/27038103?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/27038104?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/27038106?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/27038109?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27037771_19-09-2025_11_02_37.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/27038100,27038101,27038102,27038103,27038104,27038105,27038106,27038107,27038108,27038109,27038110?tags=autre,carton,flou,pet_clair,pet_fonce,mal_croppe,papier,environnement,background,metal,pehd.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 19 Sep 2025 09:02:43 GMT Content-Length: 0 Connection: close X-Message-Id: 30bBFebUQTSdTSsfEvlB5g Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1385033802, 1385033801, 1385033800, 1385033798, 1385033711, 1385033706, 1385033682, 1385033668, 1385033667, 1385033651, 1385033484, 1385033457, 1385033431, 1385033404, 1385033377, 1385033350, 1385033219, 1385033213, 1385033212, 1385033210, 1385033209, 1385033207] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033802', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033801', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033800', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033798', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033711', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033706', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033682', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033668', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033667', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033651', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033484', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033457', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033431', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033404', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033377', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033350', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033219', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033213', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033212', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033210', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033209', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033207', None, None, None, None, None, '3746750') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 22 time used for this insertion : 0.0162508487701416 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.482712507247925 time spend to save output : 0.016544580459594727 total time spend for step 9 : 6.4992570877075195 step10:split_time_score Fri Sep 19 11:02:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 22),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 19092025 27037771 Nombre de photos uploadées : 22 / 23040 (0%) 19092025 27037771 Nombre de photos taguées (types de déchets): 0 / 22 (0%) 19092025 27037771 Nombre de photos taguées (volume) : 0 / 22 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ?????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0010192394256591797 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.23277831077575684 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.0757153420781893 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27032986_19-09-2025_09_26_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27032986 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27032986 AND mptpi.`type`=3594 To do Qualite : 0.06073209728157643 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27033020_19-09-2025_09_31_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27033020 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27033020 AND mptpi.`type`=3594 To do Qualite : 0.10538957281144778 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27033023_19-09-2025_09_21_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27033023 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27033023 AND mptpi.`type`=3594 To do Qualite : 0.12652753665123456 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27033025_19-09-2025_09_11_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27033025 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27033025 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27035434 order by id desc limit 1 Qualite : 0.049680090838945035 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27037771_19-09-2025_11_02_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27037771 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27037771 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'19092025': {'nb_upload': 22, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1385033802, 1385033801, 1385033800, 1385033798, 1385033711, 1385033706, 1385033682, 1385033668, 1385033667, 1385033651, 1385033484, 1385033457, 1385033431, 1385033404, 1385033377, 1385033350, 1385033219, 1385033213, 1385033212, 1385033210, 1385033209, 1385033207] Looping around the photos to save general results len do output : 1 /27037771Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033802', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033801', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033800', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033798', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033711', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033706', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033682', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033668', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033667', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033651', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033484', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033457', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033431', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033404', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033377', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033350', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033219', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033213', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033212', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033210', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033209', None, None, None, None, None, '3746750') ('3318', None, None, None, None, None, None, None, '3746750') ('3318', '27037771', '1385033207', None, None, None, None, None, '3746750') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 23 time used for this insertion : 0.016280651092529297 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.632054090499878 time spend to save output : 0.01653289794921875 total time spend for step 10 : 1.6485869884490967 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 22 set_done_treatment 65.98user 32.12system 2:20.70elapsed 69%CPU (0avgtext+0avgdata 3166124maxresident)k 1000640inputs+30640outputs (6804major+2337297minor)pagefaults 0swaps