python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 44677 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3647026'] with mtr_portfolio_ids : ['26404030'] and first list_photo_ids : [] new path : /proc/44677/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 36 ; length of list_pids : 36 ; length of list_args : 36 time to download the photos : 4.642375946044922 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Sep 1 16:30:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10601 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-01 16:30:35.976229: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-01 16:30:36.004550: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-01 16:30:36.006480: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f39b0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-01 16:30:36.006541: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-01 16:30:36.010401: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-01 16:30:36.132471: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x24f6fd50 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-01 16:30:36.132523: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-01 16:30:36.133340: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-01 16:30:36.133648: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-01 16:30:36.135844: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-01 16:30:36.138103: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-01 16:30:36.138459: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-01 16:30:36.140775: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-01 16:30:36.141907: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-01 16:30:36.146590: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-01 16:30:36.148581: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-01 16:30:36.148689: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-01 16:30:36.149647: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-01 16:30:36.149668: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-01 16:30:36.149679: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-01 16:30:36.151442: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9676 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-01 16:30:36.469099: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-01 16:30:36.469262: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-01 16:30:36.469288: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-01 16:30:36.469311: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-01 16:30:36.469332: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-01 16:30:36.469353: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-01 16:30:36.469373: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-01 16:30:36.469395: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-01 16:30:36.471192: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-01 16:30:36.472975: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-01 16:30:36.473065: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-01 16:30:36.473086: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-01 16:30:36.473105: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-01 16:30:36.473128: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-01 16:30:36.473146: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-01 16:30:36.473164: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-01 16:30:36.473182: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-01 16:30:36.474458: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-01 16:30:36.474500: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-01 16:30:36.474509: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-01 16:30:36.474517: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-01 16:30:36.475862: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9676 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-01 16:30:45.798259: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-01 16:30:46.019585: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 36 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 Detection mask done ! Trying to reset tf kernel 45489 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 339 tf kernel not reseted sub process len(results) : 36 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 36 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5628 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00028896331787109375 nb_pixel_total : 5250 time to create 1 rle with old method : 0.008561849594116211 length of segment : 93 time for calcul the mask position with numpy : 0.0003287792205810547 nb_pixel_total : 4929 time to create 1 rle with old method : 0.011108160018920898 length of segment : 54 time for calcul the mask position with numpy : 0.03829145431518555 nb_pixel_total : 769864 time to create 1 rle with new method : 0.06309843063354492 length of segment : 984 time for calcul the mask position with numpy : 0.0020096302032470703 nb_pixel_total : 109085 time to create 1 rle with old method : 0.13225412368774414 length of segment : 531 time for calcul the mask position with numpy : 0.0003058910369873047 nb_pixel_total : 14257 time to create 1 rle with old method : 0.016292095184326172 length of segment : 138 time for calcul the mask position with numpy : 0.017073631286621094 nb_pixel_total : 1098540 time to create 1 rle with new method : 0.09893679618835449 length of segment : 1648 time for calcul the mask position with numpy : 0.0001971721649169922 nb_pixel_total : 9234 time to create 1 rle with old method : 0.011245012283325195 length of segment : 66 time for calcul the mask position with numpy : 0.0013928413391113281 nb_pixel_total : 101949 time to create 1 rle with old method : 0.11568808555603027 length of segment : 488 time for calcul the mask position with numpy : 0.0027923583984375 nb_pixel_total : 96707 time to create 1 rle with old method : 0.11133384704589844 length of segment : 548 time for calcul the mask position with numpy : 0.00037217140197753906 nb_pixel_total : 10938 time to create 1 rle with old method : 0.012906789779663086 length of segment : 158 time for calcul the mask position with numpy : 0.016575336456298828 nb_pixel_total : 752640 time to create 1 rle with new method : 0.03310656547546387 length of segment : 975 time for calcul the mask position with numpy : 0.00029850006103515625 nb_pixel_total : 9976 time to create 1 rle with old method : 0.011486053466796875 length of segment : 282 time for calcul the mask position with numpy : 0.00013780593872070312 nb_pixel_total : 7507 time to create 1 rle with old method : 0.008814573287963867 length of segment : 75 time for calcul the mask position with numpy : 0.0001437664031982422 nb_pixel_total : 5855 time to create 1 rle with old method : 0.006737232208251953 length of segment : 113 time for calcul the mask position with numpy : 0.00022459030151367188 nb_pixel_total : 12585 time to create 1 rle with old method : 0.014684438705444336 length of segment : 136 time for calcul the mask position with numpy : 0.00019288063049316406 nb_pixel_total : 7237 time to create 1 rle with old method : 0.008190155029296875 length of segment : 172 time for calcul the mask position with numpy : 0.001390218734741211 nb_pixel_total : 96207 time to create 1 rle with old method : 0.11025261878967285 length of segment : 480 time for calcul the mask position with numpy : 0.00036716461181640625 nb_pixel_total : 8288 time to create 1 rle with old method : 0.009493827819824219 length of segment : 112 time for calcul the mask position with numpy : 0.0002951622009277344 nb_pixel_total : 6441 time to create 1 rle with old method : 0.007968664169311523 length of segment : 77 time for calcul the mask position with numpy : 0.00033974647521972656 nb_pixel_total : 7986 time to create 1 rle with old method : 0.009545326232910156 length of segment : 78 time for calcul the mask position with numpy : 0.0002474784851074219 nb_pixel_total : 6349 time to create 1 rle with old method : 0.0075206756591796875 length of segment : 76 time for calcul the mask position with numpy : 0.0002052783966064453 nb_pixel_total : 6773 time to create 1 rle with old method : 0.007831096649169922 length of segment : 92 time for calcul the mask position with numpy : 0.00021839141845703125 nb_pixel_total : 10820 time to create 1 rle with old method : 0.012474298477172852 length of segment : 115 time for calcul the mask position with numpy : 0.0015819072723388672 nb_pixel_total : 94108 time to create 1 rle with old method : 0.10698580741882324 length of segment : 507 time for calcul the mask position with numpy : 0.00011038780212402344 nb_pixel_total : 2989 time to create 1 rle with old method : 0.0035729408264160156 length of segment : 64 time for calcul the mask position with numpy : 9.942054748535156e-05 nb_pixel_total : 3878 time to create 1 rle with old method : 0.0045740604400634766 length of segment : 66 time for calcul the mask position with numpy : 0.002087831497192383 nb_pixel_total : 95181 time to create 1 rle with old method : 0.1119542121887207 length of segment : 624 time for calcul the mask position with numpy : 0.00040459632873535156 nb_pixel_total : 8820 time to create 1 rle with old method : 0.015657424926757812 length of segment : 134 time for calcul the mask position with numpy : 0.0001964569091796875 nb_pixel_total : 11381 time to create 1 rle with old method : 0.01373744010925293 length of segment : 120 time for calcul the mask position with numpy : 0.0022382736206054688 nb_pixel_total : 96791 time to create 1 rle with old method : 0.11496448516845703 length of segment : 554 time for calcul the mask position with numpy : 0.011948347091674805 nb_pixel_total : 855178 time to create 1 rle with new method : 0.02185344696044922 length of segment : 1522 time for calcul the mask position with numpy : 0.0009903907775878906 nb_pixel_total : 27494 time to create 1 rle with old method : 0.03358912467956543 length of segment : 296 time for calcul the mask position with numpy : 0.0028276443481445312 nb_pixel_total : 107954 time to create 1 rle with old method : 0.12583017349243164 length of segment : 608 time for calcul the mask position with numpy : 0.0164031982421875 nb_pixel_total : 1144379 time to create 1 rle with new method : 0.21582841873168945 length of segment : 1503 time for calcul the mask position with numpy : 0.0027952194213867188 nb_pixel_total : 114166 time to create 1 rle with old method : 0.13320136070251465 length of segment : 548 time for calcul the mask position with numpy : 0.0005340576171875 nb_pixel_total : 11108 time to create 1 rle with old method : 0.014412879943847656 length of segment : 134 time for calcul the mask position with numpy : 0.003089427947998047 nb_pixel_total : 107179 time to create 1 rle with old method : 0.14263010025024414 length of segment : 517 time for calcul the mask position with numpy : 0.00018024444580078125 nb_pixel_total : 2689 time to create 1 rle with old method : 0.0034787654876708984 length of segment : 44 time for calcul the mask position with numpy : 0.0007619857788085938 nb_pixel_total : 20269 time to create 1 rle with old method : 0.023990869522094727 length of segment : 219 time for calcul the mask position with numpy : 0.00033664703369140625 nb_pixel_total : 5018 time to create 1 rle with old method : 0.006176948547363281 length of segment : 122 time for calcul the mask position with numpy : 0.002719402313232422 nb_pixel_total : 107166 time to create 1 rle with old method : 0.12349915504455566 length of segment : 532 time for calcul the mask position with numpy : 0.0005414485931396484 nb_pixel_total : 16259 time to create 1 rle with old method : 0.019550800323486328 length of segment : 150 time for calcul the mask position with numpy : 0.0390782356262207 nb_pixel_total : 1217793 time to create 1 rle with new method : 0.3124418258666992 length of segment : 1583 time for calcul the mask position with numpy : 0.00036454200744628906 nb_pixel_total : 9917 time to create 1 rle with old method : 0.011776924133300781 length of segment : 127 time for calcul the mask position with numpy : 0.0001933574676513672 nb_pixel_total : 3560 time to create 1 rle with old method : 0.005376577377319336 length of segment : 74 time for calcul the mask position with numpy : 0.012898921966552734 nb_pixel_total : 711605 time to create 1 rle with new method : 0.07680511474609375 length of segment : 876 time for calcul the mask position with numpy : 0.0128021240234375 nb_pixel_total : 760190 time to create 1 rle with new method : 0.1651747226715088 length of segment : 1019 time for calcul the mask position with numpy : 0.015287637710571289 nb_pixel_total : 1007975 time to create 1 rle with new method : 0.034964561462402344 length of segment : 1987 time for calcul the mask position with numpy : 0.0007610321044921875 nb_pixel_total : 20576 time to create 1 rle with old method : 0.025498628616333008 length of segment : 195 time for calcul the mask position with numpy : 0.0025904178619384766 nb_pixel_total : 94770 time to create 1 rle with old method : 0.10809183120727539 length of segment : 511 time for calcul the mask position with numpy : 0.00022792816162109375 nb_pixel_total : 3897 time to create 1 rle with old method : 0.004906654357910156 length of segment : 77 time for calcul the mask position with numpy : 0.0066335201263427734 nb_pixel_total : 309281 time to create 1 rle with new method : 0.01418924331665039 length of segment : 1455 time for calcul the mask position with numpy : 0.0012500286102294922 nb_pixel_total : 90678 time to create 1 rle with old method : 0.1066274642944336 length of segment : 454 time for calcul the mask position with numpy : 0.0005180835723876953 nb_pixel_total : 8240 time to create 1 rle with old method : 0.010480642318725586 length of segment : 105 time for calcul the mask position with numpy : 0.0004024505615234375 nb_pixel_total : 6772 time to create 1 rle with old method : 0.009752750396728516 length of segment : 127 time for calcul the mask position with numpy : 0.0005106925964355469 nb_pixel_total : 9735 time to create 1 rle with old method : 0.012629508972167969 length of segment : 137 time for calcul the mask position with numpy : 0.028343915939331055 nb_pixel_total : 1199871 time to create 1 rle with new method : 0.23885655403137207 length of segment : 1538 time for calcul the mask position with numpy : 0.0003426074981689453 nb_pixel_total : 8374 time to create 1 rle with old method : 0.010267972946166992 length of segment : 82 time for calcul the mask position with numpy : 0.0002598762512207031 nb_pixel_total : 3874 time to create 1 rle with old method : 0.004758119583129883 length of segment : 117 time for calcul the mask position with numpy : 0.0002741813659667969 nb_pixel_total : 5893 time to create 1 rle with old method : 0.007195472717285156 length of segment : 101 time for calcul the mask position with numpy : 0.002754688262939453 nb_pixel_total : 106211 time to create 1 rle with old method : 0.12564826011657715 length of segment : 535 time for calcul the mask position with numpy : 0.0005624294281005859 nb_pixel_total : 17667 time to create 1 rle with old method : 0.02147507667541504 length of segment : 148 time for calcul the mask position with numpy : 0.0007081031799316406 nb_pixel_total : 16275 time to create 1 rle with old method : 0.02042388916015625 length of segment : 140 time for calcul the mask position with numpy : 0.002234220504760742 nb_pixel_total : 77073 time to create 1 rle with old method : 0.0926506519317627 length of segment : 422 time for calcul the mask position with numpy : 0.002184152603149414 nb_pixel_total : 59225 time to create 1 rle with old method : 0.07305693626403809 length of segment : 398 time for calcul the mask position with numpy : 0.0006763935089111328 nb_pixel_total : 17187 time to create 1 rle with old method : 0.020695209503173828 length of segment : 163 time for calcul the mask position with numpy : 0.0003495216369628906 nb_pixel_total : 9177 time to create 1 rle with old method : 0.011191606521606445 length of segment : 110 time for calcul the mask position with numpy : 0.00014138221740722656 nb_pixel_total : 2849 time to create 1 rle with old method : 0.00435328483581543 length of segment : 46 time for calcul the mask position with numpy : 0.0029332637786865234 nb_pixel_total : 111381 time to create 1 rle with old method : 0.13730287551879883 length of segment : 726 time for calcul the mask position with numpy : 0.0027158260345458984 nb_pixel_total : 106063 time to create 1 rle with old method : 0.12193584442138672 length of segment : 506 time for calcul the mask position with numpy : 0.05223822593688965 nb_pixel_total : 1515781 time to create 1 rle with new method : 0.28255510330200195 length of segment : 1272 time for calcul the mask position with numpy : 0.00019502639770507812 nb_pixel_total : 5634 time to create 1 rle with old method : 0.006909608840942383 length of segment : 79 time spent for convertir_results : 9.492860317230225 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 72 chid ids of type : 3594 Number RLEs to save : 30865 save missing photos in datou_result : time spend for datou_step_exec : 46.11448788642883 time spend to save output : 1.895601749420166 total time spend for step 1 : 48.010089635849 step2:crop_condition Mon Sep 1 16:31:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 36 ! batch 1 Loaded 72 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 13 About to insert : list_path_to_insert length 13 new photo from crops ! About to upload 13 photos upload in portfolio : 3736932 init cache_photo without model_param we have 13 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756737084_44677 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 13 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.9529318809509277 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756737089_44677 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.9434704780578613 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756737092_44677 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6288125514984131 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 48 About to insert : list_path_to_insert length 48 new photo from crops ! About to upload 48 photos upload in portfolio : 3736932 init cache_photo without model_param we have 48 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756737145_44677 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 48 photos in the portfolio 3736932 time of upload the photos Elapsed time : 12.891939878463745 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756737159_44677 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2797431945800781 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1380639363, 1380639109, 1380639107, 1380639104, 1380639097, 1380639091, 1380639088, 1380639021, 1380639016, 1380639015, 1380639011, 1380639010, 1380639009, 1380638954, 1380638929, 1380638899, 1380638865, 1380638838, 1380638735, 1380638727, 1380638721, 1380638713, 1380638710, 1380638708, 1380638688, 1380638680, 1380638678, 1380638671, 1380638658, 1380638651, 1380638615, 1380638609, 1380638590, 1380638561, 1380638531, 1380638510] Looping around the photos to save general results len do output : 72 /1380657653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380657894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639363', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639109', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639107', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639104', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639097', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639091', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639088', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639021', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639016', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639015', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639011', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639010', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639009', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638954', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638929', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638899', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638865', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638838', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638735', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638727', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638721', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638713', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638710', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638708', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638688', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638680', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638678', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638671', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638658', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638651', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638615', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638609', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638590', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638561', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638531', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638510', None, None, None, None, None, '3647026') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 252 time used for this insertion : 0.03465151786804199 save_final save missing photos in datou_result : time spend for datou_step_exec : 79.44754219055176 time spend to save output : 0.03716158866882324 total time spend for step 2 : 79.48470377922058 step3:rle_unique_nms_with_priority Mon Sep 1 16:32:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 72 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.6342966556549072 time for calcul the mask position with numpy : 0.11203670501708984 nb_pixel_total : 1293557 time to create 1 rle with new method : 0.08465266227722168 time for calcul the mask position with numpy : 0.12477707862854004 nb_pixel_total : 769864 time to create 1 rle with new method : 0.10452079772949219 time for calcul the mask position with numpy : 0.010713815689086914 nb_pixel_total : 4929 time to create 1 rle with old method : 0.005842685699462891 time for calcul the mask position with numpy : 0.012685775756835938 nb_pixel_total : 5250 time to create 1 rle with old method : 0.0062503814697265625 create new chi : 0.47944045066833496 time to delete rle : 0.02252030372619629 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3342 TO DO : save crop sub photo not yet done ! save time : 0.23516440391540527 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.12354254722595215 time for calcul the mask position with numpy : 0.016026020050048828 nb_pixel_total : 865975 time to create 1 rle with new method : 0.13273334503173828 time for calcul the mask position with numpy : 0.03928017616271973 nb_pixel_total : 1084283 time to create 1 rle with new method : 0.20961284637451172 time for calcul the mask position with numpy : 0.00635218620300293 nb_pixel_total : 14257 time to create 1 rle with old method : 0.016761302947998047 time for calcul the mask position with numpy : 0.007317543029785156 nb_pixel_total : 109085 time to create 1 rle with old method : 0.12733983993530273 create new chi : 0.570997953414917 time to delete rle : 0.0008075237274169922 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 5714 TO DO : save crop sub photo not yet done ! save time : 0.393690824508667 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03849434852600098 time for calcul the mask position with numpy : 0.0913395881652832 nb_pixel_total : 2064366 time to create 1 rle with new method : 0.1640322208404541 time for calcul the mask position with numpy : 0.0066394805908203125 nb_pixel_total : 9234 time to create 1 rle with old method : 0.01085352897644043 create new chi : 0.276517391204834 time to delete rle : 0.0002841949462890625 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1212 TO DO : save crop sub photo not yet done ! save time : 0.11661481857299805 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.08333992958068848 time for calcul the mask position with numpy : 0.10991239547729492 nb_pixel_total : 1971651 time to create 1 rle with new method : 0.26906466484069824 time for calcul the mask position with numpy : 0.008293628692626953 nb_pixel_total : 101949 time to create 1 rle with old method : 0.11826300621032715 create new chi : 0.5193328857421875 time to delete rle : 0.000362396240234375 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 2056 TO DO : save crop sub photo not yet done ! save time : 0.17925596237182617 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.12377619743347168 time for calcul the mask position with numpy : 0.150299072265625 nb_pixel_total : 1965955 time to create 1 rle with new method : 0.12938308715820312 time for calcul the mask position with numpy : 0.0068798065185546875 nb_pixel_total : 10938 time to create 1 rle with old method : 0.012935400009155273 time for calcul the mask position with numpy : 0.010576486587524414 nb_pixel_total : 96707 time to create 1 rle with old method : 0.11377930641174316 create new chi : 0.43659114837646484 time to delete rle : 0.0005671977996826172 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2492 TO DO : save crop sub photo not yet done ! save time : 0.1938467025756836 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.05144834518432617 time for calcul the mask position with numpy : 0.017752647399902344 nb_pixel_total : 1320960 time to create 1 rle with new method : 0.16002178192138672 time for calcul the mask position with numpy : 0.012381315231323242 nb_pixel_total : 752640 time to create 1 rle with new method : 0.10887742042541504 create new chi : 0.3073880672454834 time to delete rle : 0.00033736228942871094 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 3030 TO DO : save crop sub photo not yet done ! save time : 0.22185325622558594 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.16687560081481934 time for calcul the mask position with numpy : 0.1217350959777832 nb_pixel_total : 2053843 time to create 1 rle with new method : 0.18227648735046387 time for calcul the mask position with numpy : 0.006575345993041992 nb_pixel_total : 3890 time to create 1 rle with old method : 0.0045740604400634766 time for calcul the mask position with numpy : 0.0065765380859375 nb_pixel_total : 5891 time to create 1 rle with old method : 0.006890296936035156 time for calcul the mask position with numpy : 0.006713390350341797 nb_pixel_total : 9976 time to create 1 rle with old method : 0.011909723281860352 create new chi : 0.3598494529724121 time to delete rle : 0.0004315376281738281 batch 1 Loaded 7 chid ids of type : 3594 ++++++Number RLEs to save : 1851 TO DO : save crop sub photo not yet done ! save time : 0.15219497680664062 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 0.8678452968597412 time for calcul the mask position with numpy : 0.1282052993774414 nb_pixel_total : 1921734 time to create 1 rle with new method : 0.07964181900024414 time for calcul the mask position with numpy : 0.009665966033935547 nb_pixel_total : 6773 time to create 1 rle with old method : 0.008106470108032227 time for calcul the mask position with numpy : 0.010811090469360352 nb_pixel_total : 6349 time to create 1 rle with old method : 0.007564067840576172 time for calcul the mask position with numpy : 0.010915756225585938 nb_pixel_total : 7986 time to create 1 rle with old method : 0.009221076965332031 time for calcul the mask position with numpy : 0.006624460220336914 nb_pixel_total : 6441 time to create 1 rle with old method : 0.007803440093994141 time for calcul the mask position with numpy : 0.006651639938354492 nb_pixel_total : 8288 time to create 1 rle with old method : 0.010351419448852539 time for calcul the mask position with numpy : 0.008033037185668945 nb_pixel_total : 96207 time to create 1 rle with old method : 0.11117291450500488 time for calcul the mask position with numpy : 0.007252931594848633 nb_pixel_total : 7237 time to create 1 rle with old method : 0.008483171463012695 time for calcul the mask position with numpy : 0.006688833236694336 nb_pixel_total : 12585 time to create 1 rle with old method : 0.014532327651977539 create new chi : 0.4636051654815674 time to delete rle : 0.0007140636444091797 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 3526 TO DO : save crop sub photo not yet done ! save time : 0.2761051654815674 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.10230088233947754 time for calcul the mask position with numpy : 0.03255796432495117 nb_pixel_total : 1965683 time to create 1 rle with new method : 0.210921049118042 time for calcul the mask position with numpy : 0.007375478744506836 nb_pixel_total : 2989 time to create 1 rle with old method : 0.003551483154296875 time for calcul the mask position with numpy : 0.007254123687744141 nb_pixel_total : 94108 time to create 1 rle with old method : 0.10906243324279785 time for calcul the mask position with numpy : 0.006638050079345703 nb_pixel_total : 10820 time to create 1 rle with old method : 0.012480497360229492 create new chi : 0.3983163833618164 time to delete rle : 0.0004978179931640625 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2452 TO DO : save crop sub photo not yet done ! save time : 0.1876997947692871 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.06615304946899414 time for calcul the mask position with numpy : 0.02257513999938965 nb_pixel_total : 1965721 time to create 1 rle with new method : 0.19005966186523438 time for calcul the mask position with numpy : 0.006310939788818359 nb_pixel_total : 8820 time to create 1 rle with old method : 0.010275602340698242 time for calcul the mask position with numpy : 0.006650686264038086 nb_pixel_total : 95181 time to create 1 rle with old method : 0.11088037490844727 time for calcul the mask position with numpy : 0.00590205192565918 nb_pixel_total : 3878 time to create 1 rle with old method : 0.004729747772216797 create new chi : 0.36525535583496094 time to delete rle : 0.00032782554626464844 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2728 TO DO : save crop sub photo not yet done ! save time : 0.21735334396362305 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.09893584251403809 time for calcul the mask position with numpy : 0.014500617980957031 nb_pixel_total : 1117221 time to create 1 rle with new method : 0.1276857852935791 time for calcul the mask position with numpy : 0.01825881004333496 nb_pixel_total : 848207 time to create 1 rle with new method : 0.07674741744995117 time for calcul the mask position with numpy : 0.007249355316162109 nb_pixel_total : 96791 time to create 1 rle with old method : 0.11176061630249023 time for calcul the mask position with numpy : 0.006434440612792969 nb_pixel_total : 11381 time to create 1 rle with old method : 0.012992620468139648 create new chi : 0.38545751571655273 time to delete rle : 0.000978708267211914 batch 1 Loaded 7 chid ids of type : 3594 +++++++Number RLEs to save : 5418 TO DO : save crop sub photo not yet done ! save time : 0.38542938232421875 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.05729937553405762 time for calcul the mask position with numpy : 0.06987762451171875 nb_pixel_total : 2046106 time to create 1 rle with new method : 0.133497953414917 time for calcul the mask position with numpy : 0.006553173065185547 nb_pixel_total : 27494 time to create 1 rle with old method : 0.03420686721801758 create new chi : 0.25812220573425293 time to delete rle : 0.00037670135498046875 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1672 TO DO : save crop sub photo not yet done ! save time : 0.14427495002746582 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.23927068710327148 time for calcul the mask position with numpy : 0.01591777801513672 nb_pixel_total : 821267 time to create 1 rle with new method : 0.09901094436645508 time for calcul the mask position with numpy : 0.09694647789001465 nb_pixel_total : 1144379 time to create 1 rle with new method : 0.07752370834350586 time for calcul the mask position with numpy : 0.007054805755615234 nb_pixel_total : 107954 time to create 1 rle with old method : 0.12537837028503418 create new chi : 0.43782544136047363 time to delete rle : 0.0008039474487304688 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 5302 TO DO : save crop sub photo not yet done ! save time : 0.36919522285461426 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.1069037914276123 time for calcul the mask position with numpy : 0.11113500595092773 nb_pixel_total : 1948326 time to create 1 rle with new method : 0.08217191696166992 time for calcul the mask position with numpy : 0.006407737731933594 nb_pixel_total : 11108 time to create 1 rle with old method : 0.012975215911865234 time for calcul the mask position with numpy : 0.007166862487792969 nb_pixel_total : 114166 time to create 1 rle with old method : 0.1335909366607666 create new chi : 0.36461520195007324 time to delete rle : 0.000659942626953125 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2444 TO DO : save crop sub photo not yet done ! save time : 0.18005728721618652 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.1385512351989746 time for calcul the mask position with numpy : 0.14111590385437012 nb_pixel_total : 1938445 time to create 1 rle with new method : 0.11336445808410645 time for calcul the mask position with numpy : 0.0065119266510009766 nb_pixel_total : 5018 time to create 1 rle with old method : 0.005925416946411133 time for calcul the mask position with numpy : 0.006871461868286133 nb_pixel_total : 20269 time to create 1 rle with old method : 0.023566246032714844 time for calcul the mask position with numpy : 0.006363391876220703 nb_pixel_total : 2689 time to create 1 rle with old method : 0.003182649612426758 time for calcul the mask position with numpy : 0.0068607330322265625 nb_pixel_total : 107179 time to create 1 rle with old method : 0.12793779373168945 create new chi : 0.4536097049713135 time to delete rle : 0.0005502700805664062 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 2884 TO DO : save crop sub photo not yet done ! save time : 0.22305893898010254 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.0780177116394043 time for calcul the mask position with numpy : 0.03436017036437988 nb_pixel_total : 1950175 time to create 1 rle with new method : 0.16849064826965332 time for calcul the mask position with numpy : 0.006812095642089844 nb_pixel_total : 16259 time to create 1 rle with old method : 0.01762247085571289 time for calcul the mask position with numpy : 0.00736689567565918 nb_pixel_total : 107166 time to create 1 rle with old method : 0.11601614952087402 create new chi : 0.3596024513244629 time to delete rle : 0.0006897449493408203 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2444 TO DO : save crop sub photo not yet done ! save time : 0.17526912689208984 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04067420959472656 time for calcul the mask position with numpy : 0.017787456512451172 nb_pixel_total : 855807 time to create 1 rle with new method : 0.037331581115722656 time for calcul the mask position with numpy : 0.018811464309692383 nb_pixel_total : 1217793 time to create 1 rle with new method : 0.030785799026489258 create new chi : 0.10533666610717773 time to delete rle : 0.0006000995635986328 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 4246 TO DO : save crop sub photo not yet done ! save time : 0.2960226535797119 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.044115304946899414 time for calcul the mask position with numpy : 0.09645676612854004 nb_pixel_total : 2063683 time to create 1 rle with new method : 0.1653740406036377 time for calcul the mask position with numpy : 0.006533145904541016 nb_pixel_total : 9917 time to create 1 rle with old method : 0.011601686477661133 create new chi : 0.2908310890197754 time to delete rle : 0.00041413307189941406 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1334 TO DO : save crop sub photo not yet done ! save time : 0.12784910202026367 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.11333870887756348 time for calcul the mask position with numpy : 0.6373739242553711 nb_pixel_total : 1358435 time to create 1 rle with new method : 0.09352278709411621 time for calcul the mask position with numpy : 0.019881486892700195 nb_pixel_total : 711605 time to create 1 rle with new method : 0.21968340873718262 time for calcul the mask position with numpy : 0.00622248649597168 nb_pixel_total : 3560 time to create 1 rle with old method : 0.004184246063232422 create new chi : 0.9923233985900879 time to delete rle : 0.0005257129669189453 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2980 TO DO : save crop sub photo not yet done ! save time : 0.22195911407470703 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.07291030883789062 time for calcul the mask position with numpy : 0.054070472717285156 nb_pixel_total : 1313410 time to create 1 rle with new method : 0.19756770133972168 time for calcul the mask position with numpy : 0.018734455108642578 nb_pixel_total : 760190 time to create 1 rle with new method : 0.0764000415802002 create new chi : 0.35515522956848145 time to delete rle : 0.0003859996795654297 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 3118 TO DO : save crop sub photo not yet done ! save time : 0.22433209419250488 No data in photo_id : 1380638721 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.07818269729614258 time for calcul the mask position with numpy : 0.09513640403747559 nb_pixel_total : 1065625 time to create 1 rle with new method : 0.08622336387634277 time for calcul the mask position with numpy : 0.014094352722167969 nb_pixel_total : 1007975 time to create 1 rle with new method : 0.18076062202453613 create new chi : 0.39389514923095703 time to delete rle : 0.0008666515350341797 batch 1 Loaded 3 chid ids of type : 3594 +++Number RLEs to save : 5054 TO DO : save crop sub photo not yet done ! save time : 0.3593258857727051 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.1825568675994873 time for calcul the mask position with numpy : 0.15325665473937988 nb_pixel_total : 1954357 time to create 1 rle with new method : 0.110504150390625 time for calcul the mask position with numpy : 0.010612964630126953 nb_pixel_total : 3897 time to create 1 rle with old method : 0.004327058792114258 time for calcul the mask position with numpy : 0.006779193878173828 nb_pixel_total : 94770 time to create 1 rle with old method : 0.10886096954345703 time for calcul the mask position with numpy : 0.006493091583251953 nb_pixel_total : 20576 time to create 1 rle with old method : 0.023388147354125977 create new chi : 0.43512964248657227 time to delete rle : 0.0006115436553955078 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2646 TO DO : save crop sub photo not yet done ! save time : 0.2073521614074707 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.08818602561950684 time for calcul the mask position with numpy : 0.058089256286621094 nb_pixel_total : 1665401 time to create 1 rle with new method : 0.3007471561431885 time for calcul the mask position with numpy : 0.0067501068115234375 nb_pixel_total : 8240 time to create 1 rle with old method : 0.009623289108276367 time for calcul the mask position with numpy : 0.01120305061340332 nb_pixel_total : 90678 time to create 1 rle with old method : 0.10532665252685547 time for calcul the mask position with numpy : 0.012696504592895508 nb_pixel_total : 309281 time to create 1 rle with new method : 0.08427309989929199 create new chi : 0.6018383502960205 time to delete rle : 0.0011241436004638672 batch 1 Loaded 7 chid ids of type : 3594 +++++++++Number RLEs to save : 5108 TO DO : save crop sub photo not yet done ! save time : 0.3478238582611084 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.08144760131835938 time for calcul the mask position with numpy : 0.014863967895507812 nb_pixel_total : 864661 time to create 1 rle with new method : 0.09120774269104004 time for calcul the mask position with numpy : 0.05931425094604492 nb_pixel_total : 1192432 time to create 1 rle with new method : 0.0762486457824707 time for calcul the mask position with numpy : 0.00655364990234375 nb_pixel_total : 9735 time to create 1 rle with old method : 0.011368989944458008 time for calcul the mask position with numpy : 0.006520509719848633 nb_pixel_total : 6772 time to create 1 rle with old method : 0.007898092269897461 create new chi : 0.2903096675872803 time to delete rle : 0.0008966922760009766 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 4607 TO DO : save crop sub photo not yet done ! save time : 0.3103673458099365 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.036647796630859375 time for calcul the mask position with numpy : 0.024543046951293945 nb_pixel_total : 2065226 time to create 1 rle with new method : 0.08247137069702148 time for calcul the mask position with numpy : 0.006258249282836914 nb_pixel_total : 8374 time to create 1 rle with old method : 0.009729385375976562 create new chi : 0.13211464881896973 time to delete rle : 0.00023031234741210938 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1244 TO DO : save crop sub photo not yet done ! save time : 0.10995149612426758 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03970479965209961 time for calcul the mask position with numpy : 0.17052459716796875 nb_pixel_total : 2069726 time to create 1 rle with new method : 0.17573952674865723 time for calcul the mask position with numpy : 0.007586479187011719 nb_pixel_total : 3874 time to create 1 rle with old method : 0.0070247650146484375 create new chi : 0.3757474422454834 time to delete rle : 0.00024175643920898438 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1314 TO DO : save crop sub photo not yet done ! save time : 0.1192781925201416 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.10626435279846191 time for calcul the mask position with numpy : 0.2328944206237793 nb_pixel_total : 1961496 time to create 1 rle with new method : 0.0875399112701416 time for calcul the mask position with numpy : 0.012234687805175781 nb_pixel_total : 106211 time to create 1 rle with old method : 0.12498021125793457 time for calcul the mask position with numpy : 0.006498575210571289 nb_pixel_total : 5893 time to create 1 rle with old method : 0.007019758224487305 create new chi : 0.48337721824645996 time to delete rle : 0.0004942417144775391 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 2352 TO DO : save crop sub photo not yet done ! save time : 0.18303847312927246 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.07529044151306152 time for calcul the mask position with numpy : 0.07752370834350586 nb_pixel_total : 2055933 time to create 1 rle with new method : 0.12516522407531738 time for calcul the mask position with numpy : 0.0063207149505615234 nb_pixel_total : 17667 time to create 1 rle with old method : 0.020755529403686523 create new chi : 0.23885846138000488 time to delete rle : 0.0002663135528564453 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 1376 TO DO : save crop sub photo not yet done ! save time : 0.1267857551574707 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.05062580108642578 time for calcul the mask position with numpy : 0.05131840705871582 nb_pixel_total : 2057325 time to create 1 rle with new method : 0.19585418701171875 time for calcul the mask position with numpy : 0.006605625152587891 nb_pixel_total : 16275 time to create 1 rle with old method : 0.019585371017456055 create new chi : 0.28404855728149414 time to delete rle : 0.00046896934509277344 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1360 TO DO : save crop sub photo not yet done ! save time : 0.13167858123779297 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.08611750602722168 time for calcul the mask position with numpy : 0.05924582481384277 nb_pixel_total : 1937302 time to create 1 rle with new method : 0.20642304420471191 time for calcul the mask position with numpy : 0.0068590641021728516 nb_pixel_total : 59225 time to create 1 rle with old method : 0.06998205184936523 time for calcul the mask position with numpy : 0.006601810455322266 nb_pixel_total : 77073 time to create 1 rle with old method : 0.08890986442565918 create new chi : 0.44932055473327637 time to delete rle : 0.0002956390380859375 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2720 TO DO : save crop sub photo not yet done ! save time : 0.21437525749206543 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.034682512283325195 time for calcul the mask position with numpy : 0.15826869010925293 nb_pixel_total : 2056413 time to create 1 rle with new method : 0.14502310752868652 time for calcul the mask position with numpy : 0.006382465362548828 nb_pixel_total : 17187 time to create 1 rle with old method : 0.02029705047607422 create new chi : 0.3397190570831299 time to delete rle : 0.0003116130828857422 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 1406 TO DO : save crop sub photo not yet done ! save time : 0.12862682342529297 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03820204734802246 time for calcul the mask position with numpy : 0.05011916160583496 nb_pixel_total : 2064423 time to create 1 rle with new method : 0.20248103141784668 time for calcul the mask position with numpy : 0.0065152645111083984 nb_pixel_total : 9177 time to create 1 rle with old method : 0.011870861053466797 create new chi : 0.2821509838104248 time to delete rle : 0.00025773048400878906 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1300 TO DO : save crop sub photo not yet done ! save time : 0.12682652473449707 No data in photo_id : 1380638561 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.1810288429260254 time for calcul the mask position with numpy : 0.0669867992401123 nb_pixel_total : 1959370 time to create 1 rle with new method : 0.2034759521484375 time for calcul the mask position with numpy : 0.011628150939941406 nb_pixel_total : 111381 time to create 1 rle with old method : 0.12948107719421387 time for calcul the mask position with numpy : 0.007635831832885742 nb_pixel_total : 2849 time to create 1 rle with old method : 0.0033767223358154297 create new chi : 0.43428659439086914 time to delete rle : 0.0004620552062988281 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2624 TO DO : save crop sub photo not yet done ! save time : 0.21065235137939453 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.09982943534851074 time for calcul the mask position with numpy : 0.011947154998779297 nb_pixel_total : 451756 time to create 1 rle with new method : 0.2263631820678711 time for calcul the mask position with numpy : 0.03145027160644531 nb_pixel_total : 1515781 time to create 1 rle with new method : 0.10590076446533203 time for calcul the mask position with numpy : 0.0069942474365234375 nb_pixel_total : 106063 time to create 1 rle with old method : 0.12275195121765137 create new chi : 0.5337703227996826 time to delete rle : 0.0013034343719482422 batch 1 Loaded 6 chid ids of type : 3594 ++++++Number RLEs to save : 4636 TO DO : save crop sub photo not yet done ! save time : 0.32035017013549805 map_output_result : {1380639363: (0.0, 'Should be the crop_list due to order', 0), 1380639109: (0.0, 'Should be the crop_list due to order', 0), 1380639107: (0.0, 'Should be the crop_list due to order', 0), 1380639104: (0.0, 'Should be the crop_list due to order', 0), 1380639097: (0.0, 'Should be the crop_list due to order', 0), 1380639091: (0.0, 'Should be the crop_list due to order', 0), 1380639088: (0.0, 'Should be the crop_list due to order', 0), 1380639021: (0.0, 'Should be the crop_list due to order', 0), 1380639016: (0.0, 'Should be the crop_list due to order', 0), 1380639015: (0.0, 'Should be the crop_list due to order', 0), 1380639011: (0.0, 'Should be the crop_list due to order', 0), 1380639010: (0.0, 'Should be the crop_list due to order', 0), 1380639009: (0.0, 'Should be the crop_list due to order', 0), 1380638954: (0.0, 'Should be the crop_list due to order', 0), 1380638929: (0.0, 'Should be the crop_list due to order', 0), 1380638899: (0.0, 'Should be the crop_list due to order', 0), 1380638865: (0.0, 'Should be the crop_list due to order', 0), 1380638838: (0.0, 'Should be the crop_list due to order', 0), 1380638735: (0.0, 'Should be the crop_list due to order', 0), 1380638727: (0.0, 'Should be the crop_list due to order', 0), 1380638721: (0.0, 'Should be the crop_list due to order', 0.0), 1380638713: (0.0, 'Should be the crop_list due to order', 0), 1380638710: (0.0, 'Should be the crop_list due to order', 0), 1380638708: (0.0, 'Should be the crop_list due to order', 0), 1380638688: (0.0, 'Should be the crop_list due to order', 0), 1380638680: (0.0, 'Should be the crop_list due to order', 0), 1380638678: (0.0, 'Should be the crop_list due to order', 0), 1380638671: (0.0, 'Should be the crop_list due to order', 0), 1380638658: (0.0, 'Should be the crop_list due to order', 0), 1380638651: (0.0, 'Should be the crop_list due to order', 0), 1380638615: (0.0, 'Should be the crop_list due to order', 0), 1380638609: (0.0, 'Should be the crop_list due to order', 0), 1380638590: (0.0, 'Should be the crop_list due to order', 0), 1380638561: (0.0, 'Should be the crop_list due to order', 0.0), 1380638531: (0.0, 'Should be the crop_list due to order', 0), 1380638510: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1380639363, 1380639109, 1380639107, 1380639104, 1380639097, 1380639091, 1380639088, 1380639021, 1380639016, 1380639015, 1380639011, 1380639010, 1380639009, 1380638954, 1380638929, 1380638899, 1380638865, 1380638838, 1380638735, 1380638727, 1380638721, 1380638713, 1380638710, 1380638708, 1380638688, 1380638680, 1380638678, 1380638671, 1380638658, 1380638651, 1380638615, 1380638609, 1380638590, 1380638561, 1380638531, 1380638510] Looping around the photos to save general results len do output : 36 /1380639363.Didn't retrieve data . /1380639109.Didn't retrieve data . /1380639107.Didn't retrieve data . /1380639104.Didn't retrieve data . /1380639097.Didn't retrieve data . /1380639091.Didn't retrieve data . /1380639088.Didn't retrieve data . /1380639021.Didn't retrieve data . /1380639016.Didn't retrieve data . /1380639015.Didn't retrieve data . /1380639011.Didn't retrieve data . /1380639010.Didn't retrieve data . /1380639009.Didn't retrieve data . /1380638954.Didn't retrieve data . /1380638929.Didn't retrieve data . /1380638899.Didn't retrieve data . /1380638865.Didn't retrieve data . /1380638838.Didn't retrieve data . /1380638735.Didn't retrieve data . /1380638727.Didn't retrieve data . /1380638721.Didn't retrieve data . /1380638713.Didn't retrieve data . /1380638710.Didn't retrieve data . /1380638708.Didn't retrieve data . /1380638688.Didn't retrieve data . /1380638680.Didn't retrieve data . /1380638678.Didn't retrieve data . /1380638671.Didn't retrieve data . /1380638658.Didn't retrieve data . /1380638651.Didn't retrieve data . /1380638615.Didn't retrieve data . /1380638609.Didn't retrieve data . /1380638590.Didn't retrieve data . /1380638561.Didn't retrieve data . /1380638531.Didn't retrieve data . /1380638510.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639363', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639109', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639107', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639104', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639097', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639091', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639088', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639021', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639016', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639015', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639011', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639010', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639009', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638954', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638929', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638899', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638865', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638838', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638735', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638727', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638721', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638713', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638710', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638708', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638688', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638680', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638678', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638671', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638658', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638651', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638615', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638609', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638590', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638561', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638531', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638510', None, None, None, None, None, '3647026') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 108 time used for this insertion : 0.021023988723754883 save_final save missing photos in datou_result : time spend for datou_step_exec : 26.48054003715515 time spend to save output : 0.0221254825592041 total time spend for step 3 : 26.502665519714355 step4:ventilate_hashtags_in_portfolio Mon Sep 1 16:33:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26404030 get user id for portfolio 26404030 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26404030 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','carton','flou','mal_croppe','papier','metal','autre','pehd','environnement','pet_clair','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26404030 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','carton','flou','mal_croppe','papier','metal','autre','pehd','environnement','pet_clair','pet_fonce')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26404030 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','carton','flou','mal_croppe','papier','metal','autre','pehd','environnement','pet_clair','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26404165,26404166,26404167,26404168,26404169,26404170,26404171,26404172,26404173,26404174,26404175?tags=background,carton,flou,mal_croppe,papier,metal,autre,pehd,environnement,pet_clair,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1380639363, 1380639109, 1380639107, 1380639104, 1380639097, 1380639091, 1380639088, 1380639021, 1380639016, 1380639015, 1380639011, 1380639010, 1380639009, 1380638954, 1380638929, 1380638899, 1380638865, 1380638838, 1380638735, 1380638727, 1380638721, 1380638713, 1380638710, 1380638708, 1380638688, 1380638680, 1380638678, 1380638671, 1380638658, 1380638651, 1380638615, 1380638609, 1380638590, 1380638561, 1380638531, 1380638510] Looping around the photos to save general results len do output : 1 /26404030. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639363', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639109', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639107', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639104', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639097', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639091', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639088', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639021', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639016', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639015', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639011', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639010', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639009', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638954', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638929', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638899', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638865', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638838', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638735', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638727', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638721', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638713', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638710', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638708', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638688', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638680', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638678', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638671', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638658', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638651', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638615', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638609', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638590', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638561', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638531', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638510', None, None, None, None, None, '3647026') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 37 time used for this insertion : 0.022010326385498047 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7180545330047607 time spend to save output : 0.022443771362304688 total time spend for step 4 : 1.7404983043670654 step5:final Mon Sep 1 16:33:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1380639363: ('0.1804573098851166',), 1380639109: ('0.1804573098851166',), 1380639107: ('0.1804573098851166',), 1380639104: ('0.1804573098851166',), 1380639097: ('0.1804573098851166',), 1380639091: ('0.1804573098851166',), 1380639088: ('0.1804573098851166',), 1380639021: ('0.1804573098851166',), 1380639016: ('0.1804573098851166',), 1380639015: ('0.1804573098851166',), 1380639011: ('0.1804573098851166',), 1380639010: ('0.1804573098851166',), 1380639009: ('0.1804573098851166',), 1380638954: ('0.1804573098851166',), 1380638929: ('0.1804573098851166',), 1380638899: ('0.1804573098851166',), 1380638865: ('0.1804573098851166',), 1380638838: ('0.1804573098851166',), 1380638735: ('0.1804573098851166',), 1380638727: ('0.1804573098851166',), 1380638721: ('0.1804573098851166',), 1380638713: ('0.1804573098851166',), 1380638710: ('0.1804573098851166',), 1380638708: ('0.1804573098851166',), 1380638688: ('0.1804573098851166',), 1380638680: ('0.1804573098851166',), 1380638678: ('0.1804573098851166',), 1380638671: ('0.1804573098851166',), 1380638658: ('0.1804573098851166',), 1380638651: ('0.1804573098851166',), 1380638615: ('0.1804573098851166',), 1380638609: ('0.1804573098851166',), 1380638590: ('0.1804573098851166',), 1380638561: ('0.1804573098851166',), 1380638531: ('0.1804573098851166',), 1380638510: ('0.1804573098851166',)} new output for save of step final : {1380639363: ('0.1804573098851166',), 1380639109: ('0.1804573098851166',), 1380639107: ('0.1804573098851166',), 1380639104: ('0.1804573098851166',), 1380639097: ('0.1804573098851166',), 1380639091: ('0.1804573098851166',), 1380639088: ('0.1804573098851166',), 1380639021: ('0.1804573098851166',), 1380639016: ('0.1804573098851166',), 1380639015: ('0.1804573098851166',), 1380639011: ('0.1804573098851166',), 1380639010: ('0.1804573098851166',), 1380639009: ('0.1804573098851166',), 1380638954: ('0.1804573098851166',), 1380638929: ('0.1804573098851166',), 1380638899: ('0.1804573098851166',), 1380638865: ('0.1804573098851166',), 1380638838: ('0.1804573098851166',), 1380638735: ('0.1804573098851166',), 1380638727: ('0.1804573098851166',), 1380638721: ('0.1804573098851166',), 1380638713: ('0.1804573098851166',), 1380638710: ('0.1804573098851166',), 1380638708: ('0.1804573098851166',), 1380638688: ('0.1804573098851166',), 1380638680: ('0.1804573098851166',), 1380638678: ('0.1804573098851166',), 1380638671: ('0.1804573098851166',), 1380638658: ('0.1804573098851166',), 1380638651: ('0.1804573098851166',), 1380638615: ('0.1804573098851166',), 1380638609: ('0.1804573098851166',), 1380638590: ('0.1804573098851166',), 1380638561: ('0.1804573098851166',), 1380638531: ('0.1804573098851166',), 1380638510: ('0.1804573098851166',)} [1380639363, 1380639109, 1380639107, 1380639104, 1380639097, 1380639091, 1380639088, 1380639021, 1380639016, 1380639015, 1380639011, 1380639010, 1380639009, 1380638954, 1380638929, 1380638899, 1380638865, 1380638838, 1380638735, 1380638727, 1380638721, 1380638713, 1380638710, 1380638708, 1380638688, 1380638680, 1380638678, 1380638671, 1380638658, 1380638651, 1380638615, 1380638609, 1380638590, 1380638561, 1380638531, 1380638510] Looping around the photos to save general results len do output : 36 /1380639363.Didn't retrieve data . /1380639109.Didn't retrieve data . /1380639107.Didn't retrieve data . /1380639104.Didn't retrieve data . /1380639097.Didn't retrieve data . /1380639091.Didn't retrieve data . /1380639088.Didn't retrieve data . /1380639021.Didn't retrieve data . /1380639016.Didn't retrieve data . /1380639015.Didn't retrieve data . /1380639011.Didn't retrieve data . /1380639010.Didn't retrieve data . /1380639009.Didn't retrieve data . /1380638954.Didn't retrieve data . /1380638929.Didn't retrieve data . /1380638899.Didn't retrieve data . /1380638865.Didn't retrieve data . /1380638838.Didn't retrieve data . /1380638735.Didn't retrieve data . /1380638727.Didn't retrieve data . /1380638721.Didn't retrieve data . /1380638713.Didn't retrieve data . /1380638710.Didn't retrieve data . /1380638708.Didn't retrieve data . /1380638688.Didn't retrieve data . /1380638680.Didn't retrieve data . /1380638678.Didn't retrieve data . /1380638671.Didn't retrieve data . /1380638658.Didn't retrieve data . /1380638651.Didn't retrieve data . /1380638615.Didn't retrieve data . /1380638609.Didn't retrieve data . /1380638590.Didn't retrieve data . /1380638561.Didn't retrieve data . /1380638531.Didn't retrieve data . /1380638510.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639363', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639109', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639107', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639104', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639097', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639091', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639088', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639021', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639016', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639015', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639011', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639010', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639009', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638954', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638929', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638899', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638865', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638838', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638735', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638727', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638721', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638713', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638710', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638708', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638688', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638680', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638678', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638671', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638658', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638651', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638615', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638609', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638590', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638561', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638531', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638510', None, None, None, None, None, '3647026') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 108 time used for this insertion : 0.022811174392700195 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12792062759399414 time spend to save output : 0.024407625198364258 total time spend for step 5 : 0.1523282527923584 step6:blur_detection Mon Sep 1 16:33:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1756737028_44677_1380639363_1c532b6a5bcab6961b270470fd28458f.jpg resize: (1080, 1920) 1380639363 -1.4419824729851443 treat image : temp/1756737028_44677_1380639109_0c5caf81381a62f8e25d577cab524a2d.jpg resize: (1080, 1920) 1380639109 -2.54144769697067 treat image : temp/1756737028_44677_1380639107_39e59e61546e1e276c5b694d10bdc596.jpg resize: (1080, 1920) 1380639107 -2.5411611917421397 treat image : temp/1756737028_44677_1380639104_7b091373b1a8a2904405a2adf4601a94.jpg resize: (1080, 1920) 1380639104 -1.4732576168257694 treat image : temp/1756737028_44677_1380639097_03d63c64fcaec3fc598d10af560446bf.jpg resize: (1080, 1920) 1380639097 -1.041848583669123 treat image : temp/1756737028_44677_1380639091_70d58caff393a055df746a964ae7e1f3.jpg resize: (1080, 1920) 1380639091 -2.3415224847616782 treat image : temp/1756737028_44677_1380639088_f19e6db0244c92521fad9c03b5a9c895.jpg resize: (1080, 1920) 1380639088 -0.8433697323901223 treat image : temp/1756737028_44677_1380639021_67e975a000f3a8ecde5f7dafe4e910a9.jpg resize: (1080, 1920) 1380639021 -1.3561644155084343 treat image : temp/1756737028_44677_1380639016_268868cad7f77831166f50f7df055cf4.jpg resize: (1080, 1920) 1380639016 -2.923575476137007 treat image : temp/1756737028_44677_1380639015_34a537ce0f6e982f7792f8bbd0c6633d.jpg resize: (1080, 1920) 1380639015 -2.0888861246958217 treat image : temp/1756737028_44677_1380639011_ecaebd7c33fb08e3fd88c1a0dc17d5b7.jpg resize: (1080, 1920) 1380639011 -1.5841548450336338 treat image : temp/1756737028_44677_1380639010_2c6df9096ae6f978705577fdebf97c03.jpg resize: (1080, 1920) 1380639010 -2.3143740820145755 treat image : temp/1756737028_44677_1380639009_2520a6204f0f562d4ed1d4ea08b59e17.jpg resize: (1080, 1920) 1380639009 -2.4148602489056605 treat image : temp/1756737028_44677_1380638954_8622a1deba0ac85a99d38e6d27b7cb3b.jpg resize: (1080, 1920) 1380638954 -2.0240830608841573 treat image : temp/1756737028_44677_1380638929_c0ec85723001e8dc4f3a0557d5cf5ef0.jpg resize: (1080, 1920) 1380638929 -1.9402202494305374 treat image : temp/1756737028_44677_1380638899_f298ed00ae9dccc8e2e7c326397b3844.jpg resize: (1080, 1920) 1380638899 -0.8919806495497586 treat image : temp/1756737028_44677_1380638865_60372e5eccf95cda483458fda715380a.jpg resize: (1080, 1920) 1380638865 0.3658925451082813 treat image : temp/1756737028_44677_1380638838_461dff72efe6d762a3c125ed176021e0.jpg resize: (1080, 1920) 1380638838 1.113309735715399 treat image : temp/1756737028_44677_1380638735_6bc835ace9b4ef564b139c770744df7b.jpg resize: (1080, 1920) 1380638735 -1.301076789245176 treat image : temp/1756737028_44677_1380638727_8bc434c727dbdcd77b657b41d2debab7.jpg resize: (1080, 1920) 1380638727 -2.710676666328251 treat image : temp/1756737028_44677_1380638721_5f572e9d0c5c8493436d1c6a62b1cf8b.jpg resize: (1080, 1920) 1380638721 -2.3687887802384218 treat image : temp/1756737028_44677_1380638713_b8bacdaad5cbf5355d62ca2053f74c12.jpg resize: (1080, 1920) 1380638713 -1.2714852109445112 treat image : temp/1756737028_44677_1380638710_ad64882c9e9f5991acde84d2a427739e.jpg resize: (1080, 1920) 1380638710 -2.1144973928885946 treat image : temp/1756737028_44677_1380638708_6c7939ae19626796ca2d8eb64c2cf4a0.jpg resize: (1080, 1920) 1380638708 -1.5389519150308306 treat image : temp/1756737028_44677_1380638688_8e2cc0b064df1bf724e52676fc51d4fd.jpg resize: (1080, 1920) 1380638688 -1.6177513975953615 treat image : temp/1756737028_44677_1380638680_4d5fdc3bbc0f0c6f0f20861f25d8e611.jpg resize: (1080, 1920) 1380638680 -2.43043016944296 treat image : temp/1756737028_44677_1380638678_0539a22c92b3b6fd1a54c43067e0b5a3.jpg resize: (1080, 1920) 1380638678 -1.4435183608888817 treat image : temp/1756737028_44677_1380638671_021c3a5ce00e4a8218024dec98b77fdd.jpg resize: (1080, 1920) 1380638671 -2.1297348120437993 treat image : temp/1756737028_44677_1380638658_4bca5376448f1ce788df3217116c2981.jpg resize: (1080, 1920) 1380638658 -2.2678140986702826 treat image : temp/1756737028_44677_1380638651_e44df9ddecc836f5d4267945e2a29548.jpg resize: (1080, 1920) 1380638651 -1.860495015796376 treat image : temp/1756737028_44677_1380638615_e04ac6bbac17c463d173ddea9f743e35.jpg resize: (1080, 1920) 1380638615 -2.244930762134439 treat image : temp/1756737028_44677_1380638609_c88e718bb07321d4775ee0b8b3864e46.jpg resize: (1080, 1920) 1380638609 -2.2906746375307585 treat image : temp/1756737028_44677_1380638590_bbc7e26dadeaa79a298951b0d2f0daad.jpg resize: (1080, 1920) 1380638590 -2.198129334302994 treat image : temp/1756737028_44677_1380638561_2c1459311adeb7508a42d85ed2ee191c.jpg resize: (1080, 1920) 1380638561 -0.8800001504099529 treat image : temp/1756737028_44677_1380638531_f8dbc3118f2027cc003deb4dd590c7bb.jpg resize: (1080, 1920) 1380638531 -2.3417292561290672 treat image : temp/1756737028_44677_1380638510_1d55283500efa28c18f56dc0b0c3d7aa.jpg resize: (1080, 1920) 1380638510 -2.6655639152143893 treat image : temp/1756737028_44677_1380639107_39e59e61546e1e276c5b694d10bdc596_rle_crop_3939183713_0.png resize: (65, 162) 1380657653 2.91755524272734 treat image : temp/1756737028_44677_1380639021_67e975a000f3a8ecde5f7dafe4e910a9_rle_crop_3939183722_0.png resize: (172, 59) 1380657654 -1.3868007456771274 treat image : temp/1756737028_44677_1380639021_67e975a000f3a8ecde5f7dafe4e910a9_rle_crop_3939183725_0.png resize: (77, 138) 1380657655 -3.9604831176561377 treat image : temp/1756737028_44677_1380639011_ecaebd7c33fb08e3fd88c1a0dc17d5b7_rle_crop_3939183735_0.png resize: (114, 127) 1380657656 0.02899669185058142 treat image : temp/1756737028_44677_1380638954_8622a1deba0ac85a99d38e6d27b7cb3b_rle_crop_3939183742_0.png resize: (119, 118) 1380657657 -0.5033660156438986 treat image : temp/1756737028_44677_1380638929_c0ec85723001e8dc4f3a0557d5cf5ef0_rle_crop_3939183744_0.png resize: (43, 81) 1380657658 4.873890655990902 treat image : temp/1756737028_44677_1380638710_ad64882c9e9f5991acde84d2a427739e_rle_crop_3939183757_0.png resize: (77, 79) 1380657659 -1.0908084443180912 treat image : temp/1756737028_44677_1380638708_6c7939ae19626796ca2d8eb64c2cf4a0_rle_crop_3939183758_0.png resize: (770, 898) 1380657660 -0.41570341144887973 treat image : temp/1756737028_44677_1380638688_8e2cc0b064df1bf724e52676fc51d4fd_rle_crop_3939183761_0.png resize: (127, 99) 1380657661 -1.9339494347237995 treat image : temp/1756737028_44677_1380638678_0539a22c92b3b6fd1a54c43067e0b5a3_rle_crop_3939183765_0.png resize: (117, 38) 1380657662 20.0 treat image : temp/1756737028_44677_1380638651_e44df9ddecc836f5d4267945e2a29548_rle_crop_3939183769_0.png resize: (139, 152) 1380657663 1.1571857507673933 treat image : temp/1756737028_44677_1380638531_f8dbc3118f2027cc003deb4dd590c7bb_rle_crop_3939183774_0.png resize: (46, 72) 1380657664 -2.421359812309589 treat image : temp/1756737028_44677_1380638510_1d55283500efa28c18f56dc0b0c3d7aa_rle_crop_3939183778_0.png resize: (79, 87) 1380657666 0.12432413609660037 treat image : temp/1756737028_44677_1380639021_67e975a000f3a8ecde5f7dafe4e910a9_rle_crop_3939183721_0.png resize: (127, 118) 1380657668 1.4926258717517342 treat image : temp/1756737028_44677_1380639016_268868cad7f77831166f50f7df055cf4_rle_crop_3939183729_0.png resize: (115, 117) 1380657669 0.11282637375102794 treat image : temp/1756737028_44677_1380638929_c0ec85723001e8dc4f3a0557d5cf5ef0_rle_crop_3939183745_0.png resize: (195, 166) 1380657670 -1.7220248043404465 treat image : temp/1756737028_44677_1380638929_c0ec85723001e8dc4f3a0557d5cf5ef0_rle_crop_3939183746_0.png resize: (122, 59) 1380657671 -1.0382921355163293 treat image : temp/1756737028_44677_1380638899_f298ed00ae9dccc8e2e7c326397b3844_rle_crop_3939183748_0.png resize: (136, 174) 1380657672 -1.0910944934488949 treat image : temp/1756737028_44677_1380638735_6bc835ace9b4ef564b139c770744df7b_rle_crop_3939183751_0.png resize: (73, 78) 1380657673 -1.6703583062314666 treat image : temp/1756737028_44677_1380638710_ad64882c9e9f5991acde84d2a427739e_rle_crop_3939183755_0.png resize: (187, 204) 1380657674 -1.762337089339499 treat image : temp/1756737028_44677_1380639015_34a537ce0f6e982f7792f8bbd0c6633d_rle_crop_3939183732_0.png resize: (66, 80) 1380657682 -2.047065258486761 treat image : temp/1756737028_44677_1380639363_1c532b6a5bcab6961b270470fd28458f_rle_crop_3939183707_0.png resize: (93, 75) 1380657811 -1.0260996087456817 treat image : temp/1756737028_44677_1380639363_1c532b6a5bcab6961b270470fd28458f_rle_crop_3939183708_0.png resize: (53, 110) 1380657813 -3.1082621199721583 treat image : temp/1756737028_44677_1380639363_1c532b6a5bcab6961b270470fd28458f_rle_crop_3939183709_0.png resize: (980, 1116) 1380657814 -0.15115183728005788 treat image : temp/1756737028_44677_1380639109_0c5caf81381a62f8e25d577cab524a2d_rle_crop_3939183710_0.png resize: (528, 361) 1380657816 -0.0839324907668814 treat image : temp/1756737028_44677_1380639109_0c5caf81381a62f8e25d577cab524a2d_rle_crop_3939183711_0.png resize: (138, 145) 1380657817 -2.0372014725414167 treat image : temp/1756737028_44677_1380639109_0c5caf81381a62f8e25d577cab524a2d_rle_crop_3939183712_0.png resize: (956, 1462) 1380657818 -1.0383612487406984 treat image : temp/1756737028_44677_1380639104_7b091373b1a8a2904405a2adf4601a94_rle_crop_3939183714_0.png resize: (469, 340) 1380657819 -0.6498153162845326 treat image : temp/1756737028_44677_1380639097_03d63c64fcaec3fc598d10af560446bf_rle_crop_3939183715_0.png resize: (533, 338) 1380657821 0.2943929594902645 treat image : temp/1756737028_44677_1380639097_03d63c64fcaec3fc598d10af560446bf_rle_crop_3939183716_0.png resize: (153, 93) 1380657822 -2.010467254044091 treat image : temp/1756737028_44677_1380639091_70d58caff393a055df746a964ae7e1f3_rle_crop_3939183717_0.png resize: (973, 1105) 1380657823 -0.05019342531507297 treat image : temp/1756737028_44677_1380639088_f19e6db0244c92521fad9c03b5a9c895_rle_crop_3939183718_0.png resize: (174, 177) 1380657825 -3.131009636995607 treat image : temp/1756737028_44677_1380639088_f19e6db0244c92521fad9c03b5a9c895_rle_crop_3939183719_0.png resize: (65, 157) 1380657826 -1.9655361733421413 treat image : temp/1756737028_44677_1380639088_f19e6db0244c92521fad9c03b5a9c895_rle_crop_3939183720_0.png resize: (113, 79) 1380657827 -1.331322337215618 treat image : temp/1756737028_44677_1380639021_67e975a000f3a8ecde5f7dafe4e910a9_rle_crop_3939183723_0.png resize: (478, 297) 1380657829 0.5758759735137512 treat image : temp/1756737028_44677_1380639021_67e975a000f3a8ecde5f7dafe4e910a9_rle_crop_3939183724_0.png resize: (112, 111) 1380657830 -2.172364040848671 treat image : temp/1756737028_44677_1380639021_67e975a000f3a8ecde5f7dafe4e910a9_rle_crop_3939183726_0.png resize: (77, 146) 1380657831 -2.4085418666480423 treat image : temp/1756737028_44677_1380639021_67e975a000f3a8ecde5f7dafe4e910a9_rle_crop_3939183727_0.png resize: (76, 123) 1380657834 -2.4263596916914847 treat image : temp/1756737028_44677_1380639021_67e975a000f3a8ecde5f7dafe4e910a9_rle_crop_3939183728_0.png resize: (87, 94) 1380657835 -1.7709417009624826 treat image : temp/1756737028_44677_1380639016_268868cad7f77831166f50f7df055cf4_rle_crop_3939183730_0.png resize: (502, 332) 1380657836 -0.45513150467939145 treat image : temp/1756737028_44677_1380639015_34a537ce0f6e982f7792f8bbd0c6633d_rle_crop_3939183733_0.png resize: (541, 334) 1380657838 -0.9069626554748562 treat image : temp/1756737028_44677_1380639015_34a537ce0f6e982f7792f8bbd0c6633d_rle_crop_3939183734_0.png resize: (134, 81) 1380657839 -2.1320092785420983 treat image : temp/1756737028_44677_1380639011_ecaebd7c33fb08e3fd88c1a0dc17d5b7_rle_crop_3939183736_0.png resize: (503, 350) 1380657840 -0.5118201945498961 treat image : temp/1756737028_44677_1380639011_ecaebd7c33fb08e3fd88c1a0dc17d5b7_rle_crop_3939183737_0.png resize: (984, 1194) 1380657842 -1.0053157949109235 treat image : temp/1756737028_44677_1380639010_2c6df9096ae6f978705577fdebf97c03_rle_crop_3939183738_0.png resize: (296, 216) 1380657843 -3.1881876335851085 treat image : temp/1756737028_44677_1380639009_2520a6204f0f562d4ed1d4ea08b59e17_rle_crop_3939183739_0.png resize: (557, 334) 1380657844 -0.41890287437650675 treat image : temp/1756737028_44677_1380639009_2520a6204f0f562d4ed1d4ea08b59e17_rle_crop_3939183740_0.png resize: (933, 1638) 1380657846 -0.8740745928483608 treat image : temp/1756737028_44677_1380638954_8622a1deba0ac85a99d38e6d27b7cb3b_rle_crop_3939183741_0.png resize: (540, 368) 1380657847 -0.10282767080601757 treat image : temp/1756737028_44677_1380638929_c0ec85723001e8dc4f3a0557d5cf5ef0_rle_crop_3939183743_0.png resize: (517, 345) 1380657848 -0.15675805156218514 treat image : temp/1756737028_44677_1380638899_f298ed00ae9dccc8e2e7c326397b3844_rle_crop_3939183747_0.png resize: (522, 344) 1380657850 -0.37480144798220283 treat image : temp/1756737028_44677_1380638865_60372e5eccf95cda483458fda715380a_rle_crop_3939183749_0.png resize: (962, 1698) 1380657851 -0.660848343761482 treat image : temp/1756737028_44677_1380638735_6bc835ace9b4ef564b139c770744df7b_rle_crop_3939183752_0.png resize: (875, 1014) 1380657852 0.09424580779311163 treat image : temp/1756737028_44677_1380638727_8bc434c727dbdcd77b657b41d2debab7_rle_crop_3939183753_0.png resize: (987, 1130) 1380657854 -0.5810978352422301 treat image : temp/1756737028_44677_1380638713_b8bacdaad5cbf5355d62ca2053f74c12_rle_crop_3939183754_0.png resize: (997, 1266) 1380657855 -1.8310568316904008 treat image : temp/1756737028_44677_1380638710_ad64882c9e9f5991acde84d2a427739e_rle_crop_3939183756_0.png resize: (501, 335) 1380657856 -0.512401957736212 treat image : temp/1756737028_44677_1380638708_6c7939ae19626796ca2d8eb64c2cf4a0_rle_crop_3939183759_0.png resize: (454, 310) 1380657858 0.4130086206356149 treat image : temp/1756737028_44677_1380638688_8e2cc0b064df1bf724e52676fc51d4fd_rle_crop_3939183762_0.png resize: (137, 118) 1380657859 -1.4649818473575968 treat image : temp/1756737028_44677_1380638688_8e2cc0b064df1bf724e52676fc51d4fd_rle_crop_3939183763_0.png resize: (946, 1659) 1380657860 -0.6123531174360604 treat image : temp/1756737028_44677_1380638680_4d5fdc3bbc0f0c6f0f20861f25d8e611_rle_crop_3939183764_0.png resize: (81, 150) 1380657862 -0.7062276565180537 treat image : temp/1756737028_44677_1380638671_021c3a5ce00e4a8218024dec98b77fdd_rle_crop_3939183766_0.png resize: (101, 76) 1380657863 -2.348641191595421 treat image : temp/1756737028_44677_1380638671_021c3a5ce00e4a8218024dec98b77fdd_rle_crop_3939183767_0.png resize: (511, 340) 1380657864 -0.5775891633107435 treat image : temp/1756737028_44677_1380638658_4bca5376448f1ce788df3217116c2981_rle_crop_3939183768_0.png resize: (138, 162) 1380657866 -0.23381057536738795 treat image : temp/1756737028_44677_1380638615_e04ac6bbac17c463d173ddea9f743e35_rle_crop_3939183770_0.png resize: (406, 302) 1380657867 -1.0630236891038018 treat image : temp/1756737028_44677_1380638615_e04ac6bbac17c463d173ddea9f743e35_rle_crop_3939183771_0.png resize: (398, 259) 1380657868 -1.4345454099040704 treat image : temp/1756737028_44677_1380638609_c88e718bb07321d4775ee0b8b3864e46_rle_crop_3939183772_0.png resize: (149, 180) 1380657870 -5.109655185695676 treat image : temp/1756737028_44677_1380638590_bbc7e26dadeaa79a298951b0d2f0daad_rle_crop_3939183773_0.png resize: (110, 110) 1380657871 -2.8956964276618478 treat image : temp/1756737028_44677_1380638531_f8dbc3118f2027cc003deb4dd590c7bb_rle_crop_3939183775_0.png resize: (591, 324) 1380657872 -0.7291479280028443 treat image : temp/1756737028_44677_1380638510_1d55283500efa28c18f56dc0b0c3d7aa_rle_crop_3939183776_0.png resize: (504, 375) 1380657874 -0.07289029508915769 treat image : temp/1756737028_44677_1380638510_1d55283500efa28c18f56dc0b0c3d7aa_rle_crop_3939183777_0.png resize: (975, 1763) 1380657875 -2.3724133740734588 treat image : temp/1756737028_44677_1380639016_268868cad7f77831166f50f7df055cf4_rle_crop_3939183731_0.png resize: (64, 58) 1380657891 -3.3102432153823464 treat image : temp/1756737028_44677_1380638838_461dff72efe6d762a3c125ed176021e0_rle_crop_3939183750_0.png resize: (127, 117) 1380657892 -2.2620833832236027 treat image : temp/1756737028_44677_1380638708_6c7939ae19626796ca2d8eb64c2cf4a0_rle_crop_3939183760_0.png resize: (105, 116) 1380657894 -1.370263850085612 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 108 time used for this insertion : 0.018512964248657227 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 108 time used for this insertion : 0.03120708465576172 save missing photos in datou_result : time spend for datou_step_exec : 34.758240938186646 time spend to save output : 0.05539536476135254 total time spend for step 6 : 34.813636302948 step7:brightness Mon Sep 1 16:33:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1756737028_44677_1380639363_1c532b6a5bcab6961b270470fd28458f.jpg treat image : temp/1756737028_44677_1380639109_0c5caf81381a62f8e25d577cab524a2d.jpg treat image : temp/1756737028_44677_1380639107_39e59e61546e1e276c5b694d10bdc596.jpg treat image : temp/1756737028_44677_1380639104_7b091373b1a8a2904405a2adf4601a94.jpg treat image : temp/1756737028_44677_1380639097_03d63c64fcaec3fc598d10af560446bf.jpg treat image : temp/1756737028_44677_1380639091_70d58caff393a055df746a964ae7e1f3.jpg treat image : temp/1756737028_44677_1380639088_f19e6db0244c92521fad9c03b5a9c895.jpg treat image : temp/1756737028_44677_1380639021_67e975a000f3a8ecde5f7dafe4e910a9.jpg treat image : temp/1756737028_44677_1380639016_268868cad7f77831166f50f7df055cf4.jpg treat image : temp/1756737028_44677_1380639015_34a537ce0f6e982f7792f8bbd0c6633d.jpg treat image : temp/1756737028_44677_1380639011_ecaebd7c33fb08e3fd88c1a0dc17d5b7.jpg treat image : temp/1756737028_44677_1380639010_2c6df9096ae6f978705577fdebf97c03.jpg treat image : temp/1756737028_44677_1380639009_2520a6204f0f562d4ed1d4ea08b59e17.jpg treat image : temp/1756737028_44677_1380638954_8622a1deba0ac85a99d38e6d27b7cb3b.jpg treat image : temp/1756737028_44677_1380638929_c0ec85723001e8dc4f3a0557d5cf5ef0.jpg treat image : temp/1756737028_44677_1380638899_f298ed00ae9dccc8e2e7c326397b3844.jpg treat image : temp/1756737028_44677_1380638865_60372e5eccf95cda483458fda715380a.jpg treat image : temp/1756737028_44677_1380638838_461dff72efe6d762a3c125ed176021e0.jpg treat image : temp/1756737028_44677_1380638735_6bc835ace9b4ef564b139c770744df7b.jpg treat image : temp/1756737028_44677_1380638727_8bc434c727dbdcd77b657b41d2debab7.jpg treat image : temp/1756737028_44677_1380638721_5f572e9d0c5c8493436d1c6a62b1cf8b.jpg treat image : temp/1756737028_44677_1380638713_b8bacdaad5cbf5355d62ca2053f74c12.jpg treat image : temp/1756737028_44677_1380638710_ad64882c9e9f5991acde84d2a427739e.jpg treat image : temp/1756737028_44677_1380638708_6c7939ae19626796ca2d8eb64c2cf4a0.jpg treat image : temp/1756737028_44677_1380638688_8e2cc0b064df1bf724e52676fc51d4fd.jpg treat image : temp/1756737028_44677_1380638680_4d5fdc3bbc0f0c6f0f20861f25d8e611.jpg treat image : temp/1756737028_44677_1380638678_0539a22c92b3b6fd1a54c43067e0b5a3.jpg treat image : temp/1756737028_44677_1380638671_021c3a5ce00e4a8218024dec98b77fdd.jpg treat image : temp/1756737028_44677_1380638658_4bca5376448f1ce788df3217116c2981.jpg treat image : temp/1756737028_44677_1380638651_e44df9ddecc836f5d4267945e2a29548.jpg treat image : temp/1756737028_44677_1380638615_e04ac6bbac17c463d173ddea9f743e35.jpg treat image : temp/1756737028_44677_1380638609_c88e718bb07321d4775ee0b8b3864e46.jpg treat image : temp/1756737028_44677_1380638590_bbc7e26dadeaa79a298951b0d2f0daad.jpg treat image : temp/1756737028_44677_1380638561_2c1459311adeb7508a42d85ed2ee191c.jpg treat image : temp/1756737028_44677_1380638531_f8dbc3118f2027cc003deb4dd590c7bb.jpg treat image : temp/1756737028_44677_1380638510_1d55283500efa28c18f56dc0b0c3d7aa.jpg treat image : temp/1756737028_44677_1380639107_39e59e61546e1e276c5b694d10bdc596_rle_crop_3939183713_0.png treat image : temp/1756737028_44677_1380639021_67e975a000f3a8ecde5f7dafe4e910a9_rle_crop_3939183722_0.png treat image : temp/1756737028_44677_1380639021_67e975a000f3a8ecde5f7dafe4e910a9_rle_crop_3939183725_0.png treat image : temp/1756737028_44677_1380639011_ecaebd7c33fb08e3fd88c1a0dc17d5b7_rle_crop_3939183735_0.png treat image : temp/1756737028_44677_1380638954_8622a1deba0ac85a99d38e6d27b7cb3b_rle_crop_3939183742_0.png treat image : temp/1756737028_44677_1380638929_c0ec85723001e8dc4f3a0557d5cf5ef0_rle_crop_3939183744_0.png treat image : temp/1756737028_44677_1380638710_ad64882c9e9f5991acde84d2a427739e_rle_crop_3939183757_0.png treat image : temp/1756737028_44677_1380638708_6c7939ae19626796ca2d8eb64c2cf4a0_rle_crop_3939183758_0.png treat image : temp/1756737028_44677_1380638688_8e2cc0b064df1bf724e52676fc51d4fd_rle_crop_3939183761_0.png treat image : temp/1756737028_44677_1380638678_0539a22c92b3b6fd1a54c43067e0b5a3_rle_crop_3939183765_0.png treat image : temp/1756737028_44677_1380638651_e44df9ddecc836f5d4267945e2a29548_rle_crop_3939183769_0.png treat image : temp/1756737028_44677_1380638531_f8dbc3118f2027cc003deb4dd590c7bb_rle_crop_3939183774_0.png treat image : temp/1756737028_44677_1380638510_1d55283500efa28c18f56dc0b0c3d7aa_rle_crop_3939183778_0.png treat image : temp/1756737028_44677_1380639021_67e975a000f3a8ecde5f7dafe4e910a9_rle_crop_3939183721_0.png treat image : temp/1756737028_44677_1380639016_268868cad7f77831166f50f7df055cf4_rle_crop_3939183729_0.png treat image : temp/1756737028_44677_1380638929_c0ec85723001e8dc4f3a0557d5cf5ef0_rle_crop_3939183745_0.png treat image : temp/1756737028_44677_1380638929_c0ec85723001e8dc4f3a0557d5cf5ef0_rle_crop_3939183746_0.png treat image : temp/1756737028_44677_1380638899_f298ed00ae9dccc8e2e7c326397b3844_rle_crop_3939183748_0.png treat image : temp/1756737028_44677_1380638735_6bc835ace9b4ef564b139c770744df7b_rle_crop_3939183751_0.png treat image : temp/1756737028_44677_1380638710_ad64882c9e9f5991acde84d2a427739e_rle_crop_3939183755_0.png treat image : temp/1756737028_44677_1380639015_34a537ce0f6e982f7792f8bbd0c6633d_rle_crop_3939183732_0.png treat image : temp/1756737028_44677_1380639363_1c532b6a5bcab6961b270470fd28458f_rle_crop_3939183707_0.png treat image : temp/1756737028_44677_1380639363_1c532b6a5bcab6961b270470fd28458f_rle_crop_3939183708_0.png treat image : temp/1756737028_44677_1380639363_1c532b6a5bcab6961b270470fd28458f_rle_crop_3939183709_0.png treat image : temp/1756737028_44677_1380639109_0c5caf81381a62f8e25d577cab524a2d_rle_crop_3939183710_0.png treat image : temp/1756737028_44677_1380639109_0c5caf81381a62f8e25d577cab524a2d_rle_crop_3939183711_0.png treat image : temp/1756737028_44677_1380639109_0c5caf81381a62f8e25d577cab524a2d_rle_crop_3939183712_0.png treat image : temp/1756737028_44677_1380639104_7b091373b1a8a2904405a2adf4601a94_rle_crop_3939183714_0.png treat image : temp/1756737028_44677_1380639097_03d63c64fcaec3fc598d10af560446bf_rle_crop_3939183715_0.png treat image : temp/1756737028_44677_1380639097_03d63c64fcaec3fc598d10af560446bf_rle_crop_3939183716_0.png treat image : temp/1756737028_44677_1380639091_70d58caff393a055df746a964ae7e1f3_rle_crop_3939183717_0.png treat image : temp/1756737028_44677_1380639088_f19e6db0244c92521fad9c03b5a9c895_rle_crop_3939183718_0.png treat image : temp/1756737028_44677_1380639088_f19e6db0244c92521fad9c03b5a9c895_rle_crop_3939183719_0.png treat image : temp/1756737028_44677_1380639088_f19e6db0244c92521fad9c03b5a9c895_rle_crop_3939183720_0.png treat image : temp/1756737028_44677_1380639021_67e975a000f3a8ecde5f7dafe4e910a9_rle_crop_3939183723_0.png treat image : temp/1756737028_44677_1380639021_67e975a000f3a8ecde5f7dafe4e910a9_rle_crop_3939183724_0.png treat image : temp/1756737028_44677_1380639021_67e975a000f3a8ecde5f7dafe4e910a9_rle_crop_3939183726_0.png treat image : temp/1756737028_44677_1380639021_67e975a000f3a8ecde5f7dafe4e910a9_rle_crop_3939183727_0.png treat image : temp/1756737028_44677_1380639021_67e975a000f3a8ecde5f7dafe4e910a9_rle_crop_3939183728_0.png treat image : temp/1756737028_44677_1380639016_268868cad7f77831166f50f7df055cf4_rle_crop_3939183730_0.png treat image : temp/1756737028_44677_1380639015_34a537ce0f6e982f7792f8bbd0c6633d_rle_crop_3939183733_0.png treat image : temp/1756737028_44677_1380639015_34a537ce0f6e982f7792f8bbd0c6633d_rle_crop_3939183734_0.png treat image : temp/1756737028_44677_1380639011_ecaebd7c33fb08e3fd88c1a0dc17d5b7_rle_crop_3939183736_0.png treat image : temp/1756737028_44677_1380639011_ecaebd7c33fb08e3fd88c1a0dc17d5b7_rle_crop_3939183737_0.png treat image : temp/1756737028_44677_1380639010_2c6df9096ae6f978705577fdebf97c03_rle_crop_3939183738_0.png treat image : temp/1756737028_44677_1380639009_2520a6204f0f562d4ed1d4ea08b59e17_rle_crop_3939183739_0.png treat image : temp/1756737028_44677_1380639009_2520a6204f0f562d4ed1d4ea08b59e17_rle_crop_3939183740_0.png treat image : temp/1756737028_44677_1380638954_8622a1deba0ac85a99d38e6d27b7cb3b_rle_crop_3939183741_0.png treat image : temp/1756737028_44677_1380638929_c0ec85723001e8dc4f3a0557d5cf5ef0_rle_crop_3939183743_0.png treat image : temp/1756737028_44677_1380638899_f298ed00ae9dccc8e2e7c326397b3844_rle_crop_3939183747_0.png treat image : temp/1756737028_44677_1380638865_60372e5eccf95cda483458fda715380a_rle_crop_3939183749_0.png treat image : temp/1756737028_44677_1380638735_6bc835ace9b4ef564b139c770744df7b_rle_crop_3939183752_0.png treat image : temp/1756737028_44677_1380638727_8bc434c727dbdcd77b657b41d2debab7_rle_crop_3939183753_0.png treat image : temp/1756737028_44677_1380638713_b8bacdaad5cbf5355d62ca2053f74c12_rle_crop_3939183754_0.png treat image : temp/1756737028_44677_1380638710_ad64882c9e9f5991acde84d2a427739e_rle_crop_3939183756_0.png treat image : temp/1756737028_44677_1380638708_6c7939ae19626796ca2d8eb64c2cf4a0_rle_crop_3939183759_0.png treat image : temp/1756737028_44677_1380638688_8e2cc0b064df1bf724e52676fc51d4fd_rle_crop_3939183762_0.png treat image : temp/1756737028_44677_1380638688_8e2cc0b064df1bf724e52676fc51d4fd_rle_crop_3939183763_0.png treat image : temp/1756737028_44677_1380638680_4d5fdc3bbc0f0c6f0f20861f25d8e611_rle_crop_3939183764_0.png treat image : temp/1756737028_44677_1380638671_021c3a5ce00e4a8218024dec98b77fdd_rle_crop_3939183766_0.png treat image : temp/1756737028_44677_1380638671_021c3a5ce00e4a8218024dec98b77fdd_rle_crop_3939183767_0.png treat image : temp/1756737028_44677_1380638658_4bca5376448f1ce788df3217116c2981_rle_crop_3939183768_0.png treat image : temp/1756737028_44677_1380638615_e04ac6bbac17c463d173ddea9f743e35_rle_crop_3939183770_0.png treat image : temp/1756737028_44677_1380638615_e04ac6bbac17c463d173ddea9f743e35_rle_crop_3939183771_0.png treat image : temp/1756737028_44677_1380638609_c88e718bb07321d4775ee0b8b3864e46_rle_crop_3939183772_0.png treat image : temp/1756737028_44677_1380638590_bbc7e26dadeaa79a298951b0d2f0daad_rle_crop_3939183773_0.png treat image : temp/1756737028_44677_1380638531_f8dbc3118f2027cc003deb4dd590c7bb_rle_crop_3939183775_0.png treat image : temp/1756737028_44677_1380638510_1d55283500efa28c18f56dc0b0c3d7aa_rle_crop_3939183776_0.png treat image : temp/1756737028_44677_1380638510_1d55283500efa28c18f56dc0b0c3d7aa_rle_crop_3939183777_0.png treat image : temp/1756737028_44677_1380639016_268868cad7f77831166f50f7df055cf4_rle_crop_3939183731_0.png treat image : temp/1756737028_44677_1380638838_461dff72efe6d762a3c125ed176021e0_rle_crop_3939183750_0.png treat image : temp/1756737028_44677_1380638708_6c7939ae19626796ca2d8eb64c2cf4a0_rle_crop_3939183760_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 108 time used for this insertion : 0.01741933822631836 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 108 time used for this insertion : 0.03401589393615723 save missing photos in datou_result : time spend for datou_step_exec : 10.08012080192566 time spend to save output : 0.05742001533508301 total time spend for step 7 : 10.137540817260742 step8:velours_tree Mon Sep 1 16:33:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.1893470287322998 time spend to save output : 5.626678466796875e-05 total time spend for step 8 : 0.18940329551696777 step9:send_mail_cod Mon Sep 1 16:33:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26404030_01-09-2025_16_33_54.pdf 26404165 imagette264041651756737234 26404166 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette264041661756737234 26404167 imagette264041671756737234 26404168 imagette264041681756737234 26404169 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette264041691756737234 26404170 change filename to text .imagette264041701756737235 26404171 change filename to text .change filename to text .change filename to text .imagette264041711756737235 26404172 imagette264041721756737235 26404174 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette264041741756737235 26404175 imagette264041751756737237 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26404030 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26404165,26404166,26404167,26404168,26404169,26404170,26404171,26404172,26404173,26404174,26404175?tags=background,carton,flou,mal_croppe,papier,metal,autre,pehd,environnement,pet_clair,pet_fonce args[1380639363] : ((1380639363, -1.4419824729851443, 492688767), (1380639363, 0.6391988916739617, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380639109] : ((1380639109, -2.54144769697067, 492609224), (1380639109, 0.5099790297737956, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380639107] : ((1380639107, -2.5411611917421397, 492609224), (1380639107, 0.576441605977182, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380639104] : ((1380639104, -1.4732576168257694, 492688767), (1380639104, 0.48750581828449696, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380639097] : ((1380639097, -1.041848583669123, 492688767), (1380639097, 0.6493931854119608, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380639091] : ((1380639091, -2.3415224847616782, 492609224), (1380639091, 0.7190636287938676, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380639088] : ((1380639088, -0.8433697323901223, 492688767), (1380639088, 0.46143481245409723, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380639021] : ((1380639021, -1.3561644155084343, 492688767), (1380639021, 0.7404689185301614, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380639016] : ((1380639016, -2.923575476137007, 492609224), (1380639016, 0.6617627612937971, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380639015] : ((1380639015, -2.0888861246958217, 492609224), (1380639015, 0.5848635059674736, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380639011] : ((1380639011, -1.5841548450336338, 492688767), (1380639011, 0.38368994751646784, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380639010] : ((1380639010, -2.3143740820145755, 492609224), (1380639010, 0.5350750167659665, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380639009] : ((1380639009, -2.4148602489056605, 492609224), (1380639009, 0.4709564019561362, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638954] : ((1380638954, -2.0240830608841573, 492609224), (1380638954, 0.3355486230371629, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638929] : ((1380638929, -1.9402202494305374, 492688767), (1380638929, 0.3307063361209992, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638899] : ((1380638899, -0.8919806495497586, 492688767), (1380638899, 0.48770516420057275, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638865] : ((1380638865, 0.3658925451082813, 492688767), (1380638865, 0.2581962277934937, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638838] : ((1380638838, 1.113309735715399, 492688767), (1380638838, 0.3133083719170264, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638735] : ((1380638735, -1.301076789245176, 492688767), (1380638735, 0.5168318265353874, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638727] : ((1380638727, -2.710676666328251, 492609224), (1380638727, 0.5056775834082036, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638721] : ((1380638721, -2.3687887802384218, 492609224), (1380638721, 0.577837676513895, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638713] : ((1380638713, -1.2714852109445112, 492688767), (1380638713, 0.5168980817926737, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638710] : ((1380638710, -2.1144973928885946, 492609224), (1380638710, 0.3176326197869686, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638708] : ((1380638708, -1.5389519150308306, 492688767), (1380638708, 0.35645234624341193, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638688] : ((1380638688, -1.6177513975953615, 492688767), (1380638688, 0.3997564667409382, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638680] : ((1380638680, -2.43043016944296, 492609224), (1380638680, 0.6325523695336039, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638678] : ((1380638678, -1.4435183608888817, 492688767), (1380638678, 0.5164962869065203, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638671] : ((1380638671, -2.1297348120437993, 492609224), (1380638671, 0.5791045492171594, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638658] : ((1380638658, -2.2678140986702826, 492609224), (1380638658, 0.5893077941243489, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638651] : ((1380638651, -1.860495015796376, 492688767), (1380638651, 0.5845796846433551, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638615] : ((1380638615, -2.244930762134439, 492609224), (1380638615, 0.590924536627325, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638609] : ((1380638609, -2.2906746375307585, 492609224), (1380638609, 0.5836785592270238, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638590] : ((1380638590, -2.198129334302994, 492609224), (1380638590, 0.6063614759891368, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638561] : ((1380638561, -0.8800001504099529, 492688767), (1380638561, 0.7037600793343414, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638531] : ((1380638531, -2.3417292561290672, 492609224), (1380638531, 0.3761646357023582, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com args[1380638510] : ((1380638510, -2.6655639152143893, 492609224), (1380638510, 0.38843765678464176, 2107752395), '0.1804573098851166') We are sending mail with results at report@fotonower.com refus_total : 0.1804573098851166 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26404030 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26404030_01-09-2025_16_33_54.pdf results_Auto_P26404030_01-09-2025_16_33_54.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26404030_01-09-2025_16_33_54.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26404030','results_Auto_P26404030_01-09-2025_16_33_54.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26404030_01-09-2025_16_33_54.pdf','pdf','','0.96','0.1804573098851166') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26404030

https://www.fotonower.com/image?json=false&list_photos_id=1380639363
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380639109
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380639107
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380639104
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380639097
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380639091
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380639088
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380639021
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380639016
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380639015
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380639011
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380639010
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380639009
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380638954
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380638929
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380638899
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380638865
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380638838
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.113309735715399)
https://www.fotonower.com/image?json=false&list_photos_id=1380638735
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380638727
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380638721
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380638713
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380638710
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380638708
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380638688
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380638680
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380638678
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380638671
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380638658
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380638651
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380638615
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380638609
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380638590
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380638561
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380638531
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380638510
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 18.05%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/26404166?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26404169?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/26404170?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/26404171?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26404174?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26404030_01-09-2025_16_33_54.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26404165,26404166,26404167,26404168,26404169,26404170,26404171,26404172,26404173,26404174,26404175?tags=background,carton,flou,mal_croppe,papier,metal,autre,pehd,environnement,pet_clair,pet_fonce.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 01 Sep 2025 14:34:00 GMT Content-Length: 0 Connection: close X-Message-Id: CyNoA8VxTCWBpM31x0cuXw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1380639363, 1380639109, 1380639107, 1380639104, 1380639097, 1380639091, 1380639088, 1380639021, 1380639016, 1380639015, 1380639011, 1380639010, 1380639009, 1380638954, 1380638929, 1380638899, 1380638865, 1380638838, 1380638735, 1380638727, 1380638721, 1380638713, 1380638710, 1380638708, 1380638688, 1380638680, 1380638678, 1380638671, 1380638658, 1380638651, 1380638615, 1380638609, 1380638590, 1380638561, 1380638531, 1380638510] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639363', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639109', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639107', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639104', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639097', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639091', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639088', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639021', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639016', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639015', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639011', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639010', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639009', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638954', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638929', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638899', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638865', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638838', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638735', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638727', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638721', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638713', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638710', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638708', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638688', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638680', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638678', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638671', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638658', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638651', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638615', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638609', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638590', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638561', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638531', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638510', None, None, None, None, None, '3647026') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.01842188835144043 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.423548460006714 time spend to save output : 0.018883466720581055 total time spend for step 9 : 6.442431926727295 step10:split_time_score Mon Sep 1 16:34:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('15', 36),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 01092025 26404030 Nombre de photos uploadées : 36 / 23040 (0%) 01092025 26404030 Nombre de photos taguées (types de déchets): 0 / 36 (0%) 01092025 26404030 Nombre de photos taguées (volume) : 0 / 36 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.9604644775390625e-06 ???????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0022106170654296875 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.19866132736206055 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.2049839784807956 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26388367_01-09-2025_08_52_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26388367 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26388367 AND mptpi.`type`=3594 To do Qualite : 0.02858944681861349 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26388369_01-09-2025_08_42_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26388369 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26388369 AND mptpi.`type`=3594 To do Qualite : 0.17089546783625734 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26390641_01-09-2025_10_12_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26390641 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26390641 AND mptpi.`type`=3594 To do Qualite : 0.1353585409858388 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26395439_01-09-2025_13_57_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26395439 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26395439 AND mptpi.`type`=3594 To do Qualite : 0.06672458526234568 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26395440_01-09-2025_13_02_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26395440 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26395440 AND mptpi.`type`=3594 To do Qualite : 0.12035094872334459 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26397835_01-09-2025_14_31_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26397835 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26397835 AND mptpi.`type`=3594 To do Qualite : 0.16613797260802474 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26397837_01-09-2025_14_21_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26397837 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26397837 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26404029 order by id desc limit 1 Qualite : 0.1804573098851166 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26404030_01-09-2025_16_33_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26404030 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26404030 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'01092025': {'nb_upload': 36, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1380639363, 1380639109, 1380639107, 1380639104, 1380639097, 1380639091, 1380639088, 1380639021, 1380639016, 1380639015, 1380639011, 1380639010, 1380639009, 1380638954, 1380638929, 1380638899, 1380638865, 1380638838, 1380638735, 1380638727, 1380638721, 1380638713, 1380638710, 1380638708, 1380638688, 1380638680, 1380638678, 1380638671, 1380638658, 1380638651, 1380638615, 1380638609, 1380638590, 1380638561, 1380638531, 1380638510] Looping around the photos to save general results len do output : 1 /26404030Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639363', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639109', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639107', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639104', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639097', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639091', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639088', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639021', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639016', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639015', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639011', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639010', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380639009', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638954', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638929', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638899', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638865', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638838', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638735', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638727', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638721', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638713', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638710', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638708', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638688', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638680', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638678', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638671', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638658', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638651', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638615', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638609', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638590', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638561', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638531', None, None, None, None, None, '3647026') ('3318', None, None, None, None, None, None, None, '3647026') ('3318', '26404030', '1380638510', None, None, None, None, None, '3647026') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 37 time used for this insertion : 0.01790642738342285 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.847956895828247 time spend to save output : 0.018311023712158203 total time spend for step 10 : 1.8662679195404053 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 36 set_done_treatment 143.97user 44.03system 3:36.37elapsed 86%CPU (0avgtext+0avgdata 3208612maxresident)k 1064256inputs+86720outputs (14011major+3885279minor)pagefaults 0swaps