python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1734596 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4143618'] with mtr_portfolio_ids : ['29040936'] and first list_photo_ids : [] new path : /proc/1734596/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 25 ; length of list_pids : 25 ; length of list_args : 25 time to download the photos : 3.418687105178833 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Dec 1 08:30:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-12-01 08:30:36.391753: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-12-01 08:30:36.422593: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-12-01 08:30:36.424631: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f32dc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-12-01 08:30:36.424678: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-12-01 08:30:36.428245: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-12-01 08:30:36.726855: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2c551c60 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-12-01 08:30:36.726915: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-12-01 08:30:36.728072: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-01 08:30:36.728408: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-01 08:30:36.733573: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-01 08:30:36.737010: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-01 08:30:36.737747: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-01 08:30:36.740791: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-01 08:30:36.741936: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-01 08:30:36.751434: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-01 08:30:36.753098: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-01 08:30:36.753186: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-01 08:30:36.754061: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-01 08:30:36.754078: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-01 08:30:36.754088: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-01 08:30:36.756077: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-12-01 08:30:37.138632: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-01 08:30:37.138710: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-01 08:30:37.138730: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-01 08:30:37.138748: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-01 08:30:37.138765: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-01 08:30:37.138783: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-01 08:30:37.138800: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-01 08:30:37.138818: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-01 08:30:37.140420: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-01 08:30:37.141694: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-01 08:30:37.141731: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-01 08:30:37.141750: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-01 08:30:37.141767: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-01 08:30:37.141784: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-01 08:30:37.141800: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-01 08:30:37.141817: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-01 08:30:37.141834: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-01 08:30:37.143434: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-01 08:30:37.143467: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-01 08:30:37.143477: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-01 08:30:37.143487: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-01 08:30:37.144936: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-12-01 08:30:45.274834: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-01 08:30:45.474459: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 25 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 48.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 Detection mask done ! Trying to reset tf kernel 1735354 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5706 tf kernel not reseted sub process len(results) : 25 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 25 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10998 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [513, 1212, 699, 1371] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0003445148468017578 nb_pixel_total : 12634 time to create 1 rle with old method : 0.015064001083374023 length of segment : 159 DEBUG bbox = [0, 0, 1011, 1200] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.011012077331542969 nb_pixel_total : 628695 time to create 1 rle with new method : 0.5931792259216309 length of segment : 922 DEBUG bbox = [555, 1533, 1080, 1893] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0013256072998046875 nb_pixel_total : 97336 time to create 1 rle with old method : 0.10319209098815918 length of segment : 509 DEBUG bbox = [0, 0, 1026, 1098] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0095062255859375 nb_pixel_total : 747138 time to create 1 rle with new method : 0.01669454574584961 length of segment : 976 DEBUG bbox = [822, 1029, 945, 1101] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00010943412780761719 nb_pixel_total : 5767 time to create 1 rle with old method : 0.006099224090576172 length of segment : 116 DEBUG bbox = [285, 1077, 423, 1173] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00012612342834472656 nb_pixel_total : 7535 time to create 1 rle with old method : 0.007959365844726562 length of segment : 132 DEBUG bbox = [162, 1524, 309, 1635] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00014328956604003906 nb_pixel_total : 8226 time to create 1 rle with old method : 0.009038925170898438 length of segment : 130 DEBUG bbox = [927, 1467, 1053, 1575] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00013518333435058594 nb_pixel_total : 7499 time to create 1 rle with old method : 0.008352279663085938 length of segment : 117 DEBUG bbox = [912, 1368, 972, 1461] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 3137 time to create 1 rle with old method : 0.0035903453826904297 length of segment : 56 DEBUG bbox = [480, 1509, 1071, 1920] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.001710653305053711 nb_pixel_total : 125548 time to create 1 rle with old method : 0.13135576248168945 length of segment : 561 DEBUG bbox = [660, 1425, 747, 1497] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 8.7738037109375e-05 nb_pixel_total : 3260 time to create 1 rle with old method : 0.0038018226623535156 length of segment : 85 DEBUG bbox = [876, 1095, 1080, 1374] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0005769729614257812 nb_pixel_total : 34101 time to create 1 rle with old method : 0.03947734832763672 length of segment : 182 DEBUG bbox = [840, 1023, 957, 1134] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00014448165893554688 nb_pixel_total : 7701 time to create 1 rle with old method : 0.008872747421264648 length of segment : 110 DEBUG bbox = [666, 795, 783, 972] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.000247955322265625 nb_pixel_total : 9334 time to create 1 rle with old method : 0.012886285781860352 length of segment : 121 DEBUG bbox = [843, 981, 942, 1179] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00030422210693359375 nb_pixel_total : 10813 time to create 1 rle with old method : 0.012575864791870117 length of segment : 93 DEBUG bbox = [546, 1524, 675, 1731] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0003867149353027344 nb_pixel_total : 13173 time to create 1 rle with old method : 0.01496124267578125 length of segment : 114 DEBUG bbox = [0, 93, 1062, 1128] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.014171600341796875 nb_pixel_total : 674369 time to create 1 rle with new method : 0.017734050750732422 length of segment : 1105 DEBUG bbox = [516, 1545, 1056, 1914] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0020296573638916016 nb_pixel_total : 112393 time to create 1 rle with old method : 0.11800146102905273 length of segment : 525 DEBUG bbox = [885, 777, 975, 930] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002346038818359375 nb_pixel_total : 7640 time to create 1 rle with old method : 0.008683204650878906 length of segment : 76 DEBUG bbox = [297, 1074, 423, 1179] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002722740173339844 nb_pixel_total : 10180 time to create 1 rle with old method : 0.011553525924682617 length of segment : 129 DEBUG bbox = [642, 900, 732, 1023] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00020384788513183594 nb_pixel_total : 6047 time to create 1 rle with old method : 0.006924867630004883 length of segment : 78 DEBUG bbox = [861, 804, 1050, 1041] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0005245208740234375 nb_pixel_total : 15591 time to create 1 rle with old method : 0.017272472381591797 length of segment : 225 DEBUG bbox = [6, 1578, 156, 1812] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00046443939208984375 nb_pixel_total : 20704 time to create 1 rle with old method : 0.022515535354614258 length of segment : 137 DEBUG bbox = [837, 828, 924, 996] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002574920654296875 nb_pixel_total : 5747 time to create 1 rle with old method : 0.006613731384277344 length of segment : 113 DEBUG bbox = [906, 828, 1077, 1062] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0005979537963867188 nb_pixel_total : 28346 time to create 1 rle with old method : 0.031250715255737305 length of segment : 170 DEBUG bbox = [15, 0, 1002, 1173] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.011246681213378906 nb_pixel_total : 781199 time to create 1 rle with new method : 0.017873287200927734 length of segment : 1046 DEBUG bbox = [795, 237, 1077, 705] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0009484291076660156 nb_pixel_total : 67661 time to create 1 rle with old method : 0.07464981079101562 length of segment : 242 DEBUG bbox = [3, 1410, 39, 1509] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00010037422180175781 nb_pixel_total : 2566 time to create 1 rle with old method : 0.0031061172485351562 length of segment : 34 DEBUG bbox = [294, 1086, 408, 1188] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002529621124267578 nb_pixel_total : 6277 time to create 1 rle with old method : 0.007183551788330078 length of segment : 96 DEBUG bbox = [0, 9, 888, 924] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.005637168884277344 nb_pixel_total : 461606 time to create 1 rle with new method : 0.011411666870117188 length of segment : 1117 DEBUG bbox = [1008, 147, 1077, 252] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00016999244689941406 nb_pixel_total : 3992 time to create 1 rle with old method : 0.004388332366943359 length of segment : 75 DEBUG bbox = [579, 921, 765, 1038] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00038933753967285156 nb_pixel_total : 12245 time to create 1 rle with old method : 0.013886451721191406 length of segment : 218 DEBUG bbox = [903, 249, 1068, 555] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0006008148193359375 nb_pixel_total : 29037 time to create 1 rle with old method : 0.032561540603637695 length of segment : 163 DEBUG bbox = [207, 930, 420, 1053] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0004963874816894531 nb_pixel_total : 16594 time to create 1 rle with old method : 0.01919412612915039 length of segment : 220 DEBUG bbox = [39, 1161, 201, 1275] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0003361701965332031 nb_pixel_total : 11267 time to create 1 rle with old method : 0.013017654418945312 length of segment : 147 DEBUG bbox = [24, 1596, 318, 1860] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0012159347534179688 nb_pixel_total : 49879 time to create 1 rle with old method : 0.05631542205810547 length of segment : 286 DEBUG bbox = [861, 9, 1032, 108] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00033020973205566406 nb_pixel_total : 5216 time to create 1 rle with old method : 0.005873441696166992 length of segment : 143 DEBUG bbox = [63, 0, 1008, 945] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.006969928741455078 nb_pixel_total : 413467 time to create 1 rle with new method : 0.02139568328857422 length of segment : 1446 DEBUG bbox = [876, 372, 1044, 582] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0005662441253662109 nb_pixel_total : 23940 time to create 1 rle with old method : 0.026017189025878906 length of segment : 166 DEBUG bbox = [0, 0, 1020, 1083] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.012280702590942383 nb_pixel_total : 718576 time to create 1 rle with new method : 0.01778578758239746 length of segment : 976 DEBUG bbox = [9, 1542, 255, 1662] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00023651123046875 nb_pixel_total : 10112 time to create 1 rle with old method : 0.011303424835205078 length of segment : 245 DEBUG bbox = [411, 1011, 501, 1119] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00011491775512695312 nb_pixel_total : 5264 time to create 1 rle with old method : 0.006185293197631836 length of segment : 89 DEBUG bbox = [39, 1770, 339, 1920] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0003046989440917969 nb_pixel_total : 9529 time to create 1 rle with old method : 0.011237144470214844 length of segment : 263 DEBUG bbox = [45, 1776, 312, 1905] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00026798248291015625 nb_pixel_total : 9234 time to create 1 rle with old method : 0.012663602828979492 length of segment : 263 DEBUG bbox = [0, 0, 924, 1116] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.010715484619140625 nb_pixel_total : 738864 time to create 1 rle with new method : 0.015781402587890625 length of segment : 891 DEBUG bbox = [825, 714, 906, 825] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00019931793212890625 nb_pixel_total : 6017 time to create 1 rle with old method : 0.006829977035522461 length of segment : 80 DEBUG bbox = [0, 0, 963, 927] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.010025262832641602 nb_pixel_total : 631256 time to create 1 rle with new method : 0.014408349990844727 length of segment : 1294 DEBUG bbox = [510, 906, 603, 1005] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0001633167266845703 nb_pixel_total : 6044 time to create 1 rle with old method : 0.007163286209106445 length of segment : 85 DEBUG bbox = [489, 1092, 729, 1371] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0007386207580566406 nb_pixel_total : 36527 time to create 1 rle with old method : 0.04132890701293945 length of segment : 218 DEBUG bbox = [1017, 981, 1074, 1077] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00014448165893554688 nb_pixel_total : 3575 time to create 1 rle with old method : 0.004119157791137695 length of segment : 56 DEBUG bbox = [849, 678, 957, 777] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002422332763671875 nb_pixel_total : 5042 time to create 1 rle with old method : 0.0061070919036865234 length of segment : 89 DEBUG bbox = [168, 1278, 255, 1365] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0001938343048095703 nb_pixel_total : 5248 time to create 1 rle with old method : 0.0060923099517822266 length of segment : 81 DEBUG bbox = [0, 0, 1080, 1233] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.013559341430664062 nb_pixel_total : 836704 time to create 1 rle with new method : 0.02913498878479004 length of segment : 1223 DEBUG bbox = [357, 1419, 501, 1521] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.000301361083984375 nb_pixel_total : 7133 time to create 1 rle with old method : 0.008046627044677734 length of segment : 133 DEBUG bbox = [0, 0, 1035, 957] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.009425163269042969 nb_pixel_total : 643866 time to create 1 rle with new method : 0.015751123428344727 length of segment : 1101 time spent for convertir_results : 4.805290222167969 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 55 chid ids of type : 3594 Number RLEs to save : 19427 save missing photos in datou_result : time spend for datou_step_exec : 32.911383867263794 time spend to save output : 1.2835536003112793 total time spend for step 1 : 34.19493746757507 step2:crop_condition Mon Dec 1 08:31:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 25 ! batch 1 Loaded 55 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764574269_1734596 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574272), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168615_f8d01995fd0fbe9889c5b5a75d499600_rle_crop_4053390653_0.png', 0, 95, 130, 0, 1764574272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574272), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745_rle_crop_4053390655_0.png', 0, 92, 55, 0, 1764574272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574272), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745_rle_crop_4053390657_0.png', 0, 66, 85, 0, 1764574272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574272), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745_rle_crop_4053390658_0.png', 0, 276, 180, 0, 1764574272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574272), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745_rle_crop_4053390659_0.png', 0, 107, 110, 0, 1764574272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574272), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745_rle_crop_4053390660_0.png', 0, 170, 110, 0, 1764574272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574272), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168536_276e56d413b7dde43d85a75112b7b5e5_rle_crop_4053390665_0.png', 0, 147, 73, 0, 1764574272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574272), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168528_941059de3a903317dee9994754a3405e_rle_crop_4053390670_0.png', 0, 164, 81, 0, 1764574272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574272), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168466_f514d13dd3e64f2347d5b4a300dd95a9_rle_crop_4053390683_0.png', 0, 78, 143, 0, 1764574272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574272), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168456_e7b00d7a1e6b0007e155acd07bd70988_rle_crop_4053390687_0.png', 0, 98, 243, 0, 1764574272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574272), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168456_e7b00d7a1e6b0007e155acd07bd70988_rle_crop_4053390689_0.png', 0, 142, 263, 0, 1764574272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574272), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168431_fd315b33fc3124690c583c21e7b146de_rle_crop_4053390696_0.png', 0, 82, 56, 0, 1764574272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574272), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168426_1529eb71e992ce272eeef12fba0a628f_rle_crop_4053390697_0.png', 0, 90, 86, 0, 1764574272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574272), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168426_1529eb71e992ce272eeef12fba0a628f_rle_crop_4053390698_0.png', 0, 84, 80, 0, 1764574272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574272), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168422_f9ea4b501738b33b23ffac675c220f89_rle_crop_4053390700_0.png', 0, 88, 133, 0, 1764574272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.82334041595459 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3736932 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764574280_1734596 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574282), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168661_4f10a637bfec6aa04f58d4ca51065e84_rle_crop_4053390650_0.png', 0, 1049, 972, 0, 1764574282,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574282), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168615_f8d01995fd0fbe9889c5b5a75d499600_rle_crop_4053390652_0.png', 0, 86, 114, 0, 1764574282,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574282), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745_rle_crop_4053390656_0.png', 0, 364, 551, 0, 1764574282,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574282), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168580_39b2d96c98491ee6e627c97d87ebb355_rle_crop_4053390662_0.png', 0, 158, 114, 0, 1764574282,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574282), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168580_39b2d96c98491ee6e627c97d87ebb355_rle_crop_4053390663_0.png', 0, 972, 985, 0, 1764574282,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574282), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168580_39b2d96c98491ee6e627c97d87ebb355_rle_crop_4053390664_0.png', 0, 357, 522, 0, 1764574282,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574282), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168536_276e56d413b7dde43d85a75112b7b5e5_rle_crop_4053390666_0.png', 0, 101, 121, 0, 1764574282,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574282), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168500_beec8b66842d533930d57d79b8a7aec0_rle_crop_4053390675_0.png', 0, 90, 89, 0, 1764574282,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574282), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168456_e7b00d7a1e6b0007e155acd07bd70988_rle_crop_4053390688_0.png', 0, 104, 83, 0, 1764574282,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574282), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168456_e7b00d7a1e6b0007e155acd07bd70988_rle_crop_4053390690_0.png', 0, 129, 263, 0, 1764574282,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 10 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.4444401264190674 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 27 About to insert : list_path_to_insert length 27 new photo from crops ! About to upload 27 photos upload in portfolio : 3736932 init cache_photo without model_param we have 27 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764574308_1734596 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397169230_50d3cb78df95cb3b53cc7ec46f995486_rle_crop_4053390647_0.png', 0, 128, 159, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168699_3322e66b4bf0d7dc8fc2b6906180261b_rle_crop_4053390648_0.png', 0, 1147, 964, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168699_3322e66b4bf0d7dc8fc2b6906180261b_rle_crop_4053390649_0.png', 0, 330, 501, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168615_f8d01995fd0fbe9889c5b5a75d499600_rle_crop_4053390651_0.png', 0, 65, 116, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745_rle_crop_4053390654_0.png', 0, 87, 117, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168580_39b2d96c98491ee6e627c97d87ebb355_rle_crop_4053390661_0.png', 0, 196, 92, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168531_83bb15a8e4acb2f3bbfa2c19e345198e_rle_crop_4053390668_0.png', 0, 207, 171, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168531_83bb15a8e4acb2f3bbfa2c19e345198e_rle_crop_4053390669_0.png', 0, 208, 127, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168528_941059de3a903317dee9994754a3405e_rle_crop_4053390671_0.png', 0, 210, 164, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168504_2706876ca55e274ce88f2fc15015dd8d_rle_crop_4053390672_0.png', 0, 1134, 972, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168504_2706876ca55e274ce88f2fc15015dd8d_rle_crop_4053390673_0.png', 0, 441, 239, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168500_beec8b66842d533930d57d79b8a7aec0_rle_crop_4053390674_0.png', 0, 95, 33, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168494_bab7c109dcd9c7fc3f023bfec256f2b8_rle_crop_4053390676_0.png', 0, 890, 781, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168490_8702f8000f1ef0a9bfc03c9c09bf2a57_rle_crop_4053390677_0.png', 0, 89, 65, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168490_8702f8000f1ef0a9bfc03c9c09bf2a57_rle_crop_4053390678_0.png', 0, 109, 182, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168473_48951a94a9bea55384cd51ee78df4aad_rle_crop_4053390679_0.png', 0, 293, 162, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168473_48951a94a9bea55384cd51ee78df4aad_rle_crop_4053390680_0.png', 0, 109, 209, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168469_759c6cabb42ada2c43f3dc01e5302a3f_rle_crop_4053390681_0.png', 0, 105, 147, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168466_f514d13dd3e64f2347d5b4a300dd95a9_rle_crop_4053390682_0.png', 0, 248, 267, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168466_f514d13dd3e64f2347d5b4a300dd95a9_rle_crop_4053390684_0.png', 0, 904, 940, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168462_449c2b89eb93d341d253b6ad206eca84_rle_crop_4053390685_0.png', 0, 195, 166, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168462_449c2b89eb93d341d253b6ad206eca84_rle_crop_4053390686_0.png', 0, 1058, 972, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168433_6e0a9391df655d6a9c737e2161e251fd_rle_crop_4053390691_0.png', 0, 1074, 890, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168431_fd315b33fc3124690c583c21e7b146de_rle_crop_4053390693_0.png', 0, 900, 934, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168431_fd315b33fc3124690c583c21e7b146de_rle_crop_4053390695_0.png', 0, 243, 211, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168426_1529eb71e992ce272eeef12fba0a628f_rle_crop_4053390699_0.png', 0, 1194, 1002, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574318), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168422_f9ea4b501738b33b23ffac675c220f89_rle_crop_4053390701_0.png', 0, 932, 981, 0, 1764574318,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 27 photos in the portfolio 3736932 time of upload the photos Elapsed time : 11.21796727180481 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764574321_1734596 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574321), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168536_276e56d413b7dde43d85a75112b7b5e5_rle_crop_4053390667_0.png', 0, 116, 73, 0, 1764574321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574321), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168431_fd315b33fc3124690c583c21e7b146de_rle_crop_4053390692_0.png', 0, 105, 80, 0, 1764574321,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.893622636795044 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764574322_1734596 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764574323), 0.0, 0.0, 14, '', 0, 0, '1764574230_1734596_1397168431_fd315b33fc3124690c583c21e7b146de_rle_crop_4053390694_0.png', 0, 89, 85, 0, 1764574323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.48822999000549316 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1397169230, 1397168699, 1397168661, 1397168615, 1397168582, 1397168580, 1397168536, 1397168531, 1397168528, 1397168504, 1397168500, 1397168496, 1397168494, 1397168490, 1397168473, 1397168469, 1397168466, 1397168462, 1397168456, 1397168436, 1397168433, 1397168431, 1397168426, 1397168422, 1397168419] Looping around the photos to save general results len do output : 55 /1397174266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397174349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397169230', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168699', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168661', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168615', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168582', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168580', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168536', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168531', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168528', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168504', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168500', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168496', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168494', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168490', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168473', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168469', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168466', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168462', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168456', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168436', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168433', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168431', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168426', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168422', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168419', None, None, None, None, None, '4143618') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 190 time used for this insertion : 0.038587093353271484 save_final save missing photos in datou_result : time spend for datou_step_exec : 55.401211977005005 time spend to save output : 0.04112601280212402 total time spend for step 2 : 55.44233798980713 step3:rle_unique_nms_with_priority Mon Dec 1 08:32:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 55 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.1723630428314209 time for calcul the mask position with numpy : 0.42775964736938477 nb_pixel_total : 2060966 time to create 1 rle with new method : 0.277371883392334 time for calcul the mask position with numpy : 0.00956869125366211 nb_pixel_total : 12634 time to create 1 rle with old method : 0.022596359252929688 create new chi : 0.7510178089141846 time to delete rle : 0.026028156280517578 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1398 TO DO : save crop sub photo not yet done ! save time : 0.14556264877319336 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.10020709037780762 time for calcul the mask position with numpy : 0.19875407218933105 nb_pixel_total : 1347569 time to create 1 rle with new method : 0.10722756385803223 time for calcul the mask position with numpy : 0.00877070426940918 nb_pixel_total : 97336 time to create 1 rle with old method : 0.10711932182312012 time for calcul the mask position with numpy : 0.014613151550292969 nb_pixel_total : 628695 time to create 1 rle with new method : 0.20189833641052246 create new chi : 0.6502125263214111 time to delete rle : 0.0007302761077880859 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 3942 TO DO : save crop sub photo not yet done ! save time : 0.297565221786499 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.0494534969329834 time for calcul the mask position with numpy : 0.021845102310180664 nb_pixel_total : 1326462 time to create 1 rle with new method : 0.06912541389465332 time for calcul the mask position with numpy : 0.015776872634887695 nb_pixel_total : 747138 time to create 1 rle with new method : 0.13647055625915527 create new chi : 0.25222182273864746 time to delete rle : 0.0004901885986328125 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 3032 TO DO : save crop sub photo not yet done ! save time : 0.2477278709411621 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.5212790966033936 time for calcul the mask position with numpy : 0.20781850814819336 nb_pixel_total : 2052072 time to create 1 rle with new method : 0.09527587890625 time for calcul the mask position with numpy : 0.007430553436279297 nb_pixel_total : 8226 time to create 1 rle with old method : 0.009187936782836914 time for calcul the mask position with numpy : 0.008199453353881836 nb_pixel_total : 7535 time to create 1 rle with old method : 0.008375883102416992 time for calcul the mask position with numpy : 0.007572174072265625 nb_pixel_total : 5767 time to create 1 rle with old method : 0.006571531295776367 create new chi : 0.3624913692474365 time to delete rle : 0.000629425048828125 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1836 TO DO : save crop sub photo not yet done ! save time : 0.16670584678649902 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 0.4459664821624756 time for calcul the mask position with numpy : 0.06394624710083008 nb_pixel_total : 1883020 time to create 1 rle with new method : 0.1646883487701416 time for calcul the mask position with numpy : 0.008002519607543945 nb_pixel_total : 9334 time to create 1 rle with old method : 0.01057124137878418 time for calcul the mask position with numpy : 0.007340669631958008 nb_pixel_total : 7701 time to create 1 rle with old method : 0.00864267349243164 time for calcul the mask position with numpy : 0.007494926452636719 nb_pixel_total : 34101 time to create 1 rle with old method : 0.043546438217163086 time for calcul the mask position with numpy : 0.012907028198242188 nb_pixel_total : 3260 time to create 1 rle with old method : 0.0036935806274414062 time for calcul the mask position with numpy : 0.008785247802734375 nb_pixel_total : 125548 time to create 1 rle with old method : 0.14035439491271973 time for calcul the mask position with numpy : 0.008480072021484375 nb_pixel_total : 3137 time to create 1 rle with old method : 0.003674745559692383 time for calcul the mask position with numpy : 0.007955074310302734 nb_pixel_total : 7499 time to create 1 rle with old method : 0.008446216583251953 create new chi : 0.5207483768463135 time to delete rle : 0.0006210803985595703 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 3544 TO DO : save crop sub photo not yet done ! save time : 0.2813730239868164 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.13328909873962402 time for calcul the mask position with numpy : 0.022113323211669922 nb_pixel_total : 1262852 time to create 1 rle with new method : 0.22789406776428223 time for calcul the mask position with numpy : 0.008376359939575195 nb_pixel_total : 112393 time to create 1 rle with old method : 0.1264023780822754 time for calcul the mask position with numpy : 0.018266677856445312 nb_pixel_total : 674369 time to create 1 rle with new method : 0.07649493217468262 time for calcul the mask position with numpy : 0.0078277587890625 nb_pixel_total : 13173 time to create 1 rle with old method : 0.015161991119384766 time for calcul the mask position with numpy : 0.007744550704956055 nb_pixel_total : 10813 time to create 1 rle with old method : 0.013964414596557617 create new chi : 0.5336935520172119 time to delete rle : 0.001359701156616211 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 4754 TO DO : save crop sub photo not yet done ! save time : 0.34931492805480957 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.2663438320159912 time for calcul the mask position with numpy : 0.1913893222808838 nb_pixel_total : 2049733 time to create 1 rle with new method : 0.12517166137695312 time for calcul the mask position with numpy : 0.006434202194213867 nb_pixel_total : 6047 time to create 1 rle with old method : 0.0068128108978271484 time for calcul the mask position with numpy : 0.006249666213989258 nb_pixel_total : 10180 time to create 1 rle with old method : 0.011469602584838867 time for calcul the mask position with numpy : 0.0063169002532958984 nb_pixel_total : 7640 time to create 1 rle with old method : 0.00857090950012207 create new chi : 0.3724031448364258 time to delete rle : 0.00028204917907714844 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 1646 TO DO : save crop sub photo not yet done ! save time : 0.15973639488220215 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.0481257438659668 time for calcul the mask position with numpy : 0.020119667053222656 nb_pixel_total : 2037305 time to create 1 rle with new method : 0.0745995044708252 time for calcul the mask position with numpy : 0.006090641021728516 nb_pixel_total : 20704 time to create 1 rle with old method : 0.022831201553344727 time for calcul the mask position with numpy : 0.006243467330932617 nb_pixel_total : 15591 time to create 1 rle with old method : 0.017355918884277344 create new chi : 0.15407633781433105 time to delete rle : 0.0002987384796142578 batch 1 Loaded 5 chid ids of type : 3594 +++++++Number RLEs to save : 1804 TO DO : save crop sub photo not yet done ! save time : 0.172407865524292 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.03882431983947754 time for calcul the mask position with numpy : 0.0422673225402832 nb_pixel_total : 2039507 time to create 1 rle with new method : 0.09661555290222168 time for calcul the mask position with numpy : 0.006757259368896484 nb_pixel_total : 28346 time to create 1 rle with old method : 0.031662702560424805 time for calcul the mask position with numpy : 0.006478548049926758 nb_pixel_total : 5747 time to create 1 rle with old method : 0.006422758102416992 create new chi : 0.2007901668548584 time to delete rle : 0.0003192424774169922 batch 1 Loaded 5 chid ids of type : 3594 +++++Number RLEs to save : 1646 TO DO : save crop sub photo not yet done ! save time : 0.1599280834197998 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04857587814331055 time for calcul the mask position with numpy : 0.019894123077392578 nb_pixel_total : 1224740 time to create 1 rle with new method : 0.15254521369934082 time for calcul the mask position with numpy : 0.006966352462768555 nb_pixel_total : 67661 time to create 1 rle with old method : 0.07518792152404785 time for calcul the mask position with numpy : 0.012919425964355469 nb_pixel_total : 781199 time to create 1 rle with new method : 0.19962739944458008 create new chi : 0.48403501510620117 time to delete rle : 0.0005004405975341797 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 3656 TO DO : save crop sub photo not yet done ! save time : 0.2893667221069336 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.07734942436218262 time for calcul the mask position with numpy : 0.2389512062072754 nb_pixel_total : 2064757 time to create 1 rle with new method : 0.10370421409606934 time for calcul the mask position with numpy : 0.007346630096435547 nb_pixel_total : 6277 time to create 1 rle with old method : 0.007044553756713867 time for calcul the mask position with numpy : 0.0075685977935791016 nb_pixel_total : 2566 time to create 1 rle with old method : 0.002936840057373047 create new chi : 0.38103485107421875 time to delete rle : 0.0005559921264648438 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1340 TO DO : save crop sub photo not yet done ! save time : 0.14365768432617188 No data in photo_id : 1397168496 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04606509208679199 time for calcul the mask position with numpy : 0.03505659103393555 nb_pixel_total : 1611994 time to create 1 rle with new method : 0.19626402854919434 time for calcul the mask position with numpy : 0.013952255249023438 nb_pixel_total : 461606 time to create 1 rle with new method : 0.12576818466186523 create new chi : 0.39304041862487793 time to delete rle : 0.0005612373352050781 batch 1 Loaded 3 chid ids of type : 3594 +++++Number RLEs to save : 3314 TO DO : save crop sub photo not yet done ! save time : 0.25717806816101074 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.0822453498840332 time for calcul the mask position with numpy : 0.1496868133544922 nb_pixel_total : 2057363 time to create 1 rle with new method : 0.09832620620727539 time for calcul the mask position with numpy : 0.007517099380493164 nb_pixel_total : 12245 time to create 1 rle with old method : 0.013955354690551758 time for calcul the mask position with numpy : 0.007528543472290039 nb_pixel_total : 3992 time to create 1 rle with old method : 0.00455784797668457 create new chi : 0.2942790985107422 time to delete rle : 0.0006506443023681641 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1666 TO DO : save crop sub photo not yet done ! save time : 0.15570330619812012 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.06904029846191406 time for calcul the mask position with numpy : 0.16729021072387695 nb_pixel_total : 2027969 time to create 1 rle with new method : 0.20722413063049316 time for calcul the mask position with numpy : 0.007467031478881836 nb_pixel_total : 16594 time to create 1 rle with old method : 0.01809406280517578 time for calcul the mask position with numpy : 0.007385969161987305 nb_pixel_total : 29037 time to create 1 rle with old method : 0.03180217742919922 create new chi : 0.4516568183898926 time to delete rle : 0.00047397613525390625 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 1846 TO DO : save crop sub photo not yet done ! save time : 0.1563892364501953 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04669332504272461 time for calcul the mask position with numpy : 0.08174347877502441 nb_pixel_total : 2062333 time to create 1 rle with new method : 0.13581013679504395 time for calcul the mask position with numpy : 0.007390022277832031 nb_pixel_total : 11267 time to create 1 rle with old method : 0.012464761734008789 create new chi : 0.24762964248657227 time to delete rle : 0.0003991127014160156 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1374 TO DO : save crop sub photo not yet done ! save time : 0.1527700424194336 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.2804276943206787 time for calcul the mask position with numpy : 0.06561160087585449 nb_pixel_total : 1605038 time to create 1 rle with new method : 0.25636863708496094 time for calcul the mask position with numpy : 0.011039972305297852 nb_pixel_total : 413467 time to create 1 rle with new method : 0.0914311408996582 time for calcul the mask position with numpy : 0.007896184921264648 nb_pixel_total : 5216 time to create 1 rle with old method : 0.00612187385559082 time for calcul the mask position with numpy : 0.008272171020507812 nb_pixel_total : 49879 time to create 1 rle with old method : 0.05802726745605469 create new chi : 0.5155985355377197 time to delete rle : 0.0011582374572753906 batch 1 Loaded 7 chid ids of type : 3594 ++++++Number RLEs to save : 4830 TO DO : save crop sub photo not yet done ! save time : 0.358961820602417 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.07255673408508301 time for calcul the mask position with numpy : 0.023534536361694336 nb_pixel_total : 1331084 time to create 1 rle with new method : 0.33080554008483887 time for calcul the mask position with numpy : 0.01641392707824707 nb_pixel_total : 718576 time to create 1 rle with new method : 0.06619000434875488 time for calcul the mask position with numpy : 0.012339353561401367 nb_pixel_total : 23940 time to create 1 rle with old method : 0.0267333984375 create new chi : 0.4850146770477295 time to delete rle : 0.0013415813446044922 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3364 TO DO : save crop sub photo not yet done ! save time : 0.26624369621276855 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.26388120651245117 time for calcul the mask position with numpy : 0.15521979331970215 nb_pixel_total : 2048265 time to create 1 rle with new method : 0.27074408531188965 time for calcul the mask position with numpy : 0.006902217864990234 nb_pixel_total : 430 time to create 1 rle with old method : 0.0006906986236572266 time for calcul the mask position with numpy : 0.007845640182495117 nb_pixel_total : 9529 time to create 1 rle with old method : 0.010802507400512695 time for calcul the mask position with numpy : 0.0075185298919677734 nb_pixel_total : 5264 time to create 1 rle with old method : 0.005980968475341797 time for calcul the mask position with numpy : 0.007929801940917969 nb_pixel_total : 10112 time to create 1 rle with old method : 0.011390209197998047 create new chi : 0.49571681022644043 time to delete rle : 0.0006990432739257812 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2531 TO DO : save crop sub photo not yet done ! save time : 0.21355915069580078 No data in photo_id : 1397168436 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.051561594009399414 time for calcul the mask position with numpy : 0.02137160301208496 nb_pixel_total : 1334736 time to create 1 rle with new method : 0.09656071662902832 time for calcul the mask position with numpy : 0.017084598541259766 nb_pixel_total : 738864 time to create 1 rle with new method : 0.03718447685241699 create new chi : 0.17274880409240723 time to delete rle : 0.00037479400634765625 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2862 TO DO : save crop sub photo not yet done ! save time : 0.22056841850280762 nb_obj : 5 nb_hashtags : 4 time to prepare the origin masks : 0.27066469192504883 time for calcul the mask position with numpy : 0.06440210342407227 nb_pixel_total : 1390181 time to create 1 rle with new method : 0.18851041793823242 time for calcul the mask position with numpy : 0.007608175277709961 nb_pixel_total : 3575 time to create 1 rle with old method : 0.004045724868774414 time for calcul the mask position with numpy : 0.007987260818481445 nb_pixel_total : 36527 time to create 1 rle with old method : 0.04363822937011719 time for calcul the mask position with numpy : 0.007644176483154297 nb_pixel_total : 6044 time to create 1 rle with old method : 0.006479740142822266 time for calcul the mask position with numpy : 0.015472650527954102 nb_pixel_total : 631256 time to create 1 rle with new method : 0.10184812545776367 time for calcul the mask position with numpy : 0.0077991485595703125 nb_pixel_total : 6017 time to create 1 rle with old method : 0.009096384048461914 create new chi : 0.4777414798736572 time to delete rle : 0.0012230873107910156 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 4546 TO DO : save crop sub photo not yet done ! save time : 0.3579599857330322 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.06285548210144043 time for calcul the mask position with numpy : 0.016443967819213867 nb_pixel_total : 1226606 time to create 1 rle with new method : 0.1513826847076416 time for calcul the mask position with numpy : 0.012194395065307617 nb_pixel_total : 836704 time to create 1 rle with new method : 0.029168367385864258 time for calcul the mask position with numpy : 0.006067991256713867 nb_pixel_total : 5248 time to create 1 rle with old method : 0.005787372589111328 time for calcul the mask position with numpy : 0.006102800369262695 nb_pixel_total : 5042 time to create 1 rle with old method : 0.005537748336791992 create new chi : 0.23322796821594238 time to delete rle : 0.0006117820739746094 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 3866 TO DO : save crop sub photo not yet done ! save time : 0.2942783832550049 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.06389331817626953 time for calcul the mask position with numpy : 0.051595449447631836 nb_pixel_total : 1422601 time to create 1 rle with new method : 0.22058773040771484 time for calcul the mask position with numpy : 0.014190435409545898 nb_pixel_total : 643866 time to create 1 rle with new method : 0.13285589218139648 time for calcul the mask position with numpy : 0.006893634796142578 nb_pixel_total : 7133 time to create 1 rle with old method : 0.007992267608642578 create new chi : 0.4464247226715088 time to delete rle : 0.0008366107940673828 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3548 TO DO : save crop sub photo not yet done ! save time : 0.28986215591430664 No data in photo_id : 1397168419 map_output_result : {1397169230: (0.0, 'Should be the crop_list due to order', 0), 1397168699: (0.0, 'Should be the crop_list due to order', 0), 1397168661: (0.0, 'Should be the crop_list due to order', 0), 1397168615: (0.0, 'Should be the crop_list due to order', 0), 1397168582: (0.0, 'Should be the crop_list due to order', 0), 1397168580: (0.0, 'Should be the crop_list due to order', 0), 1397168536: (0.0, 'Should be the crop_list due to order', 0), 1397168531: (0.0, 'Should be the crop_list due to order', 0), 1397168528: (0.0, 'Should be the crop_list due to order', 0), 1397168504: (0.0, 'Should be the crop_list due to order', 0), 1397168500: (0.0, 'Should be the crop_list due to order', 0), 1397168496: (0.0, 'Should be the crop_list due to order', 0.0), 1397168494: (0.0, 'Should be the crop_list due to order', 0), 1397168490: (0.0, 'Should be the crop_list due to order', 0), 1397168473: (0.0, 'Should be the crop_list due to order', 0), 1397168469: (0.0, 'Should be the crop_list due to order', 0), 1397168466: (0.0, 'Should be the crop_list due to order', 0), 1397168462: (0.0, 'Should be the crop_list due to order', 0), 1397168456: (0.0, 'Should be the crop_list due to order', 0), 1397168436: (0.0, 'Should be the crop_list due to order', 0.0), 1397168433: (0.0, 'Should be the crop_list due to order', 0), 1397168431: (0.0, 'Should be the crop_list due to order', 0), 1397168426: (0.0, 'Should be the crop_list due to order', 0), 1397168422: (0.0, 'Should be the crop_list due to order', 0), 1397168419: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1397169230, 1397168699, 1397168661, 1397168615, 1397168582, 1397168580, 1397168536, 1397168531, 1397168528, 1397168504, 1397168500, 1397168496, 1397168494, 1397168490, 1397168473, 1397168469, 1397168466, 1397168462, 1397168456, 1397168436, 1397168433, 1397168431, 1397168426, 1397168422, 1397168419] Looping around the photos to save general results len do output : 25 /1397169230.Didn't retrieve data . /1397168699.Didn't retrieve data . /1397168661.Didn't retrieve data . /1397168615.Didn't retrieve data . /1397168582.Didn't retrieve data . /1397168580.Didn't retrieve data . /1397168536.Didn't retrieve data . /1397168531.Didn't retrieve data . /1397168528.Didn't retrieve data . /1397168504.Didn't retrieve data . /1397168500.Didn't retrieve data . /1397168496.Didn't retrieve data . /1397168494.Didn't retrieve data . /1397168490.Didn't retrieve data . /1397168473.Didn't retrieve data . /1397168469.Didn't retrieve data . /1397168466.Didn't retrieve data . /1397168462.Didn't retrieve data . /1397168456.Didn't retrieve data . /1397168436.Didn't retrieve data . /1397168433.Didn't retrieve data . /1397168431.Didn't retrieve data . /1397168426.Didn't retrieve data . /1397168422.Didn't retrieve data . /1397168419.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397169230', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168699', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168661', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168615', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168582', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168580', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168536', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168531', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168528', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168504', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168500', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168496', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168494', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168490', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168473', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168469', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168466', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168462', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168456', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168436', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168433', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168431', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168426', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168422', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168419', None, None, None, None, None, '4143618') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 75 time used for this insertion : 0.017061948776245117 save_final save missing photos in datou_result : time spend for datou_step_exec : 17.958481550216675 time spend to save output : 0.01809406280517578 total time spend for step 3 : 17.97657561302185 step4:ventilate_hashtags_in_portfolio Mon Dec 1 08:32:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 29040936 get user id for portfolio 29040936 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29040936 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','metal','background','carton','pehd','pet_clair','autre','pet_fonce','flou','papier')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29040936 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','metal','background','carton','pehd','pet_clair','autre','pet_fonce','flou','papier')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29040936 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','metal','background','carton','pehd','pet_clair','autre','pet_fonce','flou','papier')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/29041146,29041147,29041148,29041149,29041150,29041151,29041152,29041153,29041154,29041155,29041156?tags=environnement,mal_croppe,metal,background,carton,pehd,pet_clair,autre,pet_fonce,flou,papier Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1397169230, 1397168699, 1397168661, 1397168615, 1397168582, 1397168580, 1397168536, 1397168531, 1397168528, 1397168504, 1397168500, 1397168496, 1397168494, 1397168490, 1397168473, 1397168469, 1397168466, 1397168462, 1397168456, 1397168436, 1397168433, 1397168431, 1397168426, 1397168422, 1397168419] Looping around the photos to save general results len do output : 1 /29040936. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397169230', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168699', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168661', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168615', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168582', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168580', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168536', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168531', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168528', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168504', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168500', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168496', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168494', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168490', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168473', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168469', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168466', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168462', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168456', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168436', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168433', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168431', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168426', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168422', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168419', None, None, None, None, None, '4143618') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 26 time used for this insertion : 0.022630691528320312 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.8877584934234619 time spend to save output : 0.023012399673461914 total time spend for step 4 : 0.9107708930969238 step5:final Mon Dec 1 08:32:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1397169230: ('0.15725399305555557',), 1397168699: ('0.15725399305555557',), 1397168661: ('0.15725399305555557',), 1397168615: ('0.15725399305555557',), 1397168582: ('0.15725399305555557',), 1397168580: ('0.15725399305555557',), 1397168536: ('0.15725399305555557',), 1397168531: ('0.15725399305555557',), 1397168528: ('0.15725399305555557',), 1397168504: ('0.15725399305555557',), 1397168500: ('0.15725399305555557',), 1397168496: ('0.15725399305555557',), 1397168494: ('0.15725399305555557',), 1397168490: ('0.15725399305555557',), 1397168473: ('0.15725399305555557',), 1397168469: ('0.15725399305555557',), 1397168466: ('0.15725399305555557',), 1397168462: ('0.15725399305555557',), 1397168456: ('0.15725399305555557',), 1397168436: ('0.15725399305555557',), 1397168433: ('0.15725399305555557',), 1397168431: ('0.15725399305555557',), 1397168426: ('0.15725399305555557',), 1397168422: ('0.15725399305555557',), 1397168419: ('0.15725399305555557',)} new output for save of step final : {1397169230: ('0.15725399305555557',), 1397168699: ('0.15725399305555557',), 1397168661: ('0.15725399305555557',), 1397168615: ('0.15725399305555557',), 1397168582: ('0.15725399305555557',), 1397168580: ('0.15725399305555557',), 1397168536: ('0.15725399305555557',), 1397168531: ('0.15725399305555557',), 1397168528: ('0.15725399305555557',), 1397168504: ('0.15725399305555557',), 1397168500: ('0.15725399305555557',), 1397168496: ('0.15725399305555557',), 1397168494: ('0.15725399305555557',), 1397168490: ('0.15725399305555557',), 1397168473: ('0.15725399305555557',), 1397168469: ('0.15725399305555557',), 1397168466: ('0.15725399305555557',), 1397168462: ('0.15725399305555557',), 1397168456: ('0.15725399305555557',), 1397168436: ('0.15725399305555557',), 1397168433: ('0.15725399305555557',), 1397168431: ('0.15725399305555557',), 1397168426: ('0.15725399305555557',), 1397168422: ('0.15725399305555557',), 1397168419: ('0.15725399305555557',)} [1397169230, 1397168699, 1397168661, 1397168615, 1397168582, 1397168580, 1397168536, 1397168531, 1397168528, 1397168504, 1397168500, 1397168496, 1397168494, 1397168490, 1397168473, 1397168469, 1397168466, 1397168462, 1397168456, 1397168436, 1397168433, 1397168431, 1397168426, 1397168422, 1397168419] Looping around the photos to save general results len do output : 25 /1397169230.Didn't retrieve data . /1397168699.Didn't retrieve data . /1397168661.Didn't retrieve data . /1397168615.Didn't retrieve data . /1397168582.Didn't retrieve data . /1397168580.Didn't retrieve data . /1397168536.Didn't retrieve data . /1397168531.Didn't retrieve data . /1397168528.Didn't retrieve data . /1397168504.Didn't retrieve data . /1397168500.Didn't retrieve data . /1397168496.Didn't retrieve data . /1397168494.Didn't retrieve data . /1397168490.Didn't retrieve data . /1397168473.Didn't retrieve data . /1397168469.Didn't retrieve data . /1397168466.Didn't retrieve data . /1397168462.Didn't retrieve data . /1397168456.Didn't retrieve data . /1397168436.Didn't retrieve data . /1397168433.Didn't retrieve data . /1397168431.Didn't retrieve data . /1397168426.Didn't retrieve data . /1397168422.Didn't retrieve data . /1397168419.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397169230', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168699', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168661', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168615', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168582', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168580', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168536', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168531', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168528', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168504', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168500', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168496', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168494', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168490', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168473', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168469', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168466', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168462', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168456', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168436', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168433', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168431', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168426', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168422', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168419', None, None, None, None, None, '4143618') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 75 time used for this insertion : 0.01897454261779785 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1374056339263916 time spend to save output : 0.020015716552734375 total time spend for step 5 : 0.15742135047912598 step6:blur_detection Mon Dec 1 08:32:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1764574230_1734596_1397169230_50d3cb78df95cb3b53cc7ec46f995486.jpg resize: (1080, 1920) 1397169230 1.0068712486134248 treat image : temp/1764574230_1734596_1397168699_3322e66b4bf0d7dc8fc2b6906180261b.jpg resize: (1080, 1920) 1397168699 1.5505497690497916 treat image : temp/1764574230_1734596_1397168661_4f10a637bfec6aa04f58d4ca51065e84.jpg resize: (1080, 1920) 1397168661 -0.9847810745794903 treat image : temp/1764574230_1734596_1397168615_f8d01995fd0fbe9889c5b5a75d499600.jpg resize: (1080, 1920) 1397168615 0.4046531203714679 treat image : temp/1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745.jpg resize: (1080, 1920) 1397168582 -0.26406737461651464 treat image : temp/1764574230_1734596_1397168580_39b2d96c98491ee6e627c97d87ebb355.jpg resize: (1080, 1920) 1397168580 -0.5815821451627209 treat image : temp/1764574230_1734596_1397168536_276e56d413b7dde43d85a75112b7b5e5.jpg resize: (1080, 1920) 1397168536 -1.129638023180873 treat image : temp/1764574230_1734596_1397168531_83bb15a8e4acb2f3bbfa2c19e345198e.jpg resize: (1080, 1920) 1397168531 -1.8066287021058867 treat image : temp/1764574230_1734596_1397168528_941059de3a903317dee9994754a3405e.jpg resize: (1080, 1920) 1397168528 -3.893174624779829 treat image : temp/1764574230_1734596_1397168504_2706876ca55e274ce88f2fc15015dd8d.jpg resize: (1080, 1920) 1397168504 1.519559300945814 treat image : temp/1764574230_1734596_1397168500_beec8b66842d533930d57d79b8a7aec0.jpg resize: (1080, 1920) 1397168500 -3.9594485299288324 treat image : temp/1764574230_1734596_1397168496_6230b2253b6c3dd21f222e45d56d0c36.jpg resize: (1080, 1920) 1397168496 2.033597922861731 treat image : temp/1764574230_1734596_1397168494_bab7c109dcd9c7fc3f023bfec256f2b8.jpg resize: (1080, 1920) 1397168494 -0.0812256223699507 treat image : temp/1764574230_1734596_1397168490_8702f8000f1ef0a9bfc03c9c09bf2a57.jpg resize: (1080, 1920) 1397168490 -4.370664834599597 treat image : temp/1764574230_1734596_1397168473_48951a94a9bea55384cd51ee78df4aad.jpg resize: (1080, 1920) 1397168473 -0.6021489313058126 treat image : temp/1764574230_1734596_1397168469_759c6cabb42ada2c43f3dc01e5302a3f.jpg resize: (1080, 1920) 1397168469 -0.6369726998041297 treat image : temp/1764574230_1734596_1397168466_f514d13dd3e64f2347d5b4a300dd95a9.jpg resize: (1080, 1920) 1397168466 -1.0383870061315839 treat image : temp/1764574230_1734596_1397168462_449c2b89eb93d341d253b6ad206eca84.jpg resize: (1080, 1920) 1397168462 -4.214464107679119 treat image : temp/1764574230_1734596_1397168456_e7b00d7a1e6b0007e155acd07bd70988.jpg resize: (1080, 1920) 1397168456 -3.1962139600035613 treat image : temp/1764574230_1734596_1397168436_ff2e17a357538b1276c25e587a7b5bbe.jpg resize: (1080, 1920) 1397168436 -0.1462069162299921 treat image : temp/1764574230_1734596_1397168433_6e0a9391df655d6a9c737e2161e251fd.jpg resize: (1080, 1920) 1397168433 -0.8895528463926955 treat image : temp/1764574230_1734596_1397168431_fd315b33fc3124690c583c21e7b146de.jpg resize: (1080, 1920) 1397168431 -0.06000700156496797 treat image : temp/1764574230_1734596_1397168426_1529eb71e992ce272eeef12fba0a628f.jpg resize: (1080, 1920) 1397168426 0.44355857306278496 treat image : temp/1764574230_1734596_1397168422_f9ea4b501738b33b23ffac675c220f89.jpg resize: (1080, 1920) 1397168422 0.5645285081465421 treat image : temp/1764574230_1734596_1397168419_70d89294fc9b6f32a4f4bc8bde8f489c.jpg resize: (1080, 1920) 1397168419 -0.21964061063245546 treat image : temp/1764574230_1734596_1397168615_f8d01995fd0fbe9889c5b5a75d499600_rle_crop_4053390653_0.png resize: (130, 95) 1397174266 -1.008123887380923 treat image : temp/1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745_rle_crop_4053390655_0.png resize: (55, 92) 1397174267 0.27900338057040314 treat image : temp/1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745_rle_crop_4053390657_0.png resize: (85, 66) 1397174268 -1.9490596299974952 treat image : temp/1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745_rle_crop_4053390658_0.png resize: (180, 276) 1397174269 -1.2304054098382382 treat image : temp/1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745_rle_crop_4053390659_0.png resize: (110, 107) 1397174270 -0.20471097780384945 treat image : temp/1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745_rle_crop_4053390660_0.png resize: (110, 170) 1397174271 -3.1819824599976396 treat image : temp/1764574230_1734596_1397168536_276e56d413b7dde43d85a75112b7b5e5_rle_crop_4053390665_0.png resize: (73, 147) 1397174272 -0.5860336992833668 treat image : temp/1764574230_1734596_1397168528_941059de3a903317dee9994754a3405e_rle_crop_4053390670_0.png resize: (81, 164) 1397174273 -3.093930504866392 treat image : temp/1764574230_1734596_1397168466_f514d13dd3e64f2347d5b4a300dd95a9_rle_crop_4053390683_0.png resize: (143, 78) 1397174274 -2.0933172746817292 treat image : temp/1764574230_1734596_1397168456_e7b00d7a1e6b0007e155acd07bd70988_rle_crop_4053390687_0.png resize: (243, 98) 1397174275 -3.766794260960238 treat image : temp/1764574230_1734596_1397168456_e7b00d7a1e6b0007e155acd07bd70988_rle_crop_4053390689_0.png resize: (263, 142) 1397174276 -2.9743942286828076 treat image : temp/1764574230_1734596_1397168431_fd315b33fc3124690c583c21e7b146de_rle_crop_4053390696_0.png resize: (56, 82) 1397174277 1.2865490171567717 treat image : temp/1764574230_1734596_1397168426_1529eb71e992ce272eeef12fba0a628f_rle_crop_4053390697_0.png resize: (86, 90) 1397174278 -0.5567547599169876 treat image : temp/1764574230_1734596_1397168426_1529eb71e992ce272eeef12fba0a628f_rle_crop_4053390698_0.png resize: (80, 84) 1397174279 -0.28651126543747024 treat image : temp/1764574230_1734596_1397168422_f9ea4b501738b33b23ffac675c220f89_rle_crop_4053390700_0.png resize: (133, 88) 1397174280 -0.8636161296884671 treat image : temp/1764574230_1734596_1397168661_4f10a637bfec6aa04f58d4ca51065e84_rle_crop_4053390650_0.png resize: (972, 1049) 1397174286 -0.037837033196456156 treat image : temp/1764574230_1734596_1397168615_f8d01995fd0fbe9889c5b5a75d499600_rle_crop_4053390652_0.png resize: (114, 86) 1397174287 -0.9267972443558147 treat image : temp/1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745_rle_crop_4053390656_0.png resize: (551, 364) 1397174288 -0.19915023062796705 treat image : temp/1764574230_1734596_1397168580_39b2d96c98491ee6e627c97d87ebb355_rle_crop_4053390662_0.png resize: (114, 158) 1397174289 -1.4767559146434526 treat image : temp/1764574230_1734596_1397168580_39b2d96c98491ee6e627c97d87ebb355_rle_crop_4053390663_0.png resize: (985, 972) 1397174290 -0.6530025634540221 treat image : temp/1764574230_1734596_1397168580_39b2d96c98491ee6e627c97d87ebb355_rle_crop_4053390664_0.png resize: (522, 357) 1397174291 0.5191299997199899 treat image : temp/1764574230_1734596_1397168536_276e56d413b7dde43d85a75112b7b5e5_rle_crop_4053390666_0.png resize: (121, 101) 1397174292 0.6925624296876234 treat image : temp/1764574230_1734596_1397168500_beec8b66842d533930d57d79b8a7aec0_rle_crop_4053390675_0.png resize: (89, 90) 1397174293 1.143161202109123 treat image : temp/1764574230_1734596_1397168456_e7b00d7a1e6b0007e155acd07bd70988_rle_crop_4053390688_0.png resize: (83, 104) 1397174294 -2.083324400045541 treat image : temp/1764574230_1734596_1397168456_e7b00d7a1e6b0007e155acd07bd70988_rle_crop_4053390690_0.png resize: (263, 129) 1397174295 -3.1312940083819587 treat image : temp/1764574230_1734596_1397169230_50d3cb78df95cb3b53cc7ec46f995486_rle_crop_4053390647_0.png resize: (159, 128) 1397174314 -1.1258095257063812 treat image : temp/1764574230_1734596_1397168699_3322e66b4bf0d7dc8fc2b6906180261b_rle_crop_4053390648_0.png resize: (964, 1147) 1397174315 0.47042311895942934 treat image : temp/1764574230_1734596_1397168699_3322e66b4bf0d7dc8fc2b6906180261b_rle_crop_4053390649_0.png resize: (501, 330) 1397174316 0.1872414705208871 treat image : temp/1764574230_1734596_1397168615_f8d01995fd0fbe9889c5b5a75d499600_rle_crop_4053390651_0.png resize: (116, 65) 1397174317 -4.398567440144774 treat image : temp/1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745_rle_crop_4053390654_0.png resize: (117, 87) 1397174318 -0.6897777194573764 treat image : temp/1764574230_1734596_1397168580_39b2d96c98491ee6e627c97d87ebb355_rle_crop_4053390661_0.png resize: (92, 196) 1397174319 -4.311424562283412 treat image : temp/1764574230_1734596_1397168531_83bb15a8e4acb2f3bbfa2c19e345198e_rle_crop_4053390668_0.png resize: (171, 207) 1397174320 -3.256065328894747 treat image : temp/1764574230_1734596_1397168531_83bb15a8e4acb2f3bbfa2c19e345198e_rle_crop_4053390669_0.png resize: (127, 208) 1397174321 -2.066880625467045 treat image : temp/1764574230_1734596_1397168528_941059de3a903317dee9994754a3405e_rle_crop_4053390671_0.png resize: (164, 210) 1397174322 -4.715411788059431 treat image : temp/1764574230_1734596_1397168504_2706876ca55e274ce88f2fc15015dd8d_rle_crop_4053390672_0.png resize: (972, 1134) 1397174323 0.5472320097433465 treat image : temp/1764574230_1734596_1397168504_2706876ca55e274ce88f2fc15015dd8d_rle_crop_4053390673_0.png resize: (239, 441) 1397174324 -2.570075806019399 treat image : temp/1764574230_1734596_1397168500_beec8b66842d533930d57d79b8a7aec0_rle_crop_4053390674_0.png resize: (33, 95) 1397174325 1.7383012410494416 treat image : temp/1764574230_1734596_1397168494_bab7c109dcd9c7fc3f023bfec256f2b8_rle_crop_4053390676_0.png resize: (781, 890) 1397174326 -0.16059362460883053 treat image : temp/1764574230_1734596_1397168490_8702f8000f1ef0a9bfc03c9c09bf2a57_rle_crop_4053390677_0.png resize: (65, 89) 1397174327 -3.4836193616264874 treat image : temp/1764574230_1734596_1397168490_8702f8000f1ef0a9bfc03c9c09bf2a57_rle_crop_4053390678_0.png resize: (182, 109) 1397174328 -2.9927088029398354 treat image : temp/1764574230_1734596_1397168473_48951a94a9bea55384cd51ee78df4aad_rle_crop_4053390679_0.png resize: (162, 293) 1397174329 -1.4393888980229865 treat image : temp/1764574230_1734596_1397168473_48951a94a9bea55384cd51ee78df4aad_rle_crop_4053390680_0.png resize: (209, 109) 1397174330 -1.6793068338151895 treat image : temp/1764574230_1734596_1397168469_759c6cabb42ada2c43f3dc01e5302a3f_rle_crop_4053390681_0.png resize: (147, 105) 1397174331 -2.1110972716366327 treat image : temp/1764574230_1734596_1397168466_f514d13dd3e64f2347d5b4a300dd95a9_rle_crop_4053390682_0.png resize: (267, 248) 1397174332 -0.39098183416092486 treat image : temp/1764574230_1734596_1397168466_f514d13dd3e64f2347d5b4a300dd95a9_rle_crop_4053390684_0.png resize: (940, 904) 1397174333 -1.2563474604179863 treat image : temp/1764574230_1734596_1397168462_449c2b89eb93d341d253b6ad206eca84_rle_crop_4053390685_0.png resize: (166, 195) 1397174334 -3.9831721528722435 treat image : temp/1764574230_1734596_1397168462_449c2b89eb93d341d253b6ad206eca84_rle_crop_4053390686_0.png resize: (972, 1058) 1397174335 -0.6101183124144757 treat image : temp/1764574230_1734596_1397168433_6e0a9391df655d6a9c737e2161e251fd_rle_crop_4053390691_0.png resize: (890, 1074) 1397174336 0.43814544747848305 treat image : temp/1764574230_1734596_1397168431_fd315b33fc3124690c583c21e7b146de_rle_crop_4053390693_0.png resize: (934, 900) 1397174337 0.04408880026033913 treat image : temp/1764574230_1734596_1397168431_fd315b33fc3124690c583c21e7b146de_rle_crop_4053390695_0.png resize: (211, 243) 1397174338 -1.6042792627605666 treat image : temp/1764574230_1734596_1397168426_1529eb71e992ce272eeef12fba0a628f_rle_crop_4053390699_0.png resize: (1002, 1194) 1397174339 0.08114579725488974 treat image : temp/1764574230_1734596_1397168422_f9ea4b501738b33b23ffac675c220f89_rle_crop_4053390701_0.png resize: (981, 932) 1397174340 0.43065195439150744 treat image : temp/1764574230_1734596_1397168536_276e56d413b7dde43d85a75112b7b5e5_rle_crop_4053390667_0.png resize: (73, 116) 1397174342 -2.012738566642026 treat image : temp/1764574230_1734596_1397168431_fd315b33fc3124690c583c21e7b146de_rle_crop_4053390692_0.png resize: (80, 105) 1397174343 -0.1431284518212334 treat image : temp/1764574230_1734596_1397168431_fd315b33fc3124690c583c21e7b146de_rle_crop_4053390694_0.png resize: (85, 89) 1397174349 -2.2937544131521435 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 80 time used for this insertion : 0.020453691482543945 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 80 time used for this insertion : 0.02023482322692871 save missing photos in datou_result : time spend for datou_step_exec : 23.99917459487915 time spend to save output : 0.0463252067565918 total time spend for step 6 : 24.045499801635742 step7:brightness Mon Dec 1 08:32:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1764574230_1734596_1397169230_50d3cb78df95cb3b53cc7ec46f995486.jpg treat image : temp/1764574230_1734596_1397168699_3322e66b4bf0d7dc8fc2b6906180261b.jpg treat image : temp/1764574230_1734596_1397168661_4f10a637bfec6aa04f58d4ca51065e84.jpg treat image : temp/1764574230_1734596_1397168615_f8d01995fd0fbe9889c5b5a75d499600.jpg treat image : temp/1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745.jpg treat image : temp/1764574230_1734596_1397168580_39b2d96c98491ee6e627c97d87ebb355.jpg treat image : temp/1764574230_1734596_1397168536_276e56d413b7dde43d85a75112b7b5e5.jpg treat image : temp/1764574230_1734596_1397168531_83bb15a8e4acb2f3bbfa2c19e345198e.jpg treat image : temp/1764574230_1734596_1397168528_941059de3a903317dee9994754a3405e.jpg treat image : temp/1764574230_1734596_1397168504_2706876ca55e274ce88f2fc15015dd8d.jpg treat image : temp/1764574230_1734596_1397168500_beec8b66842d533930d57d79b8a7aec0.jpg treat image : temp/1764574230_1734596_1397168496_6230b2253b6c3dd21f222e45d56d0c36.jpg treat image : temp/1764574230_1734596_1397168494_bab7c109dcd9c7fc3f023bfec256f2b8.jpg treat image : temp/1764574230_1734596_1397168490_8702f8000f1ef0a9bfc03c9c09bf2a57.jpg treat image : temp/1764574230_1734596_1397168473_48951a94a9bea55384cd51ee78df4aad.jpg treat image : temp/1764574230_1734596_1397168469_759c6cabb42ada2c43f3dc01e5302a3f.jpg treat image : temp/1764574230_1734596_1397168466_f514d13dd3e64f2347d5b4a300dd95a9.jpg treat image : temp/1764574230_1734596_1397168462_449c2b89eb93d341d253b6ad206eca84.jpg treat image : temp/1764574230_1734596_1397168456_e7b00d7a1e6b0007e155acd07bd70988.jpg treat image : temp/1764574230_1734596_1397168436_ff2e17a357538b1276c25e587a7b5bbe.jpg treat image : temp/1764574230_1734596_1397168433_6e0a9391df655d6a9c737e2161e251fd.jpg treat image : temp/1764574230_1734596_1397168431_fd315b33fc3124690c583c21e7b146de.jpg treat image : temp/1764574230_1734596_1397168426_1529eb71e992ce272eeef12fba0a628f.jpg treat image : temp/1764574230_1734596_1397168422_f9ea4b501738b33b23ffac675c220f89.jpg treat image : temp/1764574230_1734596_1397168419_70d89294fc9b6f32a4f4bc8bde8f489c.jpg treat image : temp/1764574230_1734596_1397168615_f8d01995fd0fbe9889c5b5a75d499600_rle_crop_4053390653_0.png treat image : temp/1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745_rle_crop_4053390655_0.png treat image : temp/1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745_rle_crop_4053390657_0.png treat image : temp/1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745_rle_crop_4053390658_0.png treat image : temp/1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745_rle_crop_4053390659_0.png treat image : temp/1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745_rle_crop_4053390660_0.png treat image : temp/1764574230_1734596_1397168536_276e56d413b7dde43d85a75112b7b5e5_rle_crop_4053390665_0.png treat image : temp/1764574230_1734596_1397168528_941059de3a903317dee9994754a3405e_rle_crop_4053390670_0.png treat image : temp/1764574230_1734596_1397168466_f514d13dd3e64f2347d5b4a300dd95a9_rle_crop_4053390683_0.png treat image : temp/1764574230_1734596_1397168456_e7b00d7a1e6b0007e155acd07bd70988_rle_crop_4053390687_0.png treat image : temp/1764574230_1734596_1397168456_e7b00d7a1e6b0007e155acd07bd70988_rle_crop_4053390689_0.png treat image : temp/1764574230_1734596_1397168431_fd315b33fc3124690c583c21e7b146de_rle_crop_4053390696_0.png treat image : temp/1764574230_1734596_1397168426_1529eb71e992ce272eeef12fba0a628f_rle_crop_4053390697_0.png treat image : temp/1764574230_1734596_1397168426_1529eb71e992ce272eeef12fba0a628f_rle_crop_4053390698_0.png treat image : temp/1764574230_1734596_1397168422_f9ea4b501738b33b23ffac675c220f89_rle_crop_4053390700_0.png treat image : temp/1764574230_1734596_1397168661_4f10a637bfec6aa04f58d4ca51065e84_rle_crop_4053390650_0.png treat image : temp/1764574230_1734596_1397168615_f8d01995fd0fbe9889c5b5a75d499600_rle_crop_4053390652_0.png treat image : temp/1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745_rle_crop_4053390656_0.png treat image : temp/1764574230_1734596_1397168580_39b2d96c98491ee6e627c97d87ebb355_rle_crop_4053390662_0.png treat image : temp/1764574230_1734596_1397168580_39b2d96c98491ee6e627c97d87ebb355_rle_crop_4053390663_0.png treat image : temp/1764574230_1734596_1397168580_39b2d96c98491ee6e627c97d87ebb355_rle_crop_4053390664_0.png treat image : temp/1764574230_1734596_1397168536_276e56d413b7dde43d85a75112b7b5e5_rle_crop_4053390666_0.png treat image : temp/1764574230_1734596_1397168500_beec8b66842d533930d57d79b8a7aec0_rle_crop_4053390675_0.png treat image : temp/1764574230_1734596_1397168456_e7b00d7a1e6b0007e155acd07bd70988_rle_crop_4053390688_0.png treat image : temp/1764574230_1734596_1397168456_e7b00d7a1e6b0007e155acd07bd70988_rle_crop_4053390690_0.png treat image : temp/1764574230_1734596_1397169230_50d3cb78df95cb3b53cc7ec46f995486_rle_crop_4053390647_0.png treat image : temp/1764574230_1734596_1397168699_3322e66b4bf0d7dc8fc2b6906180261b_rle_crop_4053390648_0.png treat image : temp/1764574230_1734596_1397168699_3322e66b4bf0d7dc8fc2b6906180261b_rle_crop_4053390649_0.png treat image : temp/1764574230_1734596_1397168615_f8d01995fd0fbe9889c5b5a75d499600_rle_crop_4053390651_0.png treat image : temp/1764574230_1734596_1397168582_0563d6ff8832219ef83091101b992745_rle_crop_4053390654_0.png treat image : temp/1764574230_1734596_1397168580_39b2d96c98491ee6e627c97d87ebb355_rle_crop_4053390661_0.png treat image : temp/1764574230_1734596_1397168531_83bb15a8e4acb2f3bbfa2c19e345198e_rle_crop_4053390668_0.png treat image : temp/1764574230_1734596_1397168531_83bb15a8e4acb2f3bbfa2c19e345198e_rle_crop_4053390669_0.png treat image : temp/1764574230_1734596_1397168528_941059de3a903317dee9994754a3405e_rle_crop_4053390671_0.png treat image : temp/1764574230_1734596_1397168504_2706876ca55e274ce88f2fc15015dd8d_rle_crop_4053390672_0.png treat image : temp/1764574230_1734596_1397168504_2706876ca55e274ce88f2fc15015dd8d_rle_crop_4053390673_0.png treat image : temp/1764574230_1734596_1397168500_beec8b66842d533930d57d79b8a7aec0_rle_crop_4053390674_0.png treat image : temp/1764574230_1734596_1397168494_bab7c109dcd9c7fc3f023bfec256f2b8_rle_crop_4053390676_0.png treat image : temp/1764574230_1734596_1397168490_8702f8000f1ef0a9bfc03c9c09bf2a57_rle_crop_4053390677_0.png treat image : temp/1764574230_1734596_1397168490_8702f8000f1ef0a9bfc03c9c09bf2a57_rle_crop_4053390678_0.png treat image : temp/1764574230_1734596_1397168473_48951a94a9bea55384cd51ee78df4aad_rle_crop_4053390679_0.png treat image : temp/1764574230_1734596_1397168473_48951a94a9bea55384cd51ee78df4aad_rle_crop_4053390680_0.png treat image : temp/1764574230_1734596_1397168469_759c6cabb42ada2c43f3dc01e5302a3f_rle_crop_4053390681_0.png treat image : temp/1764574230_1734596_1397168466_f514d13dd3e64f2347d5b4a300dd95a9_rle_crop_4053390682_0.png treat image : temp/1764574230_1734596_1397168466_f514d13dd3e64f2347d5b4a300dd95a9_rle_crop_4053390684_0.png treat image : temp/1764574230_1734596_1397168462_449c2b89eb93d341d253b6ad206eca84_rle_crop_4053390685_0.png treat image : temp/1764574230_1734596_1397168462_449c2b89eb93d341d253b6ad206eca84_rle_crop_4053390686_0.png treat image : temp/1764574230_1734596_1397168433_6e0a9391df655d6a9c737e2161e251fd_rle_crop_4053390691_0.png treat image : temp/1764574230_1734596_1397168431_fd315b33fc3124690c583c21e7b146de_rle_crop_4053390693_0.png treat image : temp/1764574230_1734596_1397168431_fd315b33fc3124690c583c21e7b146de_rle_crop_4053390695_0.png treat image : temp/1764574230_1734596_1397168426_1529eb71e992ce272eeef12fba0a628f_rle_crop_4053390699_0.png treat image : temp/1764574230_1734596_1397168422_f9ea4b501738b33b23ffac675c220f89_rle_crop_4053390701_0.png treat image : temp/1764574230_1734596_1397168536_276e56d413b7dde43d85a75112b7b5e5_rle_crop_4053390667_0.png treat image : temp/1764574230_1734596_1397168431_fd315b33fc3124690c583c21e7b146de_rle_crop_4053390692_0.png treat image : temp/1764574230_1734596_1397168431_fd315b33fc3124690c583c21e7b146de_rle_crop_4053390694_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 80 time used for this insertion : 0.01902937889099121 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 80 time used for this insertion : 0.017846107482910156 save missing photos in datou_result : time spend for datou_step_exec : 6.804466485977173 time spend to save output : 0.04237961769104004 total time spend for step 7 : 6.846846103668213 step8:velours_tree Mon Dec 1 08:32:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.08313202857971191 time spend to save output : 3.743171691894531e-05 total time spend for step 8 : 0.08316946029663086 step9:send_mail_cod Mon Dec 1 08:32:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P29040936_01-12-2025_08_32_53.pdf 29041147 imagette290411471764574373 29041148 imagette290411481764574373 29041149 imagette290411491764574373 29041150 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette290411501764574373 29041151 imagette290411511764574374 29041152 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette290411521764574374 29041153 change filename to text .change filename to text .imagette290411531764574376 29041154 change filename to text .imagette290411541764574376 29041155 imagette290411551764574376 29041156 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette290411561764574376 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=29040936 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/29041146,29041147,29041148,29041149,29041150,29041151,29041152,29041153,29041154,29041155,29041156?tags=environnement,mal_croppe,metal,background,carton,pehd,pet_clair,autre,pet_fonce,flou,papier your option no_mail is active, we will not send the real mail to your client args[1397169230] : ((1397169230, 1.0068712486134248, 492688767), (1397169230, 0.6321777385435962, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168699] : ((1397168699, 1.5505497690497916, 492688767), (1397168699, 0.509694787199221, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168661] : ((1397168661, -0.9847810745794903, 492688767), (1397168661, 0.7029716941118621, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168615] : ((1397168615, 0.4046531203714679, 492688767), (1397168615, 0.42148183026515446, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168582] : ((1397168582, -0.26406737461651464, 492688767), (1397168582, 0.38368571648046673, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168580] : ((1397168580, -0.5815821451627209, 492688767), (1397168580, 0.5558437239807488, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168536] : ((1397168536, -1.129638023180873, 492688767), (1397168536, 0.4431969030716702, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168531] : ((1397168531, -1.8066287021058867, 492688767), (1397168531, 0.6601688026291622, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168528] : ((1397168528, -3.893174624779829, 492609224), (1397168528, 0.4738753770099995, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168504] : ((1397168504, 1.519559300945814, 492688767), (1397168504, 0.18359939470785944, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168500] : ((1397168500, -3.9594485299288324, 492609224), (1397168500, 0.36938505886271966, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168496] : ((1397168496, 2.033597922861731, 492688767), (1397168496, 0.8146785558884948, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168494] : ((1397168494, -0.0812256223699507, 492688767), (1397168494, 0.6648335454173449, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168490] : ((1397168490, -4.370664834599597, 492609224), (1397168490, 0.6105789264301742, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168473] : ((1397168473, -0.6021489313058126, 492688767), (1397168473, 0.637799838169456, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168469] : ((1397168469, -0.6369726998041297, 492688767), (1397168469, 0.6532785989237188, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168466] : ((1397168466, -1.0383870061315839, 492688767), (1397168466, 0.6208299945851454, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168462] : ((1397168462, -4.214464107679119, 492609224), (1397168462, 0.3803593658252731, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168456] : ((1397168456, -3.1962139600035613, 492609224), (1397168456, 0.3968039887980144, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168436] : ((1397168436, -0.1462069162299921, 492688767), (1397168436, 0.6952402797520731, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168433] : ((1397168433, -0.8895528463926955, 492688767), (1397168433, 0.26493470159040555, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168431] : ((1397168431, -0.06000700156496797, 492688767), (1397168431, 0.6573314623769859, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168426] : ((1397168426, 0.44355857306278496, 492688767), (1397168426, 0.5315713317430367, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168422] : ((1397168422, 0.5645285081465421, 492688767), (1397168422, 0.7926182763401517, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com args[1397168419] : ((1397168419, -0.21964061063245546, 492688767), (1397168419, 0.7278557273101993, 2107752395), '0.15725399305555557') We are sending mail with results at report@fotonower.com refus_total : 0.15725399305555557 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=29040936 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29040936_01-12-2025_08_32_53.pdf results_Auto_P29040936_01-12-2025_08_32_53.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29040936_01-12-2025_08_32_53.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','29040936','results_Auto_P29040936_01-12-2025_08_32_53.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29040936_01-12-2025_08_32_53.pdf','pdf','','0.83','0.15725399305555557') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1397169230, 1397168699, 1397168661, 1397168615, 1397168582, 1397168580, 1397168536, 1397168531, 1397168528, 1397168504, 1397168500, 1397168496, 1397168494, 1397168490, 1397168473, 1397168469, 1397168466, 1397168462, 1397168456, 1397168436, 1397168433, 1397168431, 1397168426, 1397168422, 1397168419] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397169230', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168699', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168661', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168615', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168582', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168580', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168536', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168531', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168528', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168504', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168500', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168496', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168494', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168490', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168473', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168469', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168466', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168462', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168456', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168436', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168433', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168431', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168426', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168422', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168419', None, None, None, None, None, '4143618') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 25 time used for this insertion : 0.017901897430419922 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.397788047790527 time spend to save output : 0.0181732177734375 total time spend for step 9 : 6.415961265563965 step10:split_time_score Mon Dec 1 08:32:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('07', 25),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 01122025 29040936 Nombre de photos uploadées : 25 / 23040 (0%) 01122025 29040936 Nombre de photos taguées (types de déchets): 0 / 25 (0%) 01122025 29040936 Nombre de photos taguées (volume) : 0 / 25 (0%) elapsed_time : load_data_split_time_score 1.1920928955078125e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.001065969467163086 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.24500036239624023 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.15725399305555557 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29040936_01-12-2025_08_32_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29040936 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29040936 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'01122025': {'nb_upload': 25, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1397169230, 1397168699, 1397168661, 1397168615, 1397168582, 1397168580, 1397168536, 1397168531, 1397168528, 1397168504, 1397168500, 1397168496, 1397168494, 1397168490, 1397168473, 1397168469, 1397168466, 1397168462, 1397168456, 1397168436, 1397168433, 1397168431, 1397168426, 1397168422, 1397168419] Looping around the photos to save general results len do output : 1 /29040936Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397169230', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168699', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168661', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168615', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168582', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168580', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168536', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168531', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168528', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168504', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168500', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168496', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168494', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168490', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168473', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168469', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168466', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168462', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168456', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168436', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168433', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168431', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168426', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168422', None, None, None, None, None, '4143618') ('3318', None, None, None, None, None, None, None, '4143618') ('3318', '29040936', '1397168419', None, None, None, None, None, '4143618') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 26 time used for this insertion : 0.018572568893432617 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.5750703811645508 time spend to save output : 0.01884293556213379 total time spend for step 10 : 0.5939133167266846 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 25 set_done_treatment 94.81user 32.20system 2:34.28elapsed 82%CPU (0avgtext+0avgdata 3170752maxresident)k 597856inputs+61712outputs (633major+2531733minor)pagefaults 0swaps