python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2597248 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4334258'] with mtr_portfolio_ids : ['30188766'] and first list_photo_ids : [] new path : /proc/2597248/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 7 ; length of list_pids : 7 ; length of list_args : 7 time to download the photos : 1.1969950199127197 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Jan 23 12:10:29 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3177 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2026-01-23 12:10:33.626845: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2026-01-23 12:10:33.658498: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2026-01-23 12:10:33.660875: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fc6a0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2026-01-23 12:10:33.660918: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2026-01-23 12:10:33.665868: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2026-01-23 12:10:33.919386: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x5b006c0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2026-01-23 12:10:33.919443: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2026-01-23 12:10:33.920908: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-23 12:10:33.923798: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-23 12:10:33.955537: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-23 12:10:33.974307: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-23 12:10:33.979228: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-23 12:10:34.010766: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-23 12:10:34.015876: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-23 12:10:34.071473: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-23 12:10:34.072650: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-23 12:10:34.073029: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-23 12:10:34.074384: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-23 12:10:34.074405: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-23 12:10:34.074416: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-23 12:10:34.075857: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2725 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2026-01-23 12:10:34.522806: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-23 12:10:34.522889: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-23 12:10:34.522911: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-23 12:10:34.522929: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-23 12:10:34.522947: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-23 12:10:34.522966: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-23 12:10:34.522983: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-23 12:10:34.523001: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-23 12:10:34.523996: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-23 12:10:34.525135: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-23 12:10:34.525163: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-23 12:10:34.525178: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-23 12:10:34.525193: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-23 12:10:34.525207: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-23 12:10:34.525221: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-23 12:10:34.525235: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-23 12:10:34.525249: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-23 12:10:34.526015: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-23 12:10:34.526046: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-23 12:10:34.526054: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-23 12:10:34.526061: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-23 12:10:34.526869: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2725 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2026-01-23 12:10:47.401654: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-23 12:10:47.707840: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-23 12:10:49.522754: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.522822: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-23 12:10:49.523391: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.523406: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-23 12:10:49.530401: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.530422: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-23 12:10:49.530966: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.530981: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-23 12:10:49.537421: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.537441: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-23 12:10:49.537986: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.538000: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-23 12:10:49.568496: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.568521: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-23 12:10:49.569074: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.569088: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-23 12:10:49.574834: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.574853: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-23 12:10:49.575394: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.575409: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2026-01-23 12:10:49.609106: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.609658: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.611491: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.612039: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.656032: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.656593: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.658809: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.659361: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.689692: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.690246: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.691913: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.692463: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.700542: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.701093: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.702941: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.703488: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.710017: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.710570: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.712233: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.712775: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.744222: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.744777: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.745320: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.745863: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.750376: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.750981: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.770912: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.771507: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.772056: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.772603: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.788505: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.789105: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.789675: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.790217: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.794610: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.795183: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.799684: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.800243: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.812141: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.812689: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.816766: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.817313: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.817856: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.818406: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.819096: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.819647: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.830080: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.830639: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.831201: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.831746: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.832292: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.832837: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.847630: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.848180: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.881146: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.881198: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2026-01-23 12:10:49.882198: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.883230: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.890551: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.891565: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.899314: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.899862: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.920531: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.921121: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.921679: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.922224: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.926186: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.926779: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.927372: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.927942: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.929524: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.939077: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.939672: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.948513: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.949065: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.949619: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.950164: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.950736: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2026-01-23 12:10:49.951285: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2322464768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 Detection mask done ! Trying to reset tf kernel 2597553 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1984 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3177 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [1086, 876, 1782, 1164] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0023527145385742188 nb_pixel_total : 75274 time to create 1 rle with old method : 0.08184814453125 length of segment : 580 DEBUG bbox = [228, 858, 378, 1032] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00027632713317871094 nb_pixel_total : 13710 time to create 1 rle with old method : 0.014963626861572266 length of segment : 142 DEBUG bbox = [1908, 1830, 2124, 2064] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00047779083251953125 nb_pixel_total : 31484 time to create 1 rle with old method : 0.033689260482788086 length of segment : 287 DEBUG bbox = [1896, 774, 2040, 936] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002455711364746094 nb_pixel_total : 15276 time to create 1 rle with old method : 0.016439437866210938 length of segment : 129 DEBUG bbox = [426, 2364, 642, 2526] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003352165222167969 nb_pixel_total : 19770 time to create 1 rle with old method : 0.021132946014404297 length of segment : 205 DEBUG bbox = [894, 1752, 1074, 1950] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003256797790527344 nb_pixel_total : 18639 time to create 1 rle with old method : 0.020869731903076172 length of segment : 145 DEBUG bbox = [1806, 486, 1968, 702] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000301361083984375 nb_pixel_total : 8253 time to create 1 rle with old method : 0.00980997085571289 length of segment : 133 DEBUG bbox = [510, 1632, 900, 1920] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012822151184082031 nb_pixel_total : 57367 time to create 1 rle with old method : 0.062204599380493164 length of segment : 410 DEBUG bbox = [1302, 1260, 1740, 1752] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0019207000732421875 nb_pixel_total : 93150 time to create 1 rle with old method : 0.10363125801086426 length of segment : 389 DEBUG bbox = [966, 3492, 1212, 3600] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004000663757324219 nb_pixel_total : 14623 time to create 1 rle with old method : 0.020744800567626953 length of segment : 232 DEBUG bbox = [2016, 1896, 2154, 2100] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003287792205810547 nb_pixel_total : 18858 time to create 1 rle with old method : 0.024364233016967773 length of segment : 136 DEBUG bbox = [1476, 1896, 1920, 2196] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012385845184326172 nb_pixel_total : 66906 time to create 1 rle with old method : 0.07886910438537598 length of segment : 368 DEBUG bbox = [1134, 1122, 1374, 1332] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005779266357421875 nb_pixel_total : 28503 time to create 1 rle with old method : 0.03381037712097168 length of segment : 217 DEBUG bbox = [642, 1272, 1032, 1734] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00162506103515625 nb_pixel_total : 75067 time to create 1 rle with old method : 0.09497904777526855 length of segment : 415 DEBUG bbox = [1356, 1698, 1698, 1962] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000997781753540039 nb_pixel_total : 38395 time to create 1 rle with old method : 0.04828286170959473 length of segment : 303 DEBUG bbox = [360, 756, 552, 1014] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005526542663574219 nb_pixel_total : 27813 time to create 1 rle with old method : 0.03745627403259277 length of segment : 189 DEBUG bbox = [408, 2472, 756, 2838] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016028881072998047 nb_pixel_total : 75172 time to create 1 rle with old method : 0.10488510131835938 length of segment : 355 DEBUG bbox = [570, 2160, 894, 2298] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005214214324951172 nb_pixel_total : 23521 time to create 1 rle with old method : 0.026587724685668945 length of segment : 304 DEBUG bbox = [1668, 2970, 2130, 3354] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017077922821044922 nb_pixel_total : 95288 time to create 1 rle with old method : 0.1251823902130127 length of segment : 445 DEBUG bbox = [246, 1530, 468, 1740] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006031990051269531 nb_pixel_total : 21212 time to create 1 rle with old method : 0.024524688720703125 length of segment : 208 DEBUG bbox = [1890, 780, 2052, 954] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00035071372985839844 nb_pixel_total : 15180 time to create 1 rle with old method : 0.017430543899536133 length of segment : 131 DEBUG bbox = [486, 1644, 876, 1908] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009937286376953125 nb_pixel_total : 49688 time to create 1 rle with old method : 0.05508565902709961 length of segment : 344 DEBUG bbox = [216, 858, 384, 1038] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003223419189453125 nb_pixel_total : 15132 time to create 1 rle with old method : 0.017126083374023438 length of segment : 149 DEBUG bbox = [1884, 1800, 2142, 2088] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007035732269287109 nb_pixel_total : 35626 time to create 1 rle with old method : 0.03970909118652344 length of segment : 249 DEBUG bbox = [888, 1740, 1140, 1962] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005311965942382812 nb_pixel_total : 19724 time to create 1 rle with old method : 0.0224301815032959 length of segment : 152 DEBUG bbox = [1104, 852, 1764, 1176] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017707347869873047 nb_pixel_total : 77487 time to create 1 rle with old method : 0.08420753479003906 length of segment : 603 DEBUG bbox = [1182, 1746, 1686, 1986] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010578632354736328 nb_pixel_total : 54697 time to create 1 rle with old method : 0.05838894844055176 length of segment : 616 DEBUG bbox = [1842, 936, 1974, 1062] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002148151397705078 nb_pixel_total : 9994 time to create 1 rle with old method : 0.011451959609985352 length of segment : 127 DEBUG bbox = [966, 3492, 1212, 3606] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00034046173095703125 nb_pixel_total : 16716 time to create 1 rle with old method : 0.018707275390625 length of segment : 240 DEBUG bbox = [1224, 1026, 1956, 1704] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.005688905715942383 nb_pixel_total : 233054 time to create 1 rle with new method : 0.01636528968811035 length of segment : 633 DEBUG bbox = [330, 744, 552, 984] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005412101745605469 nb_pixel_total : 29416 time to create 1 rle with old method : 0.031922101974487305 length of segment : 202 DEBUG bbox = [1830, 672, 1920, 864] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002148151397705078 nb_pixel_total : 9709 time to create 1 rle with old method : 0.011516094207763672 length of segment : 85 DEBUG bbox = [1884, 2802, 2076, 3018] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004100799560546875 nb_pixel_total : 21375 time to create 1 rle with old method : 0.023894309997558594 length of segment : 196 DEBUG bbox = [594, 2172, 894, 2292] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004024505615234375 nb_pixel_total : 22925 time to create 1 rle with old method : 0.024722814559936523 length of segment : 298 DEBUG bbox = [540, 1914, 810, 2142] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005500316619873047 nb_pixel_total : 40104 time to create 1 rle with old method : 0.042294979095458984 length of segment : 301 DEBUG bbox = [42, 120, 672, 570] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002134084701538086 nb_pixel_total : 123428 time to create 1 rle with old method : 0.13468146324157715 length of segment : 963 DEBUG bbox = [1800, 492, 1962, 696] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00038814544677734375 nb_pixel_total : 7836 time to create 1 rle with old method : 0.008597373962402344 length of segment : 123 DEBUG bbox = [810, 3174, 1506, 3546] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001971006393432617 nb_pixel_total : 102563 time to create 1 rle with old method : 0.10635519027709961 length of segment : 628 DEBUG bbox = [936, 1122, 1242, 1782] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015819072723388672 nb_pixel_total : 99179 time to create 1 rle with old method : 0.10296225547790527 length of segment : 298 DEBUG bbox = [1842, 1248, 1998, 1440] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005769729614257812 nb_pixel_total : 14266 time to create 1 rle with old method : 0.015598535537719727 length of segment : 139 DEBUG bbox = [1998, 1506, 2160, 1794] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007355213165283203 nb_pixel_total : 27556 time to create 1 rle with old method : 0.02931976318359375 length of segment : 150 DEBUG bbox = [1644, 1716, 2148, 2106] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0025637149810791016 nb_pixel_total : 72015 time to create 1 rle with old method : 0.08502411842346191 length of segment : 595 DEBUG bbox = [1152, 792, 1560, 1560] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0040814876556396484 nb_pixel_total : 125232 time to create 1 rle with old method : 0.13714861869812012 length of segment : 338 DEBUG bbox = [1914, 612, 2160, 1026] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015435218811035156 nb_pixel_total : 51692 time to create 1 rle with old method : 0.05499982833862305 length of segment : 263 DEBUG bbox = [6, 3708, 162, 3840] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004918575286865234 nb_pixel_total : 15405 time to create 1 rle with old method : 0.016191482543945312 length of segment : 148 DEBUG bbox = [1698, 744, 2010, 1074] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.007970333099365234 nb_pixel_total : 70370 time to create 1 rle with old method : 0.07190370559692383 length of segment : 300 DEBUG bbox = [252, 2688, 582, 2976] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016372203826904297 nb_pixel_total : 51337 time to create 1 rle with old method : 0.05242514610290527 length of segment : 397 DEBUG bbox = [1356, 486, 1740, 1146] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0037882328033447266 nb_pixel_total : 182902 time to create 1 rle with new method : 0.008062362670898438 length of segment : 430 DEBUG bbox = [1014, 468, 1386, 1014] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0031354427337646484 nb_pixel_total : 123173 time to create 1 rle with old method : 0.1322035789489746 length of segment : 355 DEBUG bbox = [588, 402, 978, 1188] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004019021987915039 nb_pixel_total : 147091 time to create 1 rle with old method : 0.1590118408203125 length of segment : 379 DEBUG bbox = [198, 2406, 342, 2646] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005028247833251953 nb_pixel_total : 14450 time to create 1 rle with old method : 0.016811847686767578 length of segment : 137 DEBUG bbox = [90, 1902, 330, 2124] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009188652038574219 nb_pixel_total : 28115 time to create 1 rle with old method : 0.02986741065979004 length of segment : 212 DEBUG bbox = [588, 1398, 864, 1698] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013473033905029297 nb_pixel_total : 52621 time to create 1 rle with old method : 0.057115793228149414 length of segment : 258 DEBUG bbox = [1722, 2778, 1902, 2952] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005710124969482422 nb_pixel_total : 18892 time to create 1 rle with old method : 0.020044803619384766 length of segment : 167 DEBUG bbox = [432, 354, 612, 498] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00046896934509277344 nb_pixel_total : 10361 time to create 1 rle with old method : 0.01152658462524414 length of segment : 143 DEBUG bbox = [1218, 2370, 1458, 2670] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010600090026855469 nb_pixel_total : 39325 time to create 1 rle with old method : 0.04218721389770508 length of segment : 238 DEBUG bbox = [1002, 3282, 1116, 3354] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00025534629821777344 nb_pixel_total : 5173 time to create 1 rle with old method : 0.0057947635650634766 length of segment : 111 DEBUG bbox = [1224, 1746, 1392, 2112] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006930828094482422 nb_pixel_total : 25702 time to create 1 rle with old method : 0.028276920318603516 length of segment : 159 DEBUG bbox = [786, 1806, 1254, 2562] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004553556442260742 nb_pixel_total : 207172 time to create 1 rle with new method : 0.009800434112548828 length of segment : 449 DEBUG bbox = [366, 2514, 726, 2724] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010559558868408203 nb_pixel_total : 39553 time to create 1 rle with old method : 0.041387319564819336 length of segment : 342 DEBUG bbox = [1554, 486, 1746, 720] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006575584411621094 nb_pixel_total : 25879 time to create 1 rle with old method : 0.02798151969909668 length of segment : 178 DEBUG bbox = [990, 2430, 1266, 2604] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00039076805114746094 nb_pixel_total : 24088 time to create 1 rle with old method : 0.02570819854736328 length of segment : 266 DEBUG bbox = [78, 96, 696, 504] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0025484561920166016 nb_pixel_total : 64735 time to create 1 rle with old method : 0.06843066215515137 length of segment : 665 DEBUG bbox = [204, 240, 480, 552] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012047290802001953 nb_pixel_total : 36726 time to create 1 rle with old method : 0.04104900360107422 length of segment : 240 DEBUG bbox = [1290, 1716, 1554, 2058] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001241445541381836 nb_pixel_total : 60279 time to create 1 rle with old method : 0.06652021408081055 length of segment : 245 DEBUG bbox = [1980, 1314, 2148, 1596] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006766319274902344 nb_pixel_total : 32053 time to create 1 rle with old method : 0.03495335578918457 length of segment : 160 DEBUG bbox = [1992, 2028, 2154, 2478] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009427070617675781 nb_pixel_total : 43482 time to create 1 rle with old method : 0.04703497886657715 length of segment : 163 DEBUG bbox = [1536, 2436, 1968, 2820] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017821788787841797 nb_pixel_total : 48744 time to create 1 rle with old method : 0.054433584213256836 length of segment : 531 DEBUG bbox = [54, 1944, 360, 2100] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008392333984375 nb_pixel_total : 33689 time to create 1 rle with old method : 0.03561854362487793 length of segment : 308 DEBUG bbox = [1638, 1302, 1794, 1452] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00039196014404296875 nb_pixel_total : 11074 time to create 1 rle with old method : 0.011879682540893555 length of segment : 131 DEBUG bbox = [1380, 2484, 2124, 3360] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.005190134048461914 nb_pixel_total : 222082 time to create 1 rle with new method : 0.02893519401550293 length of segment : 798 DEBUG bbox = [1356, 1644, 1710, 2058] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002360820770263672 nb_pixel_total : 58644 time to create 1 rle with old method : 0.06179380416870117 length of segment : 317 DEBUG bbox = [1938, 2298, 2160, 2850] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018105506896972656 nb_pixel_total : 72636 time to create 1 rle with old method : 0.07837986946105957 length of segment : 212 DEBUG bbox = [1164, 2010, 1602, 2412] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002488851547241211 nb_pixel_total : 85985 time to create 1 rle with old method : 0.10064554214477539 length of segment : 488 DEBUG bbox = [1872, 1158, 2076, 1452] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011134147644042969 nb_pixel_total : 28911 time to create 1 rle with old method : 0.03204083442687988 length of segment : 176 DEBUG bbox = [1464, 1842, 1926, 2352] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0035185813903808594 nb_pixel_total : 170532 time to create 1 rle with new method : 0.00815272331237793 length of segment : 433 DEBUG bbox = [114, 282, 384, 486] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001146554946899414 nb_pixel_total : 19802 time to create 1 rle with old method : 0.027508020401000977 length of segment : 218 DEBUG bbox = [1818, 1254, 2154, 1836] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0023641586303710938 nb_pixel_total : 83906 time to create 1 rle with old method : 0.08773136138916016 length of segment : 338 DEBUG bbox = [1806, 2982, 2154, 3444] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0024247169494628906 nb_pixel_total : 88683 time to create 1 rle with old method : 0.09655880928039551 length of segment : 336 DEBUG bbox = [1878, 906, 2088, 1074] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006160736083984375 nb_pixel_total : 23829 time to create 1 rle with old method : 0.02663135528564453 length of segment : 199 DEBUG bbox = [1392, 948, 1668, 1350] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018129348754882812 nb_pixel_total : 66836 time to create 1 rle with old method : 0.07357192039489746 length of segment : 263 DEBUG bbox = [1194, 2010, 1362, 2232] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00036454200744628906 nb_pixel_total : 22846 time to create 1 rle with old method : 0.02445697784423828 length of segment : 146 DEBUG bbox = [834, 1728, 1290, 2172] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0027337074279785156 nb_pixel_total : 88120 time to create 1 rle with old method : 0.09704780578613281 length of segment : 458 DEBUG bbox = [828, 3132, 1128, 3330] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010521411895751953 nb_pixel_total : 32922 time to create 1 rle with old method : 0.03567862510681152 length of segment : 271 DEBUG bbox = [1194, 1836, 1392, 2076] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004317760467529297 nb_pixel_total : 24828 time to create 1 rle with old method : 0.027390241622924805 length of segment : 192 time spent for convertir_results : 8.048637390136719 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 85 chid ids of type : 3594 Number RLEs to save : 25372 save missing photos in datou_result : time spend for datou_step_exec : 61.68210172653198 time spend to save output : 1.677858591079712 total time spend for step 1 : 63.359960317611694 step2:crop_condition Fri Jan 23 12:11:33 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 7 ! batch 1 Loaded 85 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 68 About to insert : list_path_to_insert length 68 new photo from crops ! About to upload 68 photos upload in portfolio : 3736932 init cache_photo without model_param we have 68 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1769166711_2597248 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791510_0.png', 0, 263, 580, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791511_0.png', 0, 171, 142, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791512_0.png', 0, 226, 207, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791513_0.png', 0, 157, 129, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791514_0.png', 0, 156, 205, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791516_0.png', 0, 164, 133, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791517_0.png', 0, 270, 344, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791518_0.png', 0, 435, 389, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791520_0.png', 0, 197, 131, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791521_0.png', 0, 275, 347, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791522_0.png', 0, 177, 212, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791523_0.png', 0, 353, 333, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791524_0.png', 0, 221, 299, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791527_0.png', 0, 127, 304, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791529_0.png', 0, 182, 196, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791530_0.png', 0, 159, 130, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791531_0.png', 0, 242, 344, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791532_0.png', 0, 178, 149, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791533_0.png', 0, 249, 201, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791535_0.png', 0, 281, 603, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791536_0.png', 0, 236, 498, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791537_0.png', 0, 115, 121, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791539_0.png', 0, 642, 626, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791541_0.png', 0, 179, 80, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791542_0.png', 0, 191, 162, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791543_0.png', 0, 119, 298, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791544_0.png', 0, 219, 245, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791545_0.png', 0, 441, 596, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791546_0.png', 0, 161, 123, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791547_0.png', 0, 299, 626, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791548_0.png', 0, 606, 278, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791549_0.png', 0, 184, 135, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791550_0.png', 0, 285, 149, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791551_0.png', 0, 346, 466, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791552_0.png', 0, 647, 330, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791553_0.png', 0, 376, 212, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791554_0.png', 0, 121, 145, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791555_0.png', 0, 314, 291, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791556_0.png', 0, 282, 266, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791557_0.png', 0, 634, 380, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791558_0.png', 0, 497, 332, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791559_0.png', 0, 758, 333, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791560_0.png', 0, 204, 137, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791561_0.png', 0, 209, 209, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791562_0.png', 0, 299, 249, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791565_0.png', 0, 282, 238, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791566_0.png', 0, 62, 111, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179227_2d117d7000a31008ee9b33ffc0bbbd3c_rle_crop_4109791567_0.png', 0, 287, 154, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179227_2d117d7000a31008ee9b33ffc0bbbd3c_rle_crop_4109791568_0.png', 0, 695, 430, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179227_2d117d7000a31008ee9b33ffc0bbbd3c_rle_crop_4109791569_0.png', 0, 204, 342, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179227_2d117d7000a31008ee9b33ffc0bbbd3c_rle_crop_4109791570_0.png', 0, 214, 175, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179227_2d117d7000a31008ee9b33ffc0bbbd3c_rle_crop_4109791571_0.png', 0, 150, 266, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179227_2d117d7000a31008ee9b33ffc0bbbd3c_rle_crop_4109791572_0.png', 0, 311, 586, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791573_0.png', 0, 302, 233, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791575_0.png', 0, 275, 157, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791576_0.png', 0, 401, 158, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791577_0.png', 0, 357, 395, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791578_0.png', 0, 143, 304, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791580_0.png', 0, 751, 625, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791581_0.png', 0, 379, 316, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791583_0.png', 0, 380, 351, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791585_0.png', 0, 504, 418, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791586_0.png', 0, 176, 218, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791589_0.png', 0, 154, 199, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791591_0.png', 0, 212, 144, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791592_0.png', 0, 365, 415, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791593_0.png', 0, 182, 271, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166728), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791594_0.png', 0, 220, 159, 0, 1769166728,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 68 photos in the portfolio 3736932 time of upload the photos Elapsed time : 20.211849689483643 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1769166735_2597248 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166736), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791515_0.png', 0, 172, 145, 0, 1769166736,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166736), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791519_0.png', 0, 93, 232, 0, 1769166736,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166736), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791525_0.png', 0, 227, 189, 0, 1769166736,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166736), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791534_0.png', 0, 173, 152, 0, 1769166736,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166736), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791538_0.png', 0, 94, 240, 0, 1769166736,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166736), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791540_0.png', 0, 228, 198, 0, 1769166736,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166736), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791564_0.png', 0, 117, 142, 0, 1769166736,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166736), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791574_0.png', 0, 317, 245, 0, 1769166736,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166736), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791579_0.png', 0, 110, 131, 0, 1769166736,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.4333784580230713 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1769166740_2597248 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166742), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791526_0.png', 0, 360, 329, 0, 1769166742,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166742), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791528_0.png', 0, 366, 414, 0, 1769166742,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166742), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791582_0.png', 0, 513, 207, 0, 1769166742,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166742), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791584_0.png', 0, 261, 157, 0, 1769166742,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166742), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791587_0.png', 0, 445, 327, 0, 1769166742,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166742), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791588_0.png', 0, 446, 297, 0, 1769166742,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166742), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791590_0.png', 0, 394, 257, 0, 1769166742,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.3488008975982666 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1769166744_2597248 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1769166745), 0.0, 0.0, 14, '', 0, 0, '1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791563_0.png', 0, 157, 157, 0, 1769166745,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9087145328521729 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1405179231, 1405179230, 1405179229, 1405179228, 1405179227, 1405179155, 1405179154] Looping around the photos to save general results len do output : 85 /1405183204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1405183289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179231', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179230', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179229', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179228', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179227', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179155', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179154', None, None, None, None, None, '4334258') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 262 time used for this insertion : 0.048296451568603516 save_final save missing photos in datou_result : time spend for datou_step_exec : 51.91449308395386 time spend to save output : 0.0508427619934082 total time spend for step 2 : 51.965335845947266 step3:rle_unique_nms_with_priority Fri Jan 23 12:12:25 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 85 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 20 nb_hashtags : 3 time to prepare the origin masks : 9.800468921661377 time for calcul the mask position with numpy : 0.7591433525085449 nb_pixel_total : 7484945 time to create 1 rle with new method : 0.8205065727233887 time for calcul the mask position with numpy : 0.02413463592529297 nb_pixel_total : 21212 time to create 1 rle with old method : 0.02262091636657715 time for calcul the mask position with numpy : 0.024208784103393555 nb_pixel_total : 95288 time to create 1 rle with old method : 0.10419583320617676 time for calcul the mask position with numpy : 0.023999691009521484 nb_pixel_total : 23521 time to create 1 rle with old method : 0.02560281753540039 time for calcul the mask position with numpy : 0.024457693099975586 nb_pixel_total : 75172 time to create 1 rle with old method : 0.07905960083007812 time for calcul the mask position with numpy : 0.023154258728027344 nb_pixel_total : 27813 time to create 1 rle with old method : 0.029221534729003906 time for calcul the mask position with numpy : 0.023476600646972656 nb_pixel_total : 38395 time to create 1 rle with old method : 0.04003405570983887 time for calcul the mask position with numpy : 0.024022340774536133 nb_pixel_total : 75067 time to create 1 rle with old method : 0.0780794620513916 time for calcul the mask position with numpy : 0.02320551872253418 nb_pixel_total : 28503 time to create 1 rle with old method : 0.029677391052246094 time for calcul the mask position with numpy : 0.028963088989257812 nb_pixel_total : 66906 time to create 1 rle with old method : 0.0867164134979248 time for calcul the mask position with numpy : 0.02321314811706543 nb_pixel_total : 10032 time to create 1 rle with old method : 0.010858297348022461 time for calcul the mask position with numpy : 0.023378372192382812 nb_pixel_total : 14623 time to create 1 rle with old method : 0.01477360725402832 time for calcul the mask position with numpy : 0.02488565444946289 nb_pixel_total : 93150 time to create 1 rle with old method : 0.09761691093444824 time for calcul the mask position with numpy : 0.024456501007080078 nb_pixel_total : 57367 time to create 1 rle with old method : 0.05850076675415039 time for calcul the mask position with numpy : 0.02289724349975586 nb_pixel_total : 8253 time to create 1 rle with old method : 0.008543729782104492 time for calcul the mask position with numpy : 0.023476362228393555 nb_pixel_total : 18639 time to create 1 rle with old method : 0.020067691802978516 time for calcul the mask position with numpy : 0.023341894149780273 nb_pixel_total : 19770 time to create 1 rle with old method : 0.020812034606933594 time for calcul the mask position with numpy : 0.024183034896850586 nb_pixel_total : 15276 time to create 1 rle with old method : 0.01602768898010254 time for calcul the mask position with numpy : 0.023480892181396484 nb_pixel_total : 31484 time to create 1 rle with old method : 0.03264188766479492 time for calcul the mask position with numpy : 0.023922204971313477 nb_pixel_total : 13710 time to create 1 rle with old method : 0.014212846755981445 time for calcul the mask position with numpy : 0.02321457862854004 nb_pixel_total : 75274 time to create 1 rle with old method : 0.08004164695739746 create new chi : 2.963956594467163 time to delete rle : 0.03286576271057129 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 13213 TO DO : save crop sub photo not yet done ! save time : 0.7953348159790039 nb_obj : 17 nb_hashtags : 2 time to prepare the origin masks : 7.113240480422974 time for calcul the mask position with numpy : 1.0628764629364014 nb_pixel_total : 7512309 time to create 1 rle with new method : 1.1981258392333984 time for calcul the mask position with numpy : 0.023641347885131836 nb_pixel_total : 7836 time to create 1 rle with old method : 0.00847315788269043 time for calcul the mask position with numpy : 0.025276899337768555 nb_pixel_total : 123428 time to create 1 rle with old method : 0.13452720642089844 time for calcul the mask position with numpy : 0.024881362915039062 nb_pixel_total : 40104 time to create 1 rle with old method : 0.043183326721191406 time for calcul the mask position with numpy : 0.02628040313720703 nb_pixel_total : 22925 time to create 1 rle with old method : 0.025669336318969727 time for calcul the mask position with numpy : 0.026112794876098633 nb_pixel_total : 21375 time to create 1 rle with old method : 0.02404308319091797 time for calcul the mask position with numpy : 0.025813817977905273 nb_pixel_total : 9709 time to create 1 rle with old method : 0.010994672775268555 time for calcul the mask position with numpy : 0.02855396270751953 nb_pixel_total : 29416 time to create 1 rle with old method : 0.03255271911621094 time for calcul the mask position with numpy : 0.02545952796936035 nb_pixel_total : 233054 time to create 1 rle with new method : 1.0469460487365723 time for calcul the mask position with numpy : 0.024976015090942383 nb_pixel_total : 16716 time to create 1 rle with old method : 0.017624616622924805 time for calcul the mask position with numpy : 0.024489164352416992 nb_pixel_total : 9994 time to create 1 rle with old method : 0.010922670364379883 time for calcul the mask position with numpy : 0.024251222610473633 nb_pixel_total : 54697 time to create 1 rle with old method : 0.05863761901855469 time for calcul the mask position with numpy : 0.025200605392456055 nb_pixel_total : 77487 time to create 1 rle with old method : 0.08211398124694824 time for calcul the mask position with numpy : 0.0232391357421875 nb_pixel_total : 19724 time to create 1 rle with old method : 0.02113199234008789 time for calcul the mask position with numpy : 0.024570941925048828 nb_pixel_total : 35626 time to create 1 rle with old method : 0.037416934967041016 time for calcul the mask position with numpy : 0.02363872528076172 nb_pixel_total : 15132 time to create 1 rle with old method : 0.015436649322509766 time for calcul the mask position with numpy : 0.022835493087768555 nb_pixel_total : 49688 time to create 1 rle with old method : 0.05023622512817383 time for calcul the mask position with numpy : 0.023827314376831055 nb_pixel_total : 15180 time to create 1 rle with old method : 0.01594829559326172 create new chi : 4.383119106292725 time to delete rle : 0.0013713836669921875 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 12984 TO DO : save crop sub photo not yet done ! save time : 0.7863857746124268 nb_obj : 8 nb_hashtags : 1 time to prepare the origin masks : 3.423842191696167 time for calcul the mask position with numpy : 0.5428059101104736 nb_pixel_total : 7786492 time to create 1 rle with new method : 0.9538800716400146 time for calcul the mask position with numpy : 0.02265334129333496 nb_pixel_total : 15405 time to create 1 rle with old method : 0.016112804412841797 time for calcul the mask position with numpy : 0.024134397506713867 nb_pixel_total : 51692 time to create 1 rle with old method : 0.053282976150512695 time for calcul the mask position with numpy : 0.02425527572631836 nb_pixel_total : 125232 time to create 1 rle with old method : 0.12968969345092773 time for calcul the mask position with numpy : 0.023799657821655273 nb_pixel_total : 72015 time to create 1 rle with old method : 0.07364892959594727 time for calcul the mask position with numpy : 0.02326512336730957 nb_pixel_total : 27556 time to create 1 rle with old method : 0.028453350067138672 time for calcul the mask position with numpy : 0.023306846618652344 nb_pixel_total : 14266 time to create 1 rle with old method : 0.014806747436523438 time for calcul the mask position with numpy : 0.024321794509887695 nb_pixel_total : 99179 time to create 1 rle with old method : 0.10243892669677734 time for calcul the mask position with numpy : 0.02346491813659668 nb_pixel_total : 102563 time to create 1 rle with old method : 0.10521602630615234 create new chi : 2.247889518737793 time to delete rle : 0.0008730888366699219 batch 1 Loaded 17 chid ids of type : 3594 +++++++++++++Number RLEs to save : 7233 TO DO : save crop sub photo not yet done ! save time : 0.47321653366088867 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 5.080812454223633 time for calcul the mask position with numpy : 0.6167135238647461 nb_pixel_total : 7550590 time to create 1 rle with new method : 0.9377894401550293 time for calcul the mask position with numpy : 0.03710198402404785 nb_pixel_total : 5173 time to create 1 rle with old method : 0.005354881286621094 time for calcul the mask position with numpy : 0.03075098991394043 nb_pixel_total : 39325 time to create 1 rle with old method : 0.04105544090270996 time for calcul the mask position with numpy : 0.023094892501831055 nb_pixel_total : 10361 time to create 1 rle with old method : 0.01119685173034668 time for calcul the mask position with numpy : 0.024995803833007812 nb_pixel_total : 18892 time to create 1 rle with old method : 0.02144169807434082 time for calcul the mask position with numpy : 0.02569413185119629 nb_pixel_total : 52621 time to create 1 rle with old method : 0.0556788444519043 time for calcul the mask position with numpy : 0.023731470108032227 nb_pixel_total : 28115 time to create 1 rle with old method : 0.028821945190429688 time for calcul the mask position with numpy : 0.02268695831298828 nb_pixel_total : 14450 time to create 1 rle with old method : 0.015272378921508789 time for calcul the mask position with numpy : 0.023272991180419922 nb_pixel_total : 147091 time to create 1 rle with old method : 0.151810884475708 time for calcul the mask position with numpy : 0.024771928787231445 nb_pixel_total : 123173 time to create 1 rle with old method : 0.12650489807128906 time for calcul the mask position with numpy : 0.023961544036865234 nb_pixel_total : 182902 time to create 1 rle with new method : 0.9815609455108643 time for calcul the mask position with numpy : 0.024230480194091797 nb_pixel_total : 51337 time to create 1 rle with old method : 0.054467201232910156 time for calcul the mask position with numpy : 0.02414870262145996 nb_pixel_total : 70370 time to create 1 rle with old method : 0.07077956199645996 create new chi : 3.486783742904663 time to delete rle : 0.0010986328125 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 8414 TO DO : save crop sub photo not yet done ! save time : 0.5357089042663574 nb_obj : 6 nb_hashtags : 1 time to prepare the origin masks : 2.443495035171509 time for calcul the mask position with numpy : 0.5197856426239014 nb_pixel_total : 7907271 time to create 1 rle with new method : 0.8789370059967041 time for calcul the mask position with numpy : 0.022269248962402344 nb_pixel_total : 64735 time to create 1 rle with old method : 0.0651092529296875 time for calcul the mask position with numpy : 0.023440837860107422 nb_pixel_total : 24088 time to create 1 rle with old method : 0.026343107223510742 time for calcul the mask position with numpy : 0.02319931983947754 nb_pixel_total : 25879 time to create 1 rle with old method : 0.026691436767578125 time for calcul the mask position with numpy : 0.022932767868041992 nb_pixel_total : 39553 time to create 1 rle with old method : 0.041385650634765625 time for calcul the mask position with numpy : 0.02410101890563965 nb_pixel_total : 207172 time to create 1 rle with new method : 0.9141952991485596 time for calcul the mask position with numpy : 0.023406028747558594 nb_pixel_total : 25702 time to create 1 rle with old method : 0.02721261978149414 create new chi : 2.6986305713653564 time to delete rle : 0.0007607936859130859 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 6278 TO DO : save crop sub photo not yet done ! save time : 0.41417717933654785 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 3.4263687133789062 time for calcul the mask position with numpy : 0.6673922538757324 nb_pixel_total : 7808267 time to create 1 rle with new method : 0.8459491729736328 time for calcul the mask position with numpy : 0.02328944206237793 nb_pixel_total : 220086 time to create 1 rle with new method : 0.8441088199615479 time for calcul the mask position with numpy : 0.0231475830078125 nb_pixel_total : 11074 time to create 1 rle with old method : 0.012135982513427734 time for calcul the mask position with numpy : 0.024158716201782227 nb_pixel_total : 33689 time to create 1 rle with old method : 0.03505754470825195 time for calcul the mask position with numpy : 0.022662639617919922 nb_pixel_total : 48744 time to create 1 rle with old method : 0.05060386657714844 time for calcul the mask position with numpy : 0.02416253089904785 nb_pixel_total : 43482 time to create 1 rle with old method : 0.046965599060058594 time for calcul the mask position with numpy : 0.023370027542114258 nb_pixel_total : 32053 time to create 1 rle with old method : 0.03302884101867676 time for calcul the mask position with numpy : 0.02312183380126953 nb_pixel_total : 60279 time to create 1 rle with old method : 0.06060171127319336 time for calcul the mask position with numpy : 0.024362802505493164 nb_pixel_total : 36726 time to create 1 rle with old method : 0.038469552993774414 create new chi : 2.881136417388916 time to delete rle : 0.0009696483612060547 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++Number RLEs to save : 7278 TO DO : save crop sub photo not yet done ! save time : 0.4663231372833252 nb_obj : 14 nb_hashtags : 2 time to prepare the origin masks : 5.924083232879639 time for calcul the mask position with numpy : 0.499495267868042 nb_pixel_total : 7433192 time to create 1 rle with new method : 1.010554552078247 time for calcul the mask position with numpy : 0.022435665130615234 nb_pixel_total : 24828 time to create 1 rle with old method : 0.025833606719970703 time for calcul the mask position with numpy : 0.02335071563720703 nb_pixel_total : 32922 time to create 1 rle with old method : 0.03433346748352051 time for calcul the mask position with numpy : 0.023131847381591797 nb_pixel_total : 88120 time to create 1 rle with old method : 0.09303760528564453 time for calcul the mask position with numpy : 0.024623870849609375 nb_pixel_total : 16925 time to create 1 rle with old method : 0.018076658248901367 time for calcul the mask position with numpy : 0.024396419525146484 nb_pixel_total : 66836 time to create 1 rle with old method : 0.0724332332611084 time for calcul the mask position with numpy : 0.0240175724029541 nb_pixel_total : 23829 time to create 1 rle with old method : 0.024633169174194336 time for calcul the mask position with numpy : 0.02371072769165039 nb_pixel_total : 88683 time to create 1 rle with old method : 0.09459233283996582 time for calcul the mask position with numpy : 0.025158166885375977 nb_pixel_total : 82562 time to create 1 rle with old method : 0.08547711372375488 time for calcul the mask position with numpy : 0.02343273162841797 nb_pixel_total : 19802 time to create 1 rle with old method : 0.020253896713256836 time for calcul the mask position with numpy : 0.024679183959960938 nb_pixel_total : 170525 time to create 1 rle with new method : 1.0728678703308105 time for calcul the mask position with numpy : 0.02486896514892578 nb_pixel_total : 28911 time to create 1 rle with old method : 0.02996087074279785 time for calcul the mask position with numpy : 0.023730754852294922 nb_pixel_total : 85985 time to create 1 rle with old method : 0.09163165092468262 time for calcul the mask position with numpy : 0.025200605392456055 nb_pixel_total : 72636 time to create 1 rle with old method : 0.07642531394958496 time for calcul the mask position with numpy : 0.02309250831604004 nb_pixel_total : 58644 time to create 1 rle with old method : 0.06261420249938965 create new chi : 3.708987236022949 time to delete rle : 0.001398324966430664 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 10095 TO DO : save crop sub photo not yet done ! save time : 0.6312830448150635 map_output_result : {1405179231: (0.0, 'Should be the crop_list due to order', 0), 1405179230: (0.0, 'Should be the crop_list due to order', 0), 1405179229: (0.0, 'Should be the crop_list due to order', 0), 1405179228: (0.0, 'Should be the crop_list due to order', 0), 1405179227: (0.0, 'Should be the crop_list due to order', 0), 1405179155: (0.0, 'Should be the crop_list due to order', 0), 1405179154: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1405179231, 1405179230, 1405179229, 1405179228, 1405179227, 1405179155, 1405179154] Looping around the photos to save general results len do output : 7 /1405179231.Didn't retrieve data . /1405179230.Didn't retrieve data . /1405179229.Didn't retrieve data . /1405179228.Didn't retrieve data . /1405179227.Didn't retrieve data . /1405179155.Didn't retrieve data . /1405179154.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179231', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179230', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179229', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179228', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179227', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179155', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179154', None, None, None, None, None, '4334258') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.01459646224975586 save_final save missing photos in datou_result : time spend for datou_step_exec : 64.97380423545837 time spend to save output : 0.014936685562133789 total time spend for step 3 : 64.98874092102051 step4:ventilate_hashtags_in_portfolio Fri Jan 23 12:13:30 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 30188766 get user id for portfolio 30188766 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30188766 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','environnement','mal_croppe','pet_fonce','carton','flou','metal','autre','pet_clair','papier','background')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30188766 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','environnement','mal_croppe','pet_fonce','carton','flou','metal','autre','pet_clair','papier','background')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30188766 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','environnement','mal_croppe','pet_fonce','carton','flou','metal','autre','pet_clair','papier','background')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/30188926,30188927,30188928,30188929,30188930,30188931,30188932,30188933,30188934,30188935,30188936?tags=pehd,environnement,mal_croppe,pet_fonce,carton,flou,metal,autre,pet_clair,papier,background Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1405179231, 1405179230, 1405179229, 1405179228, 1405179227, 1405179155, 1405179154] Looping around the photos to save general results len do output : 1 /30188766. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179231', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179230', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179229', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179228', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179227', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179155', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179154', None, None, None, None, None, '4334258') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.016654491424560547 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.9495484828948975 time spend to save output : 0.016868114471435547 total time spend for step 4 : 1.966416597366333 step5:final Fri Jan 23 12:13:32 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1405179231: ('0.07884379822530864',), 1405179230: ('0.07884379822530864',), 1405179229: ('0.07884379822530864',), 1405179228: ('0.07884379822530864',), 1405179227: ('0.07884379822530864',), 1405179155: ('0.07884379822530864',), 1405179154: ('0.07884379822530864',)} new output for save of step final : {1405179231: ('0.07884379822530864',), 1405179230: ('0.07884379822530864',), 1405179229: ('0.07884379822530864',), 1405179228: ('0.07884379822530864',), 1405179227: ('0.07884379822530864',), 1405179155: ('0.07884379822530864',), 1405179154: ('0.07884379822530864',)} [1405179231, 1405179230, 1405179229, 1405179228, 1405179227, 1405179155, 1405179154] Looping around the photos to save general results len do output : 7 /1405179231.Didn't retrieve data . /1405179230.Didn't retrieve data . /1405179229.Didn't retrieve data . /1405179228.Didn't retrieve data . /1405179227.Didn't retrieve data . /1405179155.Didn't retrieve data . /1405179154.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179231', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179230', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179229', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179228', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179227', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179155', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179154', None, None, None, None, None, '4334258') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.01544189453125 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1423203945159912 time spend to save output : 0.015822172164916992 total time spend for step 5 : 0.1581425666809082 step6:blur_detection Fri Jan 23 12:13:32 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9.jpg resize: (2160, 3840) 1405179231 -7.048194733289049 treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6.jpg resize: (2160, 3840) 1405179230 -7.058404868685928 treat image : temp/1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929.jpg resize: (2160, 3840) 1405179229 -6.892531775128562 treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca.jpg resize: (2160, 3840) 1405179228 -7.082601822235995 treat image : temp/1769166628_2597248_1405179227_2d117d7000a31008ee9b33ffc0bbbd3c.jpg resize: (2160, 3840) 1405179227 -7.064755115105889 treat image : temp/1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac.jpg resize: (2160, 3840) 1405179155 -6.885965798870614 treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2.jpg resize: (2160, 3840) 1405179154 -7.09938509152523 treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791510_0.png resize: (580, 263) 1405183204 -4.30454215613537 treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791511_0.png resize: (142, 171) 1405183205 -1.279974118686011 treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791512_0.png resize: (207, 226) 1405183206 -4.961239519853175 treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791513_0.png resize: (129, 157) 1405183207 -3.253526620405073 treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791514_0.png resize: (205, 156) 1405183208 -2.981533942897804 treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791516_0.png resize: (133, 164) 1405183209 -3.2298974021021594 treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791517_0.png resize: (344, 270) 1405183210 -1.5103142376256442 treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791518_0.png resize: (389, 435) 1405183211 -1.3239681953677378 treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791520_0.png resize: (131, 197) 1405183212 -4.43190364432137 treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791521_0.png resize: (347, 275) 1405183213 -4.148886664298897 treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791522_0.png resize: (212, 177) 1405183214 -4.168935885554922 treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791523_0.png resize: (333, 353) 1405183215 -4.005526860822878 treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791524_0.png resize: (299, 221) 1405183216 -2.5600302334482468 treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791527_0.png resize: (304, 127) 1405183217 -2.849173443310434 treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791529_0.png resize: (196, 182) 1405183218 -1.2609653520856972 treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791530_0.png resize: (130, 159) 1405183219 -3.2271089715937356 treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791531_0.png resize: (344, 242) 1405183220 -1.0893312295494708 treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791532_0.png resize: (149, 178) 1405183221 -1.3119379114724328 treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791533_0.png resize: (201, 249) 1405183222 -5.337225218086592 treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791535_0.png resize: (603, 281) 1405183223 -4.261519049198122 treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791536_0.png resize: (498, 236) 1405183224 -2.5173777132537296 treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791537_0.png resize: (121, 115) 1405183225 -3.1677440311400322 treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791539_0.png resize: (626, 642) 1405183226 -3.563883423728346 treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791541_0.png resize: (80, 179) 1405183227 -2.766739580579321 treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791542_0.png resize: (162, 191) 1405183228 -3.255943876113198 treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791543_0.png resize: (298, 119) 1405183229 -2.849472915100239 treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791544_0.png resize: (245, 219) 1405183230 -1.5218990509981773 treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791545_0.png resize: (596, 441) 1405183231 -1.8715187479786712 treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791546_0.png resize: (123, 161) 1405183232 -3.224347604802452 treat image : temp/1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791547_0.png resize: (626, 299) 1405183233 -2.0146176122921604 treat image : temp/1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791548_0.png resize: (278, 606) 1405183234 -3.7291313222601583 treat image : temp/1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791549_0.png resize: (135, 184) 1405183235 -2.9801981124166486 treat image : temp/1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791550_0.png resize: (149, 285) 1405183236 -4.239053267599728 treat image : temp/1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791551_0.png resize: (466, 346) 1405183237 -3.812533088485483 treat image : temp/1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791552_0.png resize: (330, 647) 1405183238 -3.1078832062946025 treat image : temp/1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791553_0.png resize: (212, 376) 1405183239 -4.539421442968496 treat image : temp/1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791554_0.png resize: (145, 121) 1405183240 -0.8193492777187364 treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791555_0.png resize: (291, 314) 1405183241 -2.627414867788772 treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791556_0.png resize: (266, 282) 1405183242 0.5826088067647519 treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791557_0.png resize: (380, 634) 1405183243 -5.064975526768661 treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791558_0.png resize: (332, 497) 1405183244 -4.4676105580203505 treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791559_0.png resize: (333, 758) 1405183245 -2.998957576805909 treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791560_0.png resize: (137, 204) 1405183246 -3.8779877126590394 treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791561_0.png resize: (209, 209) 1405183247 1.3290437457165412 treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791562_0.png resize: (249, 299) 1405183248 -3.154443111333554 treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791565_0.png resize: (238, 282) 1405183249 -0.7225877682703808 treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791566_0.png resize: (111, 62) 1405183250 -2.6907173813188607 treat image : temp/1769166628_2597248_1405179227_2d117d7000a31008ee9b33ffc0bbbd3c_rle_crop_4109791567_0.png resize: (154, 287) 1405183251 -2.7414961481698374 treat image : temp/1769166628_2597248_1405179227_2d117d7000a31008ee9b33ffc0bbbd3c_rle_crop_4109791568_0.png resize: (430, 695) 1405183252 1.1810331785871484 treat image : temp/1769166628_2597248_1405179227_2d117d7000a31008ee9b33ffc0bbbd3c_rle_crop_4109791569_0.png resize: (342, 204) 1405183253 -4.426085391428153 treat image : temp/1769166628_2597248_1405179227_2d117d7000a31008ee9b33ffc0bbbd3c_rle_crop_4109791570_0.png resize: (175, 214) 1405183254 -3.44025091606202 treat image : temp/1769166628_2597248_1405179227_2d117d7000a31008ee9b33ffc0bbbd3c_rle_crop_4109791571_0.png resize: (266, 150) 1405183255 1.2798952596306186 treat image : temp/1769166628_2597248_1405179227_2d117d7000a31008ee9b33ffc0bbbd3c_rle_crop_4109791572_0.png resize: (586, 311) 1405183256 -3.6993689882307734 treat image : temp/1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791573_0.png resize: (233, 302) 1405183257 -3.0982302549294083 treat image : temp/1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791575_0.png resize: (157, 275) 1405183258 -3.192226763893534 treat image : temp/1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791576_0.png resize: (158, 401) 1405183259 -2.49147010212623 treat image : temp/1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791577_0.png resize: (395, 357) 1405183260 -3.576567336132766 treat image : temp/1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791578_0.png resize: (304, 143) 1405183261 -3.254839665606166 treat image : temp/1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791580_0.png resize: (625, 751) 1405183262 -3.8107860038078956 treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791581_0.png resize: (316, 379) 1405183263 -1.311761140435623 treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791583_0.png resize: (351, 380) 1405183264 -4.47852971841728 treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791585_0.png resize: (418, 504) 1405183265 -1.6560345979851896 treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791586_0.png resize: (218, 176) 1405183266 0.6325762395127639 treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791589_0.png resize: (199, 154) 1405183267 -3.7898727013768205 treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791591_0.png resize: (144, 212) 1405183268 1.2008486803694391 treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791592_0.png resize: (415, 365) 1405183269 -4.52106038213677 treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791593_0.png resize: (271, 182) 1405183270 2.71835689865592 treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791594_0.png resize: (159, 220) 1405183271 -3.5736274517481785 treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791515_0.png resize: (145, 172) 1405183272 -1.6597465533592772 treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791519_0.png resize: (232, 93) 1405183273 -3.444740856641128 treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791525_0.png resize: (189, 227) 1405183274 -3.1354474662890683 treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791534_0.png resize: (152, 173) 1405183275 -1.8767704027598457 treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791538_0.png resize: (240, 94) 1405183276 -3.692663755365939 treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791540_0.png resize: (198, 228) 1405183277 -3.4002915591713503 treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791564_0.png resize: (142, 117) 1405183278 -2.787497806230516 treat image : temp/1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791574_0.png resize: (245, 317) 1405183279 -4.758834728831613 treat image : temp/1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791579_0.png resize: (131, 110) 1405183280 -3.341669408312402 treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791526_0.png resize: (329, 360) 1405183281 -3.9926002383541954 treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791528_0.png resize: (414, 366) 1405183282 -4.469461060624552 treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791582_0.png resize: (207, 513) 1405183283 -3.7006546909285474 treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791584_0.png resize: (157, 261) 1405183284 -4.860087382464164 treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791587_0.png resize: (327, 445) 1405183285 -4.595478774607869 treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791588_0.png resize: (297, 446) 1405183286 -4.041919961434078 treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791590_0.png resize: (257, 394) 1405183287 -4.446609825142094 treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791563_0.png resize: (157, 157) 1405183289 -3.0382513804524987 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 92 time used for this insertion : 0.03702950477600098 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 92 time used for this insertion : 0.018032312393188477 save missing photos in datou_result : time spend for datou_step_exec : 28.763001203536987 time spend to save output : 0.061797142028808594 total time spend for step 6 : 28.824798345565796 step7:brightness Fri Jan 23 12:14:01 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9.jpg treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6.jpg treat image : temp/1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929.jpg treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca.jpg treat image : temp/1769166628_2597248_1405179227_2d117d7000a31008ee9b33ffc0bbbd3c.jpg treat image : temp/1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac.jpg treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2.jpg treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791510_0.png treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791511_0.png treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791512_0.png treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791513_0.png treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791514_0.png treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791516_0.png treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791517_0.png treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791518_0.png treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791520_0.png treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791521_0.png treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791522_0.png treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791523_0.png treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791524_0.png treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791527_0.png treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791529_0.png treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791530_0.png treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791531_0.png treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791532_0.png treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791533_0.png treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791535_0.png treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791536_0.png treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791537_0.png treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791539_0.png treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791541_0.png treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791542_0.png treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791543_0.png treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791544_0.png treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791545_0.png treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791546_0.png treat image : temp/1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791547_0.png treat image : temp/1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791548_0.png treat image : temp/1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791549_0.png treat image : temp/1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791550_0.png treat image : temp/1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791551_0.png treat image : temp/1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791552_0.png treat image : temp/1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791553_0.png treat image : temp/1769166628_2597248_1405179229_096f41775bd1c45704b3465fb91ea929_rle_crop_4109791554_0.png treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791555_0.png treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791556_0.png treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791557_0.png treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791558_0.png treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791559_0.png treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791560_0.png treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791561_0.png treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791562_0.png treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791565_0.png treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791566_0.png treat image : temp/1769166628_2597248_1405179227_2d117d7000a31008ee9b33ffc0bbbd3c_rle_crop_4109791567_0.png treat image : temp/1769166628_2597248_1405179227_2d117d7000a31008ee9b33ffc0bbbd3c_rle_crop_4109791568_0.png treat image : temp/1769166628_2597248_1405179227_2d117d7000a31008ee9b33ffc0bbbd3c_rle_crop_4109791569_0.png treat image : temp/1769166628_2597248_1405179227_2d117d7000a31008ee9b33ffc0bbbd3c_rle_crop_4109791570_0.png treat image : temp/1769166628_2597248_1405179227_2d117d7000a31008ee9b33ffc0bbbd3c_rle_crop_4109791571_0.png treat image : temp/1769166628_2597248_1405179227_2d117d7000a31008ee9b33ffc0bbbd3c_rle_crop_4109791572_0.png treat image : temp/1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791573_0.png treat image : temp/1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791575_0.png treat image : temp/1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791576_0.png treat image : temp/1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791577_0.png treat image : temp/1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791578_0.png treat image : temp/1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791580_0.png treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791581_0.png treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791583_0.png treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791585_0.png treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791586_0.png treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791589_0.png treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791591_0.png treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791592_0.png treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791593_0.png treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791594_0.png treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791515_0.png treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791519_0.png treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791525_0.png treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791534_0.png treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791538_0.png treat image : temp/1769166628_2597248_1405179230_80616a34a6d0809702eb6b5376b87df6_rle_crop_4109791540_0.png treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791564_0.png treat image : temp/1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791574_0.png treat image : temp/1769166628_2597248_1405179155_94102b61aa2e4f2c883391ca823dabac_rle_crop_4109791579_0.png treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791526_0.png treat image : temp/1769166628_2597248_1405179231_fb047c5a20cae35dd3691ce096345ff9_rle_crop_4109791528_0.png treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791582_0.png treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791584_0.png treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791587_0.png treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791588_0.png treat image : temp/1769166628_2597248_1405179154_b60a8dd30f2842c49e472101a6029bf2_rle_crop_4109791590_0.png treat image : temp/1769166628_2597248_1405179228_a311d84f86a6d07156330af700758aca_rle_crop_4109791563_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 92 time used for this insertion : 0.03983879089355469 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 92 time used for this insertion : 0.02739405632019043 save missing photos in datou_result : time spend for datou_step_exec : 8.103529691696167 time spend to save output : 0.07361626625061035 total time spend for step 7 : 8.177145957946777 step8:velours_tree Fri Jan 23 12:14:09 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.16355085372924805 time spend to save output : 5.221366882324219e-05 total time spend for step 8 : 0.1636030673980713 step9:send_mail_cod Fri Jan 23 12:14:09 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P30188766_23-01-2026_12_14_09.pdf 30188926 imagette301889261769166849 30188928 imagette301889281769166849 30188929 imagette301889291769166849 30188930 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette301889301769166849 30188931 imagette301889311769166850 30188932 imagette301889321769166850 30188933 change filename to text .imagette301889331769166850 30188934 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette301889341769166850 30188935 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette301889351769166851 30188936 imagette301889361769166853 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=30188766 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/30188926,30188927,30188928,30188929,30188930,30188931,30188932,30188933,30188934,30188935,30188936?tags=pehd,environnement,mal_croppe,pet_fonce,carton,flou,metal,autre,pet_clair,papier,background your option no_mail is active, we will not send the real mail to your client args[1405179231] : ((1405179231, -7.048194733289049, 492609224), (1405179231, 1.596396409966736, 2107752395), '0.07884379822530864') We are sending mail with results at report@fotonower.com args[1405179230] : ((1405179230, -7.058404868685928, 492609224), (1405179230, 1.5740159414734383, 2107752395), '0.07884379822530864') We are sending mail with results at report@fotonower.com args[1405179229] : ((1405179229, -6.892531775128562, 492609224), (1405179229, 1.5119980810100846, 2107752395), '0.07884379822530864') We are sending mail with results at report@fotonower.com args[1405179228] : ((1405179228, -7.082601822235995, 492609224), (1405179228, 1.4332959009632857, 2107752395), '0.07884379822530864') We are sending mail with results at report@fotonower.com args[1405179227] : ((1405179227, -7.064755115105889, 492609224), (1405179227, 1.4689605323607118, 2107752395), '0.07884379822530864') We are sending mail with results at report@fotonower.com args[1405179155] : ((1405179155, -6.885965798870614, 492609224), (1405179155, 1.5059420928541458, 2107752395), '0.07884379822530864') We are sending mail with results at report@fotonower.com args[1405179154] : ((1405179154, -7.09938509152523, 492609224), (1405179154, 1.8054850194441676, 2107752395), '0.07884379822530864') We are sending mail with results at report@fotonower.com refus_total : 0.07884379822530864 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=30188766 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30188766_23-01-2026_12_14_09.pdf results_Auto_P30188766_23-01-2026_12_14_09.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30188766_23-01-2026_12_14_09.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','30188766','results_Auto_P30188766_23-01-2026_12_14_09.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30188766_23-01-2026_12_14_09.pdf','pdf','','0.46','0.07884379822530864') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1405179231, 1405179230, 1405179229, 1405179228, 1405179227, 1405179155, 1405179154] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179231', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179230', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179229', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179228', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179227', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179155', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179154', None, None, None, None, None, '4334258') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.015033245086669922 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.405081748962402 time spend to save output : 0.015299320220947266 total time spend for step 9 : 5.42038106918335 step10:split_time_score Fri Jan 23 12:14:14 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 7),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 23012026 30188766 Nombre de photos uploadées : 7 / 23040 (0%) 23012026 30188766 Nombre de photos taguées (types de déchets): 0 / 7 (0%) 23012026 30188766 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 4.5299530029296875e-06 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.00038361549377441406 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.24041533470153809 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.07884379822530864 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30188766_23-01-2026_12_14_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30188766 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30188766 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'23012026': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1405179231, 1405179230, 1405179229, 1405179228, 1405179227, 1405179155, 1405179154] Looping around the photos to save general results len do output : 1 /30188766Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179231', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179230', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179229', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179228', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179227', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179155', None, None, None, None, None, '4334258') ('3318', None, None, None, None, None, None, None, '4334258') ('3318', '30188766', '1405179154', None, None, None, None, None, '4334258') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.015575885772705078 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.5370044708251953 time spend to save output : 0.015769004821777344 total time spend for step 10 : 0.5527734756469727 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 7 set_done_treatment 91.30user 101.27system 3:50.09elapsed 83%CPU (0avgtext+0avgdata 4001568maxresident)k 2401776inputs+83056outputs (8743major+8748626minor)pagefaults 0swaps