python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2740007 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4327686'] with mtr_portfolio_ids : ['30067991'] and first list_photo_ids : [] new path : /proc/2740007/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 7 ; length of list_pids : 7 ; length of list_args : 7 time to download the photos : 1.3223323822021484 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Jan 9 13:40:29 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5537 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2026-01-09 13:40:32.010989: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2026-01-09 13:40:32.038432: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2026-01-09 13:40:32.040044: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f8e9c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2026-01-09 13:40:32.040102: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2026-01-09 13:40:32.042696: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2026-01-09 13:40:32.279998: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2f1ec870 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2026-01-09 13:40:32.280031: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2026-01-09 13:40:32.280723: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-09 13:40:32.280982: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-09 13:40:32.287696: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-09 13:40:32.289692: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-09 13:40:32.291040: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-09 13:40:32.293083: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-09 13:40:32.294072: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-09 13:40:32.298208: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-09 13:40:32.299396: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-09 13:40:32.299471: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-09 13:40:32.300062: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-09 13:40:32.300077: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-09 13:40:32.300086: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-09 13:40:32.301409: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5062 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2026-01-09 13:40:32.589549: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-09 13:40:32.589640: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-09 13:40:32.589661: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-09 13:40:32.589680: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-09 13:40:32.589698: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-09 13:40:32.589716: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-09 13:40:32.589733: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-09 13:40:32.589752: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-09 13:40:32.591042: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-09 13:40:32.592214: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-09 13:40:32.592270: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-09 13:40:32.592292: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-09 13:40:32.592310: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-09 13:40:32.592327: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-09 13:40:32.592344: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-09 13:40:32.592362: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-09 13:40:32.592379: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-09 13:40:32.593628: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-09 13:40:32.593664: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-09 13:40:32.593675: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-09 13:40:32.593685: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-09 13:40:32.595309: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5062 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2026-01-09 13:40:41.712253: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-09 13:40:41.890522: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 Detection mask done ! Trying to reset tf kernel 2740592 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 248 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5537 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [1770, 1824, 2016, 2034] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006353855133056641 nb_pixel_total : 23174 time to create 1 rle with old method : 0.026172399520874023 length of segment : 229 DEBUG bbox = [852, 570, 1278, 1026] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018758773803710938 nb_pixel_total : 90764 time to create 1 rle with old method : 0.09759998321533203 length of segment : 409 DEBUG bbox = [618, 1644, 1122, 2016] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001466512680053711 nb_pixel_total : 79786 time to create 1 rle with old method : 0.08697009086608887 length of segment : 429 DEBUG bbox = [1020, 2034, 1266, 2412] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006229877471923828 nb_pixel_total : 37501 time to create 1 rle with old method : 0.04201626777648926 length of segment : 288 DEBUG bbox = [348, 1206, 588, 1428] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005044937133789062 nb_pixel_total : 28822 time to create 1 rle with old method : 0.0324251651763916 length of segment : 235 DEBUG bbox = [426, 2976, 696, 3210] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006082057952880859 nb_pixel_total : 28137 time to create 1 rle with old method : 0.03180861473083496 length of segment : 260 DEBUG bbox = [840, 1626, 1290, 2070] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015044212341308594 nb_pixel_total : 84607 time to create 1 rle with old method : 0.09283280372619629 length of segment : 440 DEBUG bbox = [576, 522, 852, 996] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011937618255615234 nb_pixel_total : 82149 time to create 1 rle with old method : 0.09020256996154785 length of segment : 220 DEBUG bbox = [258, 708, 450, 930] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003948211669921875 nb_pixel_total : 17011 time to create 1 rle with old method : 0.019217967987060547 length of segment : 243 DEBUG bbox = [108, 678, 372, 846] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004601478576660156 nb_pixel_total : 27115 time to create 1 rle with old method : 0.030951976776123047 length of segment : 301 DEBUG bbox = [462, 300, 798, 534] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007152557373046875 nb_pixel_total : 37000 time to create 1 rle with old method : 0.04147052764892578 length of segment : 267 DEBUG bbox = [252, 2070, 786, 2286] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011370182037353516 nb_pixel_total : 75036 time to create 1 rle with old method : 0.08314204216003418 length of segment : 505 DEBUG bbox = [1866, 1944, 2058, 2226] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00046753883361816406 nb_pixel_total : 23676 time to create 1 rle with old method : 0.026633262634277344 length of segment : 237 DEBUG bbox = [432, 3138, 726, 3504] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009188652038574219 nb_pixel_total : 45762 time to create 1 rle with old method : 0.05136251449584961 length of segment : 289 DEBUG bbox = [426, 2538, 684, 2772] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005767345428466797 nb_pixel_total : 29775 time to create 1 rle with old method : 0.03352832794189453 length of segment : 227 DEBUG bbox = [36, 2208, 336, 2550] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007913112640380859 nb_pixel_total : 43246 time to create 1 rle with old method : 0.04862093925476074 length of segment : 274 DEBUG bbox = [258, 246, 492, 498] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006012916564941406 nb_pixel_total : 39711 time to create 1 rle with old method : 0.04842519760131836 length of segment : 218 DEBUG bbox = [156, 1836, 414, 2136] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007917881011962891 nb_pixel_total : 43520 time to create 1 rle with old method : 0.0565488338470459 length of segment : 205 DEBUG bbox = [1002, 870, 1464, 1326] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002932310104370117 nb_pixel_total : 121661 time to create 1 rle with old method : 0.13525080680847168 length of segment : 414 DEBUG bbox = [738, 2922, 990, 3144] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006170272827148438 nb_pixel_total : 37723 time to create 1 rle with old method : 0.044825077056884766 length of segment : 235 DEBUG bbox = [1596, 1866, 1740, 2136] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003619194030761719 nb_pixel_total : 22727 time to create 1 rle with old method : 0.02567124366760254 length of segment : 131 DEBUG bbox = [576, 2508, 984, 2988] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017952919006347656 nb_pixel_total : 111064 time to create 1 rle with old method : 0.1213994026184082 length of segment : 428 DEBUG bbox = [540, 1506, 798, 1836] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008542537689208984 nb_pixel_total : 61562 time to create 1 rle with old method : 0.06876587867736816 length of segment : 227 DEBUG bbox = [1716, 1362, 1920, 1542] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00036263465881347656 nb_pixel_total : 21500 time to create 1 rle with old method : 0.024670124053955078 length of segment : 194 DEBUG bbox = [90, 528, 288, 750] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005409717559814453 nb_pixel_total : 27731 time to create 1 rle with old method : 0.04591870307922363 length of segment : 194 DEBUG bbox = [1830, 582, 2148, 1068] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001127004623413086 nb_pixel_total : 48799 time to create 1 rle with old method : 0.05480766296386719 length of segment : 431 DEBUG bbox = [2040, 2748, 2154, 2940] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00023365020751953125 nb_pixel_total : 15826 time to create 1 rle with old method : 0.01815176010131836 length of segment : 109 DEBUG bbox = [78, 2346, 444, 2616] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007865428924560547 nb_pixel_total : 33167 time to create 1 rle with old method : 0.03773689270019531 length of segment : 331 DEBUG bbox = [366, 948, 528, 1104] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00026988983154296875 nb_pixel_total : 12978 time to create 1 rle with old method : 0.018888473510742188 length of segment : 148 DEBUG bbox = [1704, 2070, 2034, 2244] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005841255187988281 nb_pixel_total : 39238 time to create 1 rle with old method : 0.04337048530578613 length of segment : 323 DEBUG bbox = [1608, 498, 1836, 756] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005135536193847656 nb_pixel_total : 31330 time to create 1 rle with old method : 0.03533482551574707 length of segment : 206 DEBUG bbox = [1518, 1674, 1938, 1986] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010128021240234375 nb_pixel_total : 45435 time to create 1 rle with old method : 0.05021405220031738 length of segment : 424 DEBUG bbox = [1092, 1464, 1482, 1824] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012078285217285156 nb_pixel_total : 71995 time to create 1 rle with old method : 0.07839393615722656 length of segment : 383 DEBUG bbox = [138, 894, 372, 1068] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00036525726318359375 nb_pixel_total : 10425 time to create 1 rle with old method : 0.012199640274047852 length of segment : 114 DEBUG bbox = [204, 3204, 414, 3408] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000423431396484375 nb_pixel_total : 31019 time to create 1 rle with old method : 0.035593509674072266 length of segment : 192 DEBUG bbox = [1254, 1248, 1560, 1458] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006155967712402344 nb_pixel_total : 41295 time to create 1 rle with old method : 0.044738054275512695 length of segment : 294 DEBUG bbox = [972, 822, 1290, 1176] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009396076202392578 nb_pixel_total : 65118 time to create 1 rle with old method : 0.0703575611114502 length of segment : 311 DEBUG bbox = [402, 2232, 810, 2760] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0028095245361328125 nb_pixel_total : 119639 time to create 1 rle with old method : 0.13588976860046387 length of segment : 447 DEBUG bbox = [1314, 1056, 1578, 1296] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005593299865722656 nb_pixel_total : 30778 time to create 1 rle with old method : 0.03373384475708008 length of segment : 223 DEBUG bbox = [1536, 1044, 1782, 1338] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006251335144042969 nb_pixel_total : 47949 time to create 1 rle with old method : 0.0532071590423584 length of segment : 230 DEBUG bbox = [360, 312, 648, 708] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017635822296142578 nb_pixel_total : 60826 time to create 1 rle with old method : 0.07121109962463379 length of segment : 297 DEBUG bbox = [642, 2694, 1224, 3030] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003320932388305664 nb_pixel_total : 81139 time to create 1 rle with old method : 0.09104537963867188 length of segment : 1075 DEBUG bbox = [1992, 2130, 2136, 2310] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005538463592529297 nb_pixel_total : 13336 time to create 1 rle with old method : 0.014999866485595703 length of segment : 122 DEBUG bbox = [1260, 3414, 1392, 3588] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005066394805908203 nb_pixel_total : 15289 time to create 1 rle with old method : 0.017336368560791016 length of segment : 130 DEBUG bbox = [1308, 486, 1452, 618] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005376338958740234 nb_pixel_total : 11170 time to create 1 rle with old method : 0.013299226760864258 length of segment : 136 DEBUG bbox = [1464, 768, 1890, 1044] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002061605453491211 nb_pixel_total : 38197 time to create 1 rle with old method : 0.04307222366333008 length of segment : 419 DEBUG bbox = [1680, 960, 2136, 1440] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0034241676330566406 nb_pixel_total : 122946 time to create 1 rle with old method : 0.1368114948272705 length of segment : 454 DEBUG bbox = [180, 510, 396, 780] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010824203491210938 nb_pixel_total : 36438 time to create 1 rle with old method : 0.04174470901489258 length of segment : 200 DEBUG bbox = [1320, 3156, 1866, 3546] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0032579898834228516 nb_pixel_total : 92285 time to create 1 rle with old method : 0.10009765625 length of segment : 554 DEBUG bbox = [246, 432, 612, 780] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0022444725036621094 nb_pixel_total : 60850 time to create 1 rle with old method : 0.06760191917419434 length of segment : 288 DEBUG bbox = [1008, 702, 1218, 1050] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011525154113769531 nb_pixel_total : 37777 time to create 1 rle with old method : 0.04663538932800293 length of segment : 199 DEBUG bbox = [144, 654, 354, 918] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008766651153564453 nb_pixel_total : 32102 time to create 1 rle with old method : 0.03554725646972656 length of segment : 192 DEBUG bbox = [564, 498, 786, 876] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012485980987548828 nb_pixel_total : 60486 time to create 1 rle with old method : 0.06817293167114258 length of segment : 202 DEBUG bbox = [1308, 762, 1518, 882] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005853176116943359 nb_pixel_total : 16292 time to create 1 rle with old method : 0.0185089111328125 length of segment : 204 DEBUG bbox = [768, 486, 984, 714] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008592605590820312 nb_pixel_total : 32706 time to create 1 rle with old method : 0.036271095275878906 length of segment : 211 DEBUG bbox = [186, 366, 456, 540] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006172657012939453 nb_pixel_total : 21997 time to create 1 rle with old method : 0.024848461151123047 length of segment : 236 DEBUG bbox = [1194, 1104, 1392, 1320] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007703304290771484 nb_pixel_total : 26013 time to create 1 rle with old method : 0.02888965606689453 length of segment : 190 DEBUG bbox = [30, 1002, 384, 1332] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001756429672241211 nb_pixel_total : 47449 time to create 1 rle with old method : 0.052178144454956055 length of segment : 321 DEBUG bbox = [216, 2802, 504, 3012] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001119375228881836 nb_pixel_total : 31606 time to create 1 rle with old method : 0.03505969047546387 length of segment : 266 DEBUG bbox = [510, 2208, 804, 2850] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002763986587524414 nb_pixel_total : 94920 time to create 1 rle with old method : 0.10613560676574707 length of segment : 267 DEBUG bbox = [1140, 912, 1368, 1146] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006749629974365234 nb_pixel_total : 32108 time to create 1 rle with old method : 0.03555464744567871 length of segment : 211 DEBUG bbox = [876, 2748, 1062, 2928] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00064849853515625 nb_pixel_total : 20579 time to create 1 rle with old method : 0.022382497787475586 length of segment : 190 DEBUG bbox = [1344, 2352, 1536, 2604] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008463859558105469 nb_pixel_total : 30180 time to create 1 rle with old method : 0.03342938423156738 length of segment : 183 DEBUG bbox = [768, 2910, 1050, 3240] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006697177886962891 nb_pixel_total : 43655 time to create 1 rle with old method : 0.047719717025756836 length of segment : 298 DEBUG bbox = [66, 840, 228, 1050] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003788471221923828 nb_pixel_total : 25715 time to create 1 rle with old method : 0.032758235931396484 length of segment : 151 DEBUG bbox = [432, 1740, 840, 2130] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002328634262084961 nb_pixel_total : 82467 time to create 1 rle with old method : 0.09449934959411621 length of segment : 363 DEBUG bbox = [660, 1254, 924, 1554] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012407302856445312 nb_pixel_total : 41655 time to create 1 rle with old method : 0.047684669494628906 length of segment : 280 DEBUG bbox = [1038, 3126, 1350, 3348] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005364418029785156 nb_pixel_total : 33524 time to create 1 rle with old method : 0.0402989387512207 length of segment : 299 DEBUG bbox = [1842, 2370, 2070, 2604] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004436969757080078 nb_pixel_total : 27739 time to create 1 rle with old method : 0.03208756446838379 length of segment : 205 DEBUG bbox = [1068, 1116, 1674, 1722] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0021753311157226562 nb_pixel_total : 105287 time to create 1 rle with old method : 0.11625981330871582 length of segment : 344 DEBUG bbox = [1830, 2604, 2130, 2988] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001016378402709961 nb_pixel_total : 71740 time to create 1 rle with old method : 0.07956385612487793 length of segment : 353 DEBUG bbox = [288, 2454, 552, 2754] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012388229370117188 nb_pixel_total : 47203 time to create 1 rle with old method : 0.052820682525634766 length of segment : 243 DEBUG bbox = [606, 2886, 816, 3300] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001010894775390625 nb_pixel_total : 49889 time to create 1 rle with old method : 0.06509566307067871 length of segment : 194 DEBUG bbox = [384, 2304, 696, 2574] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014014244079589844 nb_pixel_total : 51108 time to create 1 rle with old method : 0.05765676498413086 length of segment : 286 DEBUG bbox = [672, 2184, 864, 2364] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007424354553222656 nb_pixel_total : 23830 time to create 1 rle with old method : 0.030696630477905273 length of segment : 158 DEBUG bbox = [594, 2268, 690, 2364] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00020933151245117188 nb_pixel_total : 4815 time to create 1 rle with old method : 0.00566411018371582 length of segment : 81 DEBUG bbox = [1734, 930, 2130, 1254] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0020122528076171875 nb_pixel_total : 73806 time to create 1 rle with old method : 0.08160138130187988 length of segment : 417 DEBUG bbox = [36, 2904, 228, 3102] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007643699645996094 nb_pixel_total : 20322 time to create 1 rle with old method : 0.0316462516784668 length of segment : 159 DEBUG bbox = [630, 900, 1116, 1458] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0034911632537841797 nb_pixel_total : 142693 time to create 1 rle with old method : 0.15854430198669434 length of segment : 442 DEBUG bbox = [174, 3348, 348, 3456] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003497600555419922 nb_pixel_total : 12382 time to create 1 rle with old method : 0.013702392578125 length of segment : 144 DEBUG bbox = [774, 756, 960, 918] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00040078163146972656 nb_pixel_total : 12708 time to create 1 rle with old method : 0.014315128326416016 length of segment : 171 time spent for convertir_results : 7.468495845794678 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 81 chid ids of type : 3594 Number RLEs to save : 22400 save missing photos in datou_result : time spend for datou_step_exec : 49.34344410896301 time spend to save output : 1.4818646907806396 total time spend for step 1 : 50.82530879974365 step2:crop_condition Fri Jan 9 13:41:19 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 7 ! batch 1 Loaded 81 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 72 About to insert : list_path_to_insert length 72 new photo from crops ! About to upload 72 photos upload in portfolio : 3736932 init cache_photo without model_param we have 72 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767962497_2740007 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140292_0c5c7c3789f7d65e0540ec5346b69cfd_rle_crop_4095246248_0.png', 0, 192, 228, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140292_0c5c7c3789f7d65e0540ec5346b69cfd_rle_crop_4095246249_0.png', 0, 421, 367, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140292_0c5c7c3789f7d65e0540ec5346b69cfd_rle_crop_4095246250_0.png', 0, 346, 391, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140292_0c5c7c3789f7d65e0540ec5346b69cfd_rle_crop_4095246251_0.png', 0, 351, 205, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246252_0.png', 0, 202, 211, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246253_0.png', 0, 207, 202, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246254_0.png', 0, 434, 374, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246255_0.png', 0, 467, 217, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246256_0.png', 0, 213, 162, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246257_0.png', 0, 163, 235, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246258_0.png', 0, 210, 264, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246261_0.png', 0, 313, 235, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246262_0.png', 0, 229, 220, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246266_0.png', 0, 405, 393, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246267_0.png', 0, 219, 233, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246268_0.png', 0, 262, 131, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246269_0.png', 0, 448, 377, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246270_0.png', 0, 316, 225, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246271_0.png', 0, 164, 194, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246272_0.png', 0, 214, 194, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246273_0.png', 0, 464, 291, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246274_0.png', 0, 177, 109, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246275_0.png', 0, 222, 317, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246276_0.png', 0, 138, 147, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246277_0.png', 0, 166, 323, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246279_0.png', 0, 273, 402, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246280_0.png', 0, 296, 355, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246281_0.png', 0, 135, 111, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246282_0.png', 0, 198, 191, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246283_0.png', 0, 195, 293, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246284_0.png', 0, 338, 310, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246285_0.png', 0, 521, 363, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246286_0.png', 0, 214, 218, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246287_0.png', 0, 260, 227, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246288_0.png', 0, 391, 282, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246289_0.png', 0, 325, 471, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246290_0.png', 0, 166, 122, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246292_0.png', 0, 118, 136, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246293_0.png', 0, 252, 394, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246294_0.png', 0, 473, 430, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246295_0.png', 0, 234, 199, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246296_0.png', 0, 339, 496, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246297_0.png', 0, 304, 273, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246298_0.png', 0, 308, 199, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246299_0.png', 0, 241, 191, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246300_0.png', 0, 375, 198, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246301_0.png', 0, 113, 204, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246302_0.png', 0, 211, 198, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246303_0.png', 0, 169, 235, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246304_0.png', 0, 197, 190, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246305_0.png', 0, 283, 279, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246306_0.png', 0, 197, 266, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246308_0.png', 0, 214, 211, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246309_0.png', 0, 175, 181, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246310_0.png', 0, 241, 181, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246311_0.png', 0, 302, 272, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246312_0.png', 0, 209, 150, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246313_0.png', 0, 387, 346, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246314_0.png', 0, 292, 242, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246315_0.png', 0, 199, 299, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246316_0.png', 0, 205, 202, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246317_0.png', 0, 572, 315, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246319_0.png', 0, 295, 229, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246320_0.png', 0, 405, 191, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246321_0.png', 0, 258, 286, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246322_0.png', 0, 178, 155, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246323_0.png', 0, 76, 80, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246324_0.png', 0, 300, 390, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246325_0.png', 0, 184, 149, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246326_0.png', 0, 509, 442, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246327_0.png', 0, 103, 143, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962510), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246328_0.png', 0, 145, 171, 0, 1767962510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 72 photos in the portfolio 3736932 time of upload the photos Elapsed time : 16.438456296920776 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767962515_2740007 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962516), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246259_0.png', 0, 209, 505, 0, 1767962516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962516), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246265_0.png', 0, 297, 205, 0, 1767962516,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7838931083679199 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767962517_2740007 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962517), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246291_0.png', 0, 159, 130, 0, 1767962517,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7028899192810059 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767962520_2740007 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962522), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246260_0.png', 0, 227, 174, 0, 1767962522,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962522), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246263_0.png', 0, 320, 211, 0, 1767962522,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962522), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246264_0.png', 0, 238, 218, 0, 1767962522,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962522), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246278_0.png', 0, 230, 201, 0, 1767962522,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962522), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246307_0.png', 0, 593, 218, 0, 1767962522,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767962522), 0.0, 0.0, 14, '', 0, 0, '1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246318_0.png', 0, 346, 291, 0, 1767962522,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.8977560997009277 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1403140292, 1403140271, 1403140270, 1403140269, 1403140268, 1403140256, 1403140255] Looping around the photos to save general results len do output : 81 /1403146590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403146687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140292', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140271', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140270', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140269', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140268', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140256', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140255', None, None, None, None, None, '4327686') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 250 time used for this insertion : 0.0332646369934082 save_final save missing photos in datou_result : time spend for datou_step_exec : 42.611976146698 time spend to save output : 0.0363774299621582 total time spend for step 2 : 42.648353576660156 step3:rle_unique_nms_with_priority Fri Jan 9 13:42:02 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 81 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 1.857837200164795 time for calcul the mask position with numpy : 0.7444469928741455 nb_pixel_total : 8063175 time to create 1 rle with new method : 0.8830742835998535 time for calcul the mask position with numpy : 0.030719995498657227 nb_pixel_total : 37501 time to create 1 rle with old method : 0.04245805740356445 time for calcul the mask position with numpy : 0.02896904945373535 nb_pixel_total : 79786 time to create 1 rle with old method : 0.08944034576416016 time for calcul the mask position with numpy : 0.02539968490600586 nb_pixel_total : 90764 time to create 1 rle with old method : 0.1004483699798584 time for calcul the mask position with numpy : 0.02376842498779297 nb_pixel_total : 23174 time to create 1 rle with old method : 0.025560855865478516 create new chi : 2.0329227447509766 time to delete rle : 0.03206157684326172 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 4870 TO DO : save crop sub photo not yet done ! save time : 0.36440014839172363 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 7.75305962562561 time for calcul the mask position with numpy : 0.6300797462463379 nb_pixel_total : 7529801 time to create 1 rle with new method : 0.7266590595245361 time for calcul the mask position with numpy : 0.03589773178100586 nb_pixel_total : 37723 time to create 1 rle with old method : 0.04105234146118164 time for calcul the mask position with numpy : 0.027070283889770508 nb_pixel_total : 121661 time to create 1 rle with old method : 0.13216209411621094 time for calcul the mask position with numpy : 0.024083375930786133 nb_pixel_total : 43520 time to create 1 rle with old method : 0.04791545867919922 time for calcul the mask position with numpy : 0.02425408363342285 nb_pixel_total : 39711 time to create 1 rle with old method : 0.04332399368286133 time for calcul the mask position with numpy : 0.02376699447631836 nb_pixel_total : 43246 time to create 1 rle with old method : 0.04796290397644043 time for calcul the mask position with numpy : 0.02488088607788086 nb_pixel_total : 29775 time to create 1 rle with old method : 0.032602787017822266 time for calcul the mask position with numpy : 0.023545026779174805 nb_pixel_total : 45762 time to create 1 rle with old method : 0.04861879348754883 time for calcul the mask position with numpy : 0.024837493896484375 nb_pixel_total : 23676 time to create 1 rle with old method : 0.026072978973388672 time for calcul the mask position with numpy : 0.02468562126159668 nb_pixel_total : 75036 time to create 1 rle with old method : 0.07870173454284668 time for calcul the mask position with numpy : 0.022797107696533203 nb_pixel_total : 37000 time to create 1 rle with old method : 0.04025673866271973 time for calcul the mask position with numpy : 0.024040937423706055 nb_pixel_total : 26763 time to create 1 rle with old method : 0.028825759887695312 time for calcul the mask position with numpy : 0.023953676223754883 nb_pixel_total : 17011 time to create 1 rle with old method : 0.018572330474853516 time for calcul the mask position with numpy : 0.02411937713623047 nb_pixel_total : 82149 time to create 1 rle with old method : 0.08870649337768555 time for calcul the mask position with numpy : 0.025052309036254883 nb_pixel_total : 84607 time to create 1 rle with old method : 0.09200835227966309 time for calcul the mask position with numpy : 0.025900840759277344 nb_pixel_total : 28137 time to create 1 rle with old method : 0.03161764144897461 time for calcul the mask position with numpy : 0.025313854217529297 nb_pixel_total : 28822 time to create 1 rle with old method : 0.0324246883392334 create new chi : 2.633540391921997 time to delete rle : 0.0013718605041503906 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 11247 TO DO : save crop sub photo not yet done ! save time : 0.8100848197937012 nb_obj : 15 nb_hashtags : 2 time to prepare the origin masks : 6.582128524780273 time for calcul the mask position with numpy : 0.4913015365600586 nb_pixel_total : 7709604 time to create 1 rle with new method : 1.6830286979675293 time for calcul the mask position with numpy : 0.024838685989379883 nb_pixel_total : 31019 time to create 1 rle with old method : 0.03630495071411133 time for calcul the mask position with numpy : 0.026546716690063477 nb_pixel_total : 10425 time to create 1 rle with old method : 0.012323141098022461 time for calcul the mask position with numpy : 0.025743961334228516 nb_pixel_total : 71995 time to create 1 rle with old method : 0.09386992454528809 time for calcul the mask position with numpy : 0.029608726501464844 nb_pixel_total : 45435 time to create 1 rle with old method : 0.05743408203125 time for calcul the mask position with numpy : 0.025054216384887695 nb_pixel_total : 31330 time to create 1 rle with old method : 0.03889131546020508 time for calcul the mask position with numpy : 0.02554774284362793 nb_pixel_total : 39238 time to create 1 rle with old method : 0.04518556594848633 time for calcul the mask position with numpy : 0.02492380142211914 nb_pixel_total : 12978 time to create 1 rle with old method : 0.015062093734741211 time for calcul the mask position with numpy : 0.02447795867919922 nb_pixel_total : 33167 time to create 1 rle with old method : 0.03817462921142578 time for calcul the mask position with numpy : 0.0264890193939209 nb_pixel_total : 15826 time to create 1 rle with old method : 0.017766475677490234 time for calcul the mask position with numpy : 0.025326967239379883 nb_pixel_total : 48799 time to create 1 rle with old method : 0.0540158748626709 time for calcul the mask position with numpy : 0.024251699447631836 nb_pixel_total : 27731 time to create 1 rle with old method : 0.031165361404418945 time for calcul the mask position with numpy : 0.027035236358642578 nb_pixel_total : 21500 time to create 1 rle with old method : 0.02453017234802246 time for calcul the mask position with numpy : 0.02463054656982422 nb_pixel_total : 61562 time to create 1 rle with old method : 0.0704042911529541 time for calcul the mask position with numpy : 0.027248620986938477 nb_pixel_total : 111064 time to create 1 rle with old method : 0.12665390968322754 time for calcul the mask position with numpy : 0.024498701095581055 nb_pixel_total : 22727 time to create 1 rle with old method : 0.02611374855041504 create new chi : 3.29431414604187 time to delete rle : 0.001317739486694336 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 9830 TO DO : save crop sub photo not yet done ! save time : 0.671520471572876 nb_obj : 14 nb_hashtags : 2 time to prepare the origin masks : 5.5611395835876465 time for calcul the mask position with numpy : 0.6692469120025635 nb_pixel_total : 7518086 time to create 1 rle with new method : 0.8544294834136963 time for calcul the mask position with numpy : 0.02367544174194336 nb_pixel_total : 92285 time to create 1 rle with old method : 0.10004854202270508 time for calcul the mask position with numpy : 0.02519512176513672 nb_pixel_total : 36438 time to create 1 rle with old method : 0.0402679443359375 time for calcul the mask position with numpy : 0.025580167770385742 nb_pixel_total : 122946 time to create 1 rle with old method : 0.13281893730163574 time for calcul the mask position with numpy : 0.025672435760498047 nb_pixel_total : 38197 time to create 1 rle with old method : 0.06104111671447754 time for calcul the mask position with numpy : 0.02592301368713379 nb_pixel_total : 11170 time to create 1 rle with old method : 0.01208639144897461 time for calcul the mask position with numpy : 0.02255535125732422 nb_pixel_total : 15289 time to create 1 rle with old method : 0.016407489776611328 time for calcul the mask position with numpy : 0.02427530288696289 nb_pixel_total : 13336 time to create 1 rle with old method : 0.014731407165527344 time for calcul the mask position with numpy : 0.02449965476989746 nb_pixel_total : 81139 time to create 1 rle with old method : 0.08869647979736328 time for calcul the mask position with numpy : 0.02439141273498535 nb_pixel_total : 60826 time to create 1 rle with old method : 0.06397461891174316 time for calcul the mask position with numpy : 0.02432847023010254 nb_pixel_total : 47949 time to create 1 rle with old method : 0.05213642120361328 time for calcul the mask position with numpy : 0.024502992630004883 nb_pixel_total : 30687 time to create 1 rle with old method : 0.03430628776550293 time for calcul the mask position with numpy : 0.02496337890625 nb_pixel_total : 119639 time to create 1 rle with old method : 0.1298370361328125 time for calcul the mask position with numpy : 0.025092124938964844 nb_pixel_total : 65118 time to create 1 rle with old method : 0.07086181640625 time for calcul the mask position with numpy : 0.02440333366394043 nb_pixel_total : 41295 time to create 1 rle with old method : 0.04687929153442383 create new chi : 2.775667428970337 time to delete rle : 0.0015058517456054688 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 11884 TO DO : save crop sub photo not yet done ! save time : 0.8317835330963135 nb_obj : 14 nb_hashtags : 2 time to prepare the origin masks : 5.368073463439941 time for calcul the mask position with numpy : 0.6379551887512207 nb_pixel_total : 7749335 time to create 1 rle with new method : 0.9338624477386475 time for calcul the mask position with numpy : 0.023756027221679688 nb_pixel_total : 30180 time to create 1 rle with old method : 0.033838510513305664 time for calcul the mask position with numpy : 0.03824877738952637 nb_pixel_total : 20579 time to create 1 rle with old method : 0.023103713989257812 time for calcul the mask position with numpy : 0.03678488731384277 nb_pixel_total : 32108 time to create 1 rle with old method : 0.035843610763549805 time for calcul the mask position with numpy : 0.03209066390991211 nb_pixel_total : 94920 time to create 1 rle with old method : 0.10224437713623047 time for calcul the mask position with numpy : 0.024013757705688477 nb_pixel_total : 31606 time to create 1 rle with old method : 0.034819841384887695 time for calcul the mask position with numpy : 0.026068925857543945 nb_pixel_total : 47449 time to create 1 rle with old method : 0.0741431713104248 time for calcul the mask position with numpy : 0.02464914321899414 nb_pixel_total : 26013 time to create 1 rle with old method : 0.031154394149780273 time for calcul the mask position with numpy : 0.025899171829223633 nb_pixel_total : 21997 time to create 1 rle with old method : 0.024853229522705078 time for calcul the mask position with numpy : 0.02400493621826172 nb_pixel_total : 32706 time to create 1 rle with old method : 0.03553009033203125 time for calcul the mask position with numpy : 0.025133132934570312 nb_pixel_total : 16292 time to create 1 rle with old method : 0.017696857452392578 time for calcul the mask position with numpy : 0.02435898780822754 nb_pixel_total : 60486 time to create 1 rle with old method : 0.0681314468383789 time for calcul the mask position with numpy : 0.024199485778808594 nb_pixel_total : 32102 time to create 1 rle with old method : 0.03538870811462402 time for calcul the mask position with numpy : 0.023534774780273438 nb_pixel_total : 37777 time to create 1 rle with old method : 0.04130411148071289 time for calcul the mask position with numpy : 0.02469348907470703 nb_pixel_total : 60850 time to create 1 rle with old method : 0.06902837753295898 create new chi : 2.619798183441162 time to delete rle : 0.0011892318725585938 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 8479 TO DO : save crop sub photo not yet done ! save time : 0.5617518424987793 nb_obj : 9 nb_hashtags : 2 time to prepare the origin masks : 3.718845844268799 time for calcul the mask position with numpy : 0.6179714202880859 nb_pixel_total : 7815415 time to create 1 rle with new method : 0.7427175045013428 time for calcul the mask position with numpy : 0.037148237228393555 nb_pixel_total : 47203 time to create 1 rle with old method : 0.05047011375427246 time for calcul the mask position with numpy : 0.023200511932373047 nb_pixel_total : 71740 time to create 1 rle with old method : 0.07714152336120605 time for calcul the mask position with numpy : 0.023932218551635742 nb_pixel_total : 105287 time to create 1 rle with old method : 0.11032652854919434 time for calcul the mask position with numpy : 0.023021936416625977 nb_pixel_total : 27739 time to create 1 rle with old method : 0.030079364776611328 time for calcul the mask position with numpy : 0.024106740951538086 nb_pixel_total : 33524 time to create 1 rle with old method : 0.035684823989868164 time for calcul the mask position with numpy : 0.023907899856567383 nb_pixel_total : 41655 time to create 1 rle with old method : 0.046199798583984375 time for calcul the mask position with numpy : 0.024016857147216797 nb_pixel_total : 82467 time to create 1 rle with old method : 0.08881974220275879 time for calcul the mask position with numpy : 0.023199081420898438 nb_pixel_total : 25715 time to create 1 rle with old method : 0.027835607528686523 time for calcul the mask position with numpy : 0.0236666202545166 nb_pixel_total : 43655 time to create 1 rle with old method : 0.04650163650512695 create new chi : 2.1406357288360596 time to delete rle : 0.0009717941284179688 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 7232 TO DO : save crop sub photo not yet done ! save time : 0.5150563716888428 nb_obj : 9 nb_hashtags : 1 time to prepare the origin masks : 3.070564031600952 time for calcul the mask position with numpy : 0.7202417850494385 nb_pixel_total : 7902847 time to create 1 rle with new method : 0.8518919944763184 time for calcul the mask position with numpy : 0.022830486297607422 nb_pixel_total : 12708 time to create 1 rle with old method : 0.01383209228515625 time for calcul the mask position with numpy : 0.023328542709350586 nb_pixel_total : 12382 time to create 1 rle with old method : 0.013083457946777344 time for calcul the mask position with numpy : 0.023662567138671875 nb_pixel_total : 142693 time to create 1 rle with old method : 0.15438342094421387 time for calcul the mask position with numpy : 0.022904396057128906 nb_pixel_total : 20322 time to create 1 rle with old method : 0.021271705627441406 time for calcul the mask position with numpy : 0.023572683334350586 nb_pixel_total : 73806 time to create 1 rle with old method : 0.07848548889160156 time for calcul the mask position with numpy : 0.022785186767578125 nb_pixel_total : 4815 time to create 1 rle with old method : 0.005044221878051758 time for calcul the mask position with numpy : 0.024214506149291992 nb_pixel_total : 23830 time to create 1 rle with old method : 0.02540302276611328 time for calcul the mask position with numpy : 0.023086071014404297 nb_pixel_total : 51108 time to create 1 rle with old method : 0.05444192886352539 time for calcul the mask position with numpy : 0.02404022216796875 nb_pixel_total : 49889 time to create 1 rle with old method : 0.0527195930480957 create new chi : 2.241319417953491 time to delete rle : 0.0009751319885253906 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 6264 TO DO : save crop sub photo not yet done ! save time : 0.44864630699157715 map_output_result : {1403140292: (0.0, 'Should be the crop_list due to order', 0), 1403140271: (0.0, 'Should be the crop_list due to order', 0), 1403140270: (0.0, 'Should be the crop_list due to order', 0), 1403140269: (0.0, 'Should be the crop_list due to order', 0), 1403140268: (0.0, 'Should be the crop_list due to order', 0), 1403140256: (0.0, 'Should be the crop_list due to order', 0), 1403140255: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1403140292, 1403140271, 1403140270, 1403140269, 1403140268, 1403140256, 1403140255] Looping around the photos to save general results len do output : 7 /1403140292.Didn't retrieve data . /1403140271.Didn't retrieve data . /1403140270.Didn't retrieve data . /1403140269.Didn't retrieve data . /1403140268.Didn't retrieve data . /1403140256.Didn't retrieve data . /1403140255.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140292', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140271', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140270', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140269', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140268', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140256', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140255', None, None, None, None, None, '4327686') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.016843080520629883 save_final save missing photos in datou_result : time spend for datou_step_exec : 57.284384965896606 time spend to save output : 0.01744556427001953 total time spend for step 3 : 57.301830530166626 step4:ventilate_hashtags_in_portfolio Fri Jan 9 13:42:59 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 30067991 get user id for portfolio 30067991 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30067991 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','background','papier','mal_croppe','pehd','autre','flou','metal','pet_clair','environnement','carton')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30067991 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','background','papier','mal_croppe','pehd','autre','flou','metal','pet_clair','environnement','carton')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30067991 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','background','papier','mal_croppe','pehd','autre','flou','metal','pet_clair','environnement','carton')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/30068214,30068215,30068216,30068217,30068218,30068219,30068220,30068221,30068222,30068223,30068224?tags=pet_fonce,background,papier,mal_croppe,pehd,autre,flou,metal,pet_clair,environnement,carton Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1403140292, 1403140271, 1403140270, 1403140269, 1403140268, 1403140256, 1403140255] Looping around the photos to save general results len do output : 1 /30067991. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140292', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140271', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140270', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140269', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140268', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140256', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140255', None, None, None, None, None, '4327686') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.015759944915771484 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.973440170288086 time spend to save output : 0.01599264144897461 total time spend for step 4 : 1.9894328117370605 step5:final Fri Jan 9 13:43:01 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1403140292: ('0.0649756289958113',), 1403140271: ('0.0649756289958113',), 1403140270: ('0.0649756289958113',), 1403140269: ('0.0649756289958113',), 1403140268: ('0.0649756289958113',), 1403140256: ('0.0649756289958113',), 1403140255: ('0.0649756289958113',)} new output for save of step final : {1403140292: ('0.0649756289958113',), 1403140271: ('0.0649756289958113',), 1403140270: ('0.0649756289958113',), 1403140269: ('0.0649756289958113',), 1403140268: ('0.0649756289958113',), 1403140256: ('0.0649756289958113',), 1403140255: ('0.0649756289958113',)} [1403140292, 1403140271, 1403140270, 1403140269, 1403140268, 1403140256, 1403140255] Looping around the photos to save general results len do output : 7 /1403140292.Didn't retrieve data . /1403140271.Didn't retrieve data . /1403140270.Didn't retrieve data . /1403140269.Didn't retrieve data . /1403140268.Didn't retrieve data . /1403140256.Didn't retrieve data . /1403140255.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140292', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140271', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140270', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140269', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140268', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140256', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140255', None, None, None, None, None, '4327686') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.017301082611083984 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13698196411132812 time spend to save output : 0.01769113540649414 total time spend for step 5 : 0.15467309951782227 step6:blur_detection Fri Jan 9 13:43:01 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1767962427_2740007_1403140292_0c5c7c3789f7d65e0540ec5346b69cfd.jpg resize: (2160, 3840) 1403140292 -5.894370047765368 treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7.jpg resize: (2160, 3840) 1403140271 -6.911818876332754 treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0.jpg resize: (2160, 3840) 1403140270 -7.004559821840983 treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1.jpg resize: (2160, 3840) 1403140269 -6.958177744123747 treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b.jpg resize: (2160, 3840) 1403140268 -6.936144750163302 treat image : temp/1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7.jpg resize: (2160, 3840) 1403140256 -7.026646531464146 treat image : temp/1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631.jpg resize: (2160, 3840) 1403140255 -6.83409977781327 treat image : temp/1767962427_2740007_1403140292_0c5c7c3789f7d65e0540ec5346b69cfd_rle_crop_4095246248_0.png resize: (228, 192) 1403146590 -3.390636368379014 treat image : temp/1767962427_2740007_1403140292_0c5c7c3789f7d65e0540ec5346b69cfd_rle_crop_4095246249_0.png resize: (367, 421) 1403146591 -3.5610087390708918 treat image : temp/1767962427_2740007_1403140292_0c5c7c3789f7d65e0540ec5346b69cfd_rle_crop_4095246250_0.png resize: (391, 346) 1403146593 -3.645849405002904 treat image : temp/1767962427_2740007_1403140292_0c5c7c3789f7d65e0540ec5346b69cfd_rle_crop_4095246251_0.png resize: (205, 351) 1403146594 -2.962822873458635 treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246252_0.png resize: (211, 202) 1403146596 0.3103161036114874 treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246253_0.png resize: (202, 207) 1403146597 -3.2417858179165164 treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246254_0.png resize: (374, 434) 1403146598 -2.1802493599868833 treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246255_0.png resize: (217, 467) 1403146600 -3.1041468416431566 treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246256_0.png resize: (162, 213) 1403146601 -1.5177631524439485 treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246257_0.png resize: (235, 163) 1403146602 -2.322130892381184 treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246258_0.png resize: (264, 210) 1403146604 -2.472628387820225 treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246261_0.png resize: (235, 313) 1403146605 -3.5175920445627367 treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246262_0.png resize: (220, 229) 1403146606 0.1450111001610436 treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246266_0.png resize: (393, 405) 1403146608 -3.407179284188043 treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246267_0.png resize: (233, 219) 1403146609 -2.7099457767929707 treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246268_0.png resize: (131, 262) 1403146610 -2.665703343882555 treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246269_0.png resize: (377, 448) 1403146612 -3.496177865020884 treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246270_0.png resize: (225, 316) 1403146613 -4.28979007412221 treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246271_0.png resize: (194, 164) 1403146614 -2.876293111345462 treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246272_0.png resize: (194, 214) 1403146616 2.610331191195255 treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246273_0.png resize: (291, 464) 1403146617 -3.9373864654960307 treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246274_0.png resize: (109, 177) 1403146618 -3.8668267347412213 treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246275_0.png resize: (317, 222) 1403146620 -3.472214613192548 treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246276_0.png resize: (147, 138) 1403146621 -2.3962660224147108 treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246277_0.png resize: (323, 166) 1403146622 -1.9907759533107259 treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246279_0.png resize: (402, 273) 1403146624 -4.05228296103553 treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246280_0.png resize: (355, 296) 1403146625 -4.902929769307117 treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246281_0.png resize: (111, 135) 1403146626 -2.345285608090136 treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246282_0.png resize: (191, 198) 1403146628 1.0289237480185518 treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246283_0.png resize: (293, 195) 1403146629 -4.816171548838426 treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246284_0.png resize: (310, 338) 1403146630 -2.300311027743923 treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246285_0.png resize: (363, 521) 1403146632 -3.558737877575485 treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246286_0.png resize: (218, 214) 1403146633 -3.6962429846279603 treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246287_0.png resize: (227, 260) 1403146635 -1.0551158207241538 treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246288_0.png resize: (282, 391) 1403146636 -2.0267913350152433 treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246289_0.png resize: (471, 325) 1403146637 -3.3014288005767574 treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246290_0.png resize: (122, 166) 1403146638 -3.009032483762647 treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246292_0.png resize: (136, 118) 1403146639 -3.6253914751802787 treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246293_0.png resize: (394, 252) 1403146640 -3.7814047418826457 treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246294_0.png resize: (430, 473) 1403146641 -4.6186130258370515 treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246295_0.png resize: (199, 234) 1403146642 -4.569232878554255 treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246296_0.png resize: (496, 339) 1403146643 -4.578087681110421 treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246297_0.png resize: (273, 304) 1403146645 -3.6784078489473395 treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246298_0.png resize: (199, 308) 1403146646 -1.2292922287839587 treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246299_0.png resize: (191, 241) 1403146647 -3.8159549947932154 treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246300_0.png resize: (198, 375) 1403146648 -3.0045023368431 treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246301_0.png resize: (204, 113) 1403146649 -4.165396617809606 treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246302_0.png resize: (198, 211) 1403146650 -3.4572173153760493 treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246303_0.png resize: (235, 169) 1403146651 -3.5454179241443486 treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246304_0.png resize: (190, 197) 1403146652 -5.1208683643917965 treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246305_0.png resize: (279, 283) 1403146653 -4.066354526281109 treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246306_0.png resize: (266, 197) 1403146654 -2.6971448841342633 treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246308_0.png resize: (211, 214) 1403146655 -3.6065872287619434 treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246309_0.png resize: (181, 175) 1403146656 -3.064255428182808 treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246310_0.png resize: (181, 241) 1403146657 -2.677607586592038 treat image : temp/1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246311_0.png resize: (272, 302) 1403146658 -2.8920874651903667 treat image : temp/1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246312_0.png resize: (150, 209) 1403146659 -1.348818982480196 treat image : temp/1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246313_0.png resize: (346, 387) 1403146660 -2.6516050700000036 treat image : temp/1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246314_0.png resize: (242, 292) 1403146661 -3.2625258930404986 treat image : temp/1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246315_0.png resize: (299, 199) 1403146662 -3.9262024646084264 treat image : temp/1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246316_0.png resize: (202, 205) 1403146663 -3.764075074020722 treat image : temp/1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246317_0.png resize: (315, 572) 1403146664 -4.482163777124161 treat image : temp/1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246319_0.png resize: (229, 295) 1403146665 -1.834879856581423 treat image : temp/1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246320_0.png resize: (191, 405) 1403146666 -0.23125360848765297 treat image : temp/1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246321_0.png resize: (286, 258) 1403146667 -0.18252711811400282 treat image : temp/1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246322_0.png resize: (155, 178) 1403146668 -1.0363008761613974 treat image : temp/1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246323_0.png resize: (80, 76) 1403146669 -1.964851536373073 treat image : temp/1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246324_0.png resize: (390, 300) 1403146670 -3.9782822442938146 treat image : temp/1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246325_0.png resize: (149, 184) 1403146671 1.4503756454413947 treat image : temp/1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246326_0.png resize: (442, 509) 1403146672 -3.2405007574347757 treat image : temp/1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246327_0.png resize: (143, 103) 1403146673 -3.54228922920971 treat image : temp/1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246328_0.png resize: (171, 145) 1403146674 -2.2420941410661577 treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246259_0.png resize: (505, 209) 1403146677 -2.2669714661128118 treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246265_0.png resize: (205, 297) 1403146678 -0.3313933264308401 treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246291_0.png resize: (130, 159) 1403146680 -3.611248908525991 treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246260_0.png resize: (174, 227) 1403146682 -3.981777565642422 treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246263_0.png resize: (211, 320) 1403146683 -3.908094457146335 treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246264_0.png resize: (218, 238) 1403146684 -4.459943108168598 treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246278_0.png resize: (201, 230) 1403146685 -5.64059185846602 treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246307_0.png resize: (218, 593) 1403146686 -3.952232300085055 treat image : temp/1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246318_0.png resize: (291, 346) 1403146687 -4.850947458948437 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 88 time used for this insertion : 0.019335031509399414 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 88 time used for this insertion : 0.020905256271362305 save missing photos in datou_result : time spend for datou_step_exec : 28.742058992385864 time spend to save output : 0.045891761779785156 total time spend for step 6 : 28.78795075416565 step7:brightness Fri Jan 9 13:43:30 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1767962427_2740007_1403140292_0c5c7c3789f7d65e0540ec5346b69cfd.jpg treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7.jpg treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0.jpg treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1.jpg treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b.jpg treat image : temp/1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7.jpg treat image : temp/1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631.jpg treat image : temp/1767962427_2740007_1403140292_0c5c7c3789f7d65e0540ec5346b69cfd_rle_crop_4095246248_0.png treat image : temp/1767962427_2740007_1403140292_0c5c7c3789f7d65e0540ec5346b69cfd_rle_crop_4095246249_0.png treat image : temp/1767962427_2740007_1403140292_0c5c7c3789f7d65e0540ec5346b69cfd_rle_crop_4095246250_0.png treat image : temp/1767962427_2740007_1403140292_0c5c7c3789f7d65e0540ec5346b69cfd_rle_crop_4095246251_0.png treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246252_0.png treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246253_0.png treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246254_0.png treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246255_0.png treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246256_0.png treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246257_0.png treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246258_0.png treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246261_0.png treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246262_0.png treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246266_0.png treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246267_0.png treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246268_0.png treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246269_0.png treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246270_0.png treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246271_0.png treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246272_0.png treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246273_0.png treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246274_0.png treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246275_0.png treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246276_0.png treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246277_0.png treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246279_0.png treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246280_0.png treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246281_0.png treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246282_0.png treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246283_0.png treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246284_0.png treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246285_0.png treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246286_0.png treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246287_0.png treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246288_0.png treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246289_0.png treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246290_0.png treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246292_0.png treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246293_0.png treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246294_0.png treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246295_0.png treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246296_0.png treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246297_0.png treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246298_0.png treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246299_0.png treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246300_0.png treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246301_0.png treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246302_0.png treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246303_0.png treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246304_0.png treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246305_0.png treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246306_0.png treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246308_0.png treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246309_0.png treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246310_0.png treat image : temp/1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246311_0.png treat image : temp/1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246312_0.png treat image : temp/1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246313_0.png treat image : temp/1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246314_0.png treat image : temp/1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246315_0.png treat image : temp/1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246316_0.png treat image : temp/1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246317_0.png treat image : temp/1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246319_0.png treat image : temp/1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246320_0.png treat image : temp/1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246321_0.png treat image : temp/1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246322_0.png treat image : temp/1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246323_0.png treat image : temp/1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246324_0.png treat image : temp/1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246325_0.png treat image : temp/1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246326_0.png treat image : temp/1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246327_0.png treat image : temp/1767962427_2740007_1403140255_20444c1b32a2dc965fbc156561d97631_rle_crop_4095246328_0.png treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246259_0.png treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246265_0.png treat image : temp/1767962427_2740007_1403140269_74c4788f780fdfd5a6a0cf0b615b3bd1_rle_crop_4095246291_0.png treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246260_0.png treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246263_0.png treat image : temp/1767962427_2740007_1403140271_86e8fa3488ae1d8d571d2511b30952c7_rle_crop_4095246264_0.png treat image : temp/1767962427_2740007_1403140270_6bf6c83de3e4d5efb6e9b1968b36d5d0_rle_crop_4095246278_0.png treat image : temp/1767962427_2740007_1403140268_b022ea6502fba493fdd41553a63b6a7b_rle_crop_4095246307_0.png treat image : temp/1767962427_2740007_1403140256_d459c1cdd458678f9545434ef24305c7_rle_crop_4095246318_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 88 time used for this insertion : 0.02160334587097168 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 88 time used for this insertion : 0.022077560424804688 save missing photos in datou_result : time spend for datou_step_exec : 7.615627765655518 time spend to save output : 0.049489736557006836 total time spend for step 7 : 7.665117502212524 step8:velours_tree Fri Jan 9 13:43:38 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.08878970146179199 time spend to save output : 5.030632019042969e-05 total time spend for step 8 : 0.08884000778198242 step9:send_mail_cod Fri Jan 9 13:43:38 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P30067991_09-01-2026_13_43_38.pdf 30068214 imagette300682141767962618 30068215 imagette300682151767962618 30068216 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette300682161767962618 30068217 imagette300682171767962620 30068218 imagette300682181767962620 30068219 imagette300682191767962620 30068220 imagette300682201767962620 30068221 change filename to text .imagette300682211767962620 30068222 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette300682221767962620 30068224 change filename to text .change filename to text .imagette300682241767962621 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=30067991 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/30068214,30068215,30068216,30068217,30068218,30068219,30068220,30068221,30068222,30068223,30068224?tags=pet_fonce,background,papier,mal_croppe,pehd,autre,flou,metal,pet_clair,environnement,carton your option no_mail is active, we will not send the real mail to your client args[1403140292] : ((1403140292, -5.894370047765368, 492609224), (1403140292, 0.6878008659512015, 2107752395), '0.0649756289958113') We are sending mail with results at report@fotonower.com args[1403140271] : ((1403140271, -6.911818876332754, 492609224), (1403140271, 1.3772704714316708, 2107752395), '0.0649756289958113') We are sending mail with results at report@fotonower.com args[1403140270] : ((1403140270, -7.004559821840983, 492609224), (1403140270, 1.225573761541599, 2107752395), '0.0649756289958113') We are sending mail with results at report@fotonower.com args[1403140269] : ((1403140269, -6.958177744123747, 492609224), (1403140269, 1.4770011482487082, 2107752395), '0.0649756289958113') We are sending mail with results at report@fotonower.com args[1403140268] : ((1403140268, -6.936144750163302, 492609224), (1403140268, 1.1655583866507482, 2107752395), '0.0649756289958113') We are sending mail with results at report@fotonower.com args[1403140256] : ((1403140256, -7.026646531464146, 492609224), (1403140256, 1.0801591330388218, 2107752395), '0.0649756289958113') We are sending mail with results at report@fotonower.com args[1403140255] : ((1403140255, -6.83409977781327, 492609224), (1403140255, 1.3838648858044782, 2107752395), '0.0649756289958113') We are sending mail with results at report@fotonower.com refus_total : 0.0649756289958113 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=30067991 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30067991_09-01-2026_13_43_38.pdf results_Auto_P30067991_09-01-2026_13_43_38.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30067991_09-01-2026_13_43_38.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','30067991','results_Auto_P30067991_09-01-2026_13_43_38.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30067991_09-01-2026_13_43_38.pdf','pdf','','0.38','0.0649756289958113') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1403140292, 1403140271, 1403140270, 1403140269, 1403140268, 1403140256, 1403140255] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140292', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140271', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140270', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140269', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140268', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140256', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140255', None, None, None, None, None, '4327686') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.018735408782958984 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.6232452392578125 time spend to save output : 0.01905512809753418 total time spend for step 9 : 4.642300367355347 step10:split_time_score Fri Jan 9 13:43:43 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('12', 7),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 09012026 30067991 Nombre de photos uploadées : 7 / 23040 (0%) 09012026 30067991 Nombre de photos taguées (types de déchets): 0 / 7 (0%) 09012026 30067991 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 1.0728836059570312e-05 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.00039005279541015625 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.23962640762329102 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.04309769020070876 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30064897_09-01-2026_07_12_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30064897 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30064897 AND mptpi.`type`=3726 To do Qualite : 0.04467766520703957 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30066437_09-01-2026_11_12_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30066437 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30066437 AND mptpi.`type`=3726 To do Qualite : 0.03704448516803841 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30066438_09-01-2026_11_14_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30066438 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30066438 AND mptpi.`type`=3594 To do Qualite : 0.02840877116406274 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30066439_09-01-2026_11_08_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30066439 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30066439 AND mptpi.`type`=3726 To do Qualite : 0.03760322869318223 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30067367_09-01-2026_12_09_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30067367 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30067367 AND mptpi.`type`=3726 To do Qualite : 0.0649756289958113 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30067991_09-01-2026_13_43_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30067991 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30067991 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'09012026': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1403140292, 1403140271, 1403140270, 1403140269, 1403140268, 1403140256, 1403140255] Looping around the photos to save general results len do output : 1 /30067991Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140292', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140271', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140270', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140269', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140268', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140256', None, None, None, None, None, '4327686') ('3318', None, None, None, None, None, None, None, '4327686') ('3318', '30067991', '1403140255', None, None, None, None, None, '4327686') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.01668405532836914 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.8632187843322754 time spend to save output : 0.01683974266052246 total time spend for step 10 : 0.8800585269927979 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 7 set_done_treatment 88.86user 81.92system 3:19.21elapsed 85%CPU (0avgtext+0avgdata 4356492maxresident)k 293856inputs+72416outputs (92major+8872102minor)pagefaults 0swaps