python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1899611 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4144082'] with mtr_portfolio_ids : ['29043561'] and first list_photo_ids : [] new path : /proc/1899611/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 2.8096861839294434 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Dec 1 10:10:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-12-01 10:10:36.015063: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-12-01 10:10:36.042420: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-12-01 10:10:36.044009: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f57b8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-12-01 10:10:36.044062: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-12-01 10:10:36.046582: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-12-01 10:10:36.332549: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x8aff890 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-12-01 10:10:36.332619: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-12-01 10:10:36.334185: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-01 10:10:36.334662: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-01 10:10:36.341910: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-01 10:10:36.344706: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-01 10:10:36.345271: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-01 10:10:36.348691: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-01 10:10:36.350256: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-01 10:10:36.357168: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-01 10:10:36.359242: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-01 10:10:36.359382: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-01 10:10:36.360438: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-01 10:10:36.360460: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-01 10:10:36.360474: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-01 10:10:36.362347: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-12-01 10:10:36.679685: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-01 10:10:36.679814: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-01 10:10:36.679833: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-01 10:10:36.679849: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-01 10:10:36.679865: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-01 10:10:36.679880: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-01 10:10:36.679894: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-01 10:10:36.679909: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-01 10:10:36.681216: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-01 10:10:36.682389: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-01 10:10:36.682429: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-01 10:10:36.682446: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-01 10:10:36.682462: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-01 10:10:36.682478: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-01 10:10:36.682494: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-01 10:10:36.682510: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-01 10:10:36.682526: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-01 10:10:36.683802: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-01 10:10:36.683837: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-01 10:10:36.683846: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-01 10:10:36.683853: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-01 10:10:36.685188: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-12-01 10:10:47.750540: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-01 10:10:47.962250: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 Detection mask done ! Trying to reset tf kernel 1900331 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1929 tf kernel not reseted sub process len(results) : 11 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 11 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 7218 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [1080, 1086, 1212, 1332] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011775493621826172 nb_pixel_total : 19779 time to create 1 rle with old method : 0.02351999282836914 length of segment : 109 DEBUG bbox = [1542, 1458, 2034, 1818] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.005185365676879883 nb_pixel_total : 105943 time to create 1 rle with old method : 0.12124156951904297 length of segment : 499 DEBUG bbox = [1260, 882, 1560, 1380] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0029006004333496094 nb_pixel_total : 74964 time to create 1 rle with old method : 0.10010480880737305 length of segment : 332 DEBUG bbox = [282, 2580, 546, 2832] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014698505401611328 nb_pixel_total : 49736 time to create 1 rle with old method : 0.06354904174804688 length of segment : 260 DEBUG bbox = [1470, 2208, 2004, 2496] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002660036087036133 nb_pixel_total : 67586 time to create 1 rle with old method : 0.07590818405151367 length of segment : 1083 DEBUG bbox = [0, 2178, 186, 2454] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009815692901611328 nb_pixel_total : 27702 time to create 1 rle with old method : 0.03183102607727051 length of segment : 180 DEBUG bbox = [1998, 1590, 2148, 1758] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002772808074951172 nb_pixel_total : 14860 time to create 1 rle with old method : 0.01730203628540039 length of segment : 149 DEBUG bbox = [162, 2904, 474, 3348] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018367767333984375 nb_pixel_total : 94916 time to create 1 rle with old method : 0.1323227882385254 length of segment : 320 DEBUG bbox = [336, 762, 468, 912] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00046563148498535156 nb_pixel_total : 11513 time to create 1 rle with old method : 0.013480186462402344 length of segment : 113 DEBUG bbox = [18, 2568, 186, 2766] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005755424499511719 nb_pixel_total : 19569 time to create 1 rle with old method : 0.02248549461364746 length of segment : 159 DEBUG bbox = [1812, 1806, 2076, 2058] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006773471832275391 nb_pixel_total : 43259 time to create 1 rle with old method : 0.04892396926879883 length of segment : 237 DEBUG bbox = [972, 804, 1242, 1158] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014452934265136719 nb_pixel_total : 57218 time to create 1 rle with old method : 0.07269978523254395 length of segment : 240 DEBUG bbox = [780, 2406, 1104, 2676] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016009807586669922 nb_pixel_total : 63587 time to create 1 rle with old method : 0.0742790699005127 length of segment : 289 DEBUG bbox = [402, 1218, 636, 1488] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010557174682617188 nb_pixel_total : 43741 time to create 1 rle with old method : 0.050260066986083984 length of segment : 226 DEBUG bbox = [726, 1380, 900, 1578] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003693103790283203 nb_pixel_total : 21520 time to create 1 rle with old method : 0.02519965171813965 length of segment : 170 DEBUG bbox = [954, 660, 1200, 888] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005283355712890625 nb_pixel_total : 20186 time to create 1 rle with old method : 0.029906749725341797 length of segment : 232 DEBUG bbox = [510, 1698, 924, 2238] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018489360809326172 nb_pixel_total : 107065 time to create 1 rle with old method : 0.12773990631103516 length of segment : 575 DEBUG bbox = [1674, 2808, 2022, 3222] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0019576549530029297 nb_pixel_total : 97686 time to create 1 rle with old method : 0.10951042175292969 length of segment : 313 DEBUG bbox = [84, 1572, 708, 2046] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.005975008010864258 nb_pixel_total : 189487 time to create 1 rle with new method : 0.010871648788452148 length of segment : 545 DEBUG bbox = [750, 348, 1146, 672] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017163753509521484 nb_pixel_total : 69899 time to create 1 rle with old method : 0.08249378204345703 length of segment : 384 DEBUG bbox = [690, 2946, 1146, 3102] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012984275817871094 nb_pixel_total : 29923 time to create 1 rle with old method : 0.03318047523498535 length of segment : 461 DEBUG bbox = [798, 816, 1080, 1188] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013058185577392578 nb_pixel_total : 54128 time to create 1 rle with old method : 0.06118631362915039 length of segment : 273 DEBUG bbox = [156, 3156, 396, 3300] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004839897155761719 nb_pixel_total : 20381 time to create 1 rle with old method : 0.023312807083129883 length of segment : 210 DEBUG bbox = [186, 1638, 342, 1908] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004572868347167969 nb_pixel_total : 25422 time to create 1 rle with old method : 0.028215646743774414 length of segment : 134 DEBUG bbox = [948, 2934, 1134, 3078] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003254413604736328 nb_pixel_total : 13196 time to create 1 rle with old method : 0.01456451416015625 length of segment : 203 DEBUG bbox = [78, 6, 546, 270] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013194084167480469 nb_pixel_total : 78787 time to create 1 rle with old method : 0.08629179000854492 length of segment : 458 DEBUG bbox = [168, 1662, 372, 1896] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007028579711914062 nb_pixel_total : 26694 time to create 1 rle with old method : 0.03296518325805664 length of segment : 188 DEBUG bbox = [1458, 984, 1596, 1152] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00037384033203125 nb_pixel_total : 11131 time to create 1 rle with old method : 0.012710809707641602 length of segment : 108 DEBUG bbox = [954, 240, 1140, 480] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00046539306640625 nb_pixel_total : 23782 time to create 1 rle with old method : 0.0289461612701416 length of segment : 196 DEBUG bbox = [1872, 2874, 2076, 3108] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004949569702148438 nb_pixel_total : 30302 time to create 1 rle with old method : 0.03389573097229004 length of segment : 194 DEBUG bbox = [120, 78, 504, 252] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000492095947265625 nb_pixel_total : 15692 time to create 1 rle with old method : 0.017789840698242188 length of segment : 475 DEBUG bbox = [948, 2574, 1170, 2748] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00039887428283691406 nb_pixel_total : 21947 time to create 1 rle with old method : 0.024173259735107422 length of segment : 219 DEBUG bbox = [948, 1734, 1290, 2292] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018439292907714844 nb_pixel_total : 100570 time to create 1 rle with old method : 0.11081266403198242 length of segment : 255 DEBUG bbox = [1110, 1128, 1338, 1314] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004699230194091797 nb_pixel_total : 22837 time to create 1 rle with old method : 0.025417804718017578 length of segment : 215 DEBUG bbox = [1740, 816, 2082, 1320] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016644001007080078 nb_pixel_total : 62293 time to create 1 rle with old method : 0.06991791725158691 length of segment : 222 DEBUG bbox = [960, 318, 1236, 462] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00040411949157714844 nb_pixel_total : 26525 time to create 1 rle with old method : 0.0288541316986084 length of segment : 256 DEBUG bbox = [18, 3000, 132, 3108] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00019812583923339844 nb_pixel_total : 6501 time to create 1 rle with old method : 0.007654428482055664 length of segment : 95 DEBUG bbox = [1758, 1494, 2154, 1956] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0020542144775390625 nb_pixel_total : 99392 time to create 1 rle with old method : 0.11141085624694824 length of segment : 375 DEBUG bbox = [1752, 1878, 2160, 2010] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006353855133056641 nb_pixel_total : 32267 time to create 1 rle with old method : 0.035334110260009766 length of segment : 393 DEBUG bbox = [1632, 2256, 1824, 2448] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006191730499267578 nb_pixel_total : 22728 time to create 1 rle with old method : 0.025224924087524414 length of segment : 181 DEBUG bbox = [1656, 1830, 1890, 2010] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007293224334716797 nb_pixel_total : 22469 time to create 1 rle with old method : 0.025201797485351562 length of segment : 191 DEBUG bbox = [1590, 2436, 1794, 2586] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000423431396484375 nb_pixel_total : 12216 time to create 1 rle with old method : 0.013502836227416992 length of segment : 176 DEBUG bbox = [0, 972, 306, 1326] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015676021575927734 nb_pixel_total : 55685 time to create 1 rle with old method : 0.06400132179260254 length of segment : 356 DEBUG bbox = [270, 2772, 654, 3078] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0019326210021972656 nb_pixel_total : 72832 time to create 1 rle with old method : 0.08335018157958984 length of segment : 382 DEBUG bbox = [954, 1920, 1428, 2592] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0040433406829833984 nb_pixel_total : 145162 time to create 1 rle with old method : 0.15724444389343262 length of segment : 394 DEBUG bbox = [1224, 2442, 1548, 2718] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010538101196289062 nb_pixel_total : 40289 time to create 1 rle with old method : 0.04549241065979004 length of segment : 425 DEBUG bbox = [1122, 708, 1506, 966] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015032291412353516 nb_pixel_total : 57633 time to create 1 rle with old method : 0.06328177452087402 length of segment : 364 DEBUG bbox = [858, 2280, 1278, 2556] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017466545104980469 nb_pixel_total : 64697 time to create 1 rle with old method : 0.07185697555541992 length of segment : 385 DEBUG bbox = [372, 948, 750, 1350] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002140045166015625 nb_pixel_total : 70816 time to create 1 rle with old method : 0.07750415802001953 length of segment : 308 DEBUG bbox = [1302, 2298, 1428, 2406] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003371238708496094 nb_pixel_total : 8813 time to create 1 rle with old method : 0.009919881820678711 length of segment : 122 DEBUG bbox = [1182, 1782, 1368, 1950] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005984306335449219 nb_pixel_total : 20700 time to create 1 rle with old method : 0.028787851333618164 length of segment : 184 DEBUG bbox = [1152, 1584, 1344, 1794] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006592273712158203 nb_pixel_total : 27100 time to create 1 rle with old method : 0.04413580894470215 length of segment : 188 DEBUG bbox = [552, 390, 738, 522] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005431175231933594 nb_pixel_total : 16266 time to create 1 rle with old method : 0.018500328063964844 length of segment : 164 DEBUG bbox = [1854, 1068, 2160, 1758] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0027878284454345703 nb_pixel_total : 114683 time to create 1 rle with old method : 0.13623833656311035 length of segment : 260 DEBUG bbox = [342, 1170, 642, 1362] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011205673217773438 nb_pixel_total : 33697 time to create 1 rle with old method : 0.03772258758544922 length of segment : 269 DEBUG bbox = [822, 2136, 1062, 2370] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008900165557861328 nb_pixel_total : 19164 time to create 1 rle with old method : 0.022427797317504883 length of segment : 225 DEBUG bbox = [180, 2580, 672, 3048] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003256082534790039 nb_pixel_total : 119006 time to create 1 rle with old method : 0.1324005126953125 length of segment : 471 DEBUG bbox = [162, 2166, 384, 2424] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009131431579589844 nb_pixel_total : 25395 time to create 1 rle with old method : 0.02888011932373047 length of segment : 201 DEBUG bbox = [822, 282, 1350, 840] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0037453174591064453 nb_pixel_total : 142827 time to create 1 rle with old method : 0.15983796119689941 length of segment : 490 time spent for convertir_results : 6.53094744682312 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 59 chid ids of type : 3594 Number RLEs to save : 17081 save missing photos in datou_result : time spend for datou_step_exec : 60.782879114151 time spend to save output : 1.1428470611572266 total time spend for step 1 : 61.92572617530823 step2:crop_condition Mon Dec 1 10:11:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 59 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 23 About to insert : list_path_to_insert length 23 new photo from crops ! About to upload 23 photos upload in portfolio : 3736932 init cache_photo without model_param we have 23 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764580303_1899611 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182147_21a757c278c9118c66a5d66abca10083_rle_crop_4053477812_0.png', 0, 244, 104, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182147_21a757c278c9118c66a5d66abca10083_rle_crop_4053477814_0.png', 0, 444, 292, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182147_21a757c278c9118c66a5d66abca10083_rle_crop_4053477816_0.png', 0, 258, 521, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477822_0.png', 0, 242, 237, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477823_0.png', 0, 339, 239, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182142_adc6f7476aaef24d60645347d080beba_rle_crop_4053477827_0.png', 0, 203, 232, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182091_393fff2a82bb5cbc6f5633bb96269745_rle_crop_4053477828_0.png', 0, 501, 371, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182091_393fff2a82bb5cbc6f5633bb96269745_rle_crop_4053477830_0.png', 0, 473, 541, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182091_393fff2a82bb5cbc6f5633bb96269745_rle_crop_4053477832_0.png', 0, 151, 420, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182091_393fff2a82bb5cbc6f5633bb96269745_rle_crop_4053477833_0.png', 0, 349, 225, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182084_eaddfc83c176987035a966f071cd1460_rle_crop_4053477839_0.png', 0, 147, 107, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5_rle_crop_4053477850_0.png', 0, 123, 386, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b_rle_crop_4053477851_0.png', 0, 188, 173, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b_rle_crop_4053477853_0.png', 0, 128, 174, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b_rle_crop_4053477854_0.png', 0, 335, 287, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b_rle_crop_4053477856_0.png', 0, 577, 386, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b_rle_crop_4053477857_0.png', 0, 254, 318, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477858_0.png', 0, 224, 363, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477864_0.png', 0, 125, 164, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182061_cc847e671070762ef607943e200c2cd6_rle_crop_4053477866_0.png', 0, 192, 269, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182061_cc847e671070762ef607943e200c2cd6_rle_crop_4053477867_0.png', 0, 210, 225, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182061_cc847e671070762ef607943e200c2cd6_rle_crop_4053477868_0.png', 0, 434, 471, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580308), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182061_cc847e671070762ef607943e200c2cd6_rle_crop_4053477869_0.png', 0, 228, 201, 0, 1764580308,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 23 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.815577268600464 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3736932 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764580312_1899611 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580314), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182147_21a757c278c9118c66a5d66abca10083_rle_crop_4053477815_0.png', 0, 237, 260, 0, 1764580314,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580314), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477818_0.png', 0, 165, 149, 0, 1764580314,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580314), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182142_adc6f7476aaef24d60645347d080beba_rle_crop_4053477826_0.png', 0, 182, 170, 0, 1764580314,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580314), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182087_a78893aefa4a88106ce3b8bcd0557e6c_rle_crop_4053477834_0.png', 0, 130, 210, 0, 1764580314,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580314), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182087_a78893aefa4a88106ce3b8bcd0557e6c_rle_crop_4053477836_0.png', 0, 133, 175, 0, 1764580314,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580314), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182080_a8bb22ded8396f22412b8339e2609bae_rle_crop_4053477843_0.png', 0, 158, 219, 0, 1764580314,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580314), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5_rle_crop_4053477845_0.png', 0, 160, 215, 0, 1764580314,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580314), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5_rle_crop_4053477848_0.png', 0, 98, 95, 0, 1764580314,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580314), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b_rle_crop_4053477855_0.png', 0, 279, 382, 0, 1764580314,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580314), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477859_0.png', 0, 265, 348, 0, 1764580314,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580314), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477860_0.png', 0, 358, 282, 0, 1764580314,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 11 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.9129505157470703 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764580317_1899611 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580319), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477820_0.png', 0, 134, 113, 0, 1764580319,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580319), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182084_eaddfc83c176987035a966f071cd1460_rle_crop_4053477840_0.png', 0, 212, 173, 0, 1764580319,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580319), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5_rle_crop_4053477847_0.png', 0, 127, 256, 0, 1764580319,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580319), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477861_0.png', 0, 95, 122, 0, 1764580319,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580319), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477862_0.png', 0, 147, 184, 0, 1764580319,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580319), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477863_0.png', 0, 208, 188, 0, 1764580319,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.1655561923980713 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3736932 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764580325_1899611 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580328), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182147_21a757c278c9118c66a5d66abca10083_rle_crop_4053477813_0.png', 0, 342, 426, 0, 1764580328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580328), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182147_21a757c278c9118c66a5d66abca10083_rle_crop_4053477817_0.png', 0, 268, 176, 0, 1764580328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580328), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477819_0.png', 0, 424, 310, 0, 1764580328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580328), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477821_0.png', 0, 179, 159, 0, 1764580328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580328), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477824_0.png', 0, 268, 280, 0, 1764580328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580328), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182091_393fff2a82bb5cbc6f5633bb96269745_rle_crop_4053477829_0.png', 0, 376, 310, 0, 1764580328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580328), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182091_393fff2a82bb5cbc6f5633bb96269745_rle_crop_4053477831_0.png', 0, 276, 384, 0, 1764580328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580328), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182087_a78893aefa4a88106ce3b8bcd0557e6c_rle_crop_4053477835_0.png', 0, 263, 134, 0, 1764580328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580328), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182084_eaddfc83c176987035a966f071cd1460_rle_crop_4053477837_0.png', 0, 237, 445, 0, 1764580328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580328), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182080_a8bb22ded8396f22412b8339e2609bae_rle_crop_4053477841_0.png', 0, 195, 192, 0, 1764580328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580328), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182080_a8bb22ded8396f22412b8339e2609bae_rle_crop_4053477842_0.png', 0, 129, 298, 0, 1764580328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580328), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5_rle_crop_4053477844_0.png', 0, 508, 252, 0, 1764580328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580328), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5_rle_crop_4053477846_0.png', 0, 366, 218, 0, 1764580328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580328), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5_rle_crop_4053477849_0.png', 0, 380, 346, 0, 1764580328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580328), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477865_0.png', 0, 554, 256, 0, 1764580328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580328), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182061_cc847e671070762ef607943e200c2cd6_rle_crop_4053477870_0.png', 0, 483, 490, 0, 1764580328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 16 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.228910207748413 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764580331_1899611 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580332), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477825_0.png', 0, 239, 225, 0, 1764580332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580332), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182084_eaddfc83c176987035a966f071cd1460_rle_crop_4053477838_0.png', 0, 183, 188, 0, 1764580332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764580332), 0.0, 0.0, 14, '', 0, 0, '1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b_rle_crop_4053477852_0.png', 0, 157, 183, 0, 1764580332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0619854927062988 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1397182147, 1397182145, 1397182142, 1397182091, 1397182087, 1397182084, 1397182080, 1397182079, 1397182077, 1397182065, 1397182061] Looping around the photos to save general results len do output : 59 /1397187112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397187182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182147', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182145', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182142', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182091', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182087', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182084', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182080', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182079', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182077', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182065', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182061', None, None, None, None, None, '4144082') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 188 time used for this insertion : 0.036719322204589844 save_final save missing photos in datou_result : time spend for datou_step_exec : 37.4102828502655 time spend to save output : 0.03910684585571289 total time spend for step 2 : 37.449389696121216 step3:rle_unique_nms_with_priority Mon Dec 1 10:12:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 59 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 2.7356700897216797 time for calcul the mask position with numpy : 1.097675085067749 nb_pixel_total : 7948690 time to create 1 rle with new method : 0.8230869770050049 time for calcul the mask position with numpy : 0.02800154685974121 nb_pixel_total : 27702 time to create 1 rle with old method : 0.03033733367919922 time for calcul the mask position with numpy : 0.027193307876586914 nb_pixel_total : 67586 time to create 1 rle with old method : 0.07638287544250488 time for calcul the mask position with numpy : 0.028794527053833008 nb_pixel_total : 49736 time to create 1 rle with old method : 0.05637359619140625 time for calcul the mask position with numpy : 0.026190519332885742 nb_pixel_total : 74964 time to create 1 rle with old method : 0.08606481552124023 time for calcul the mask position with numpy : 0.032712697982788086 nb_pixel_total : 105943 time to create 1 rle with old method : 0.12670350074768066 time for calcul the mask position with numpy : 0.02496504783630371 nb_pixel_total : 19779 time to create 1 rle with old method : 0.021694660186767578 create new chi : 2.526189088821411 time to delete rle : 0.03169989585876465 batch 1 Loaded 13 chid ids of type : 3594 +++++++++++Number RLEs to save : 7086 TO DO : save crop sub photo not yet done ! save time : 0.5165691375732422 nb_obj : 8 nb_hashtags : 5 time to prepare the origin masks : 4.891805648803711 time for calcul the mask position with numpy : 0.6776258945465088 nb_pixel_total : 7945737 time to create 1 rle with new method : 0.6506557464599609 time for calcul the mask position with numpy : 0.040369510650634766 nb_pixel_total : 43741 time to create 1 rle with old method : 0.04791736602783203 time for calcul the mask position with numpy : 0.0367579460144043 nb_pixel_total : 63587 time to create 1 rle with old method : 0.07253122329711914 time for calcul the mask position with numpy : 0.0270235538482666 nb_pixel_total : 57218 time to create 1 rle with old method : 0.06501984596252441 time for calcul the mask position with numpy : 0.03062891960144043 nb_pixel_total : 43259 time to create 1 rle with old method : 0.04848217964172363 time for calcul the mask position with numpy : 0.02601480484008789 nb_pixel_total : 19569 time to create 1 rle with old method : 0.024176597595214844 time for calcul the mask position with numpy : 0.027681827545166016 nb_pixel_total : 11513 time to create 1 rle with old method : 0.013351202011108398 time for calcul the mask position with numpy : 0.034226179122924805 nb_pixel_total : 94916 time to create 1 rle with old method : 0.10982584953308105 time for calcul the mask position with numpy : 0.025140762329101562 nb_pixel_total : 14860 time to create 1 rle with old method : 0.016361236572265625 create new chi : 2.0162088871002197 time to delete rle : 0.0012400150299072266 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 5626 TO DO : save crop sub photo not yet done ! save time : 0.4013395309448242 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 2.7786738872528076 time for calcul the mask position with numpy : 0.7507326602935791 nb_pixel_total : 8252694 time to create 1 rle with new method : 0.8064768314361572 time for calcul the mask position with numpy : 0.02491021156311035 nb_pixel_total : 20186 time to create 1 rle with old method : 0.02305436134338379 time for calcul the mask position with numpy : 0.026148319244384766 nb_pixel_total : 21520 time to create 1 rle with old method : 0.0244905948638916 create new chi : 1.7048559188842773 time to delete rle : 0.0004398822784423828 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2964 TO DO : save crop sub photo not yet done ! save time : 0.23718905448913574 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 2.3027868270874023 time for calcul the mask position with numpy : 0.5463080406188965 nb_pixel_total : 7746212 time to create 1 rle with new method : 0.9724643230438232 time for calcul the mask position with numpy : 0.024948596954345703 nb_pixel_total : 54128 time to create 1 rle with old method : 0.05733752250671387 time for calcul the mask position with numpy : 0.02350616455078125 nb_pixel_total : 29923 time to create 1 rle with old method : 0.03397083282470703 time for calcul the mask position with numpy : 0.02565789222717285 nb_pixel_total : 69899 time to create 1 rle with old method : 0.07447957992553711 time for calcul the mask position with numpy : 0.02504110336303711 nb_pixel_total : 189487 time to create 1 rle with new method : 0.5764036178588867 time for calcul the mask position with numpy : 0.02516961097717285 nb_pixel_total : 97686 time to create 1 rle with old method : 0.1054532527923584 time for calcul the mask position with numpy : 0.025116920471191406 nb_pixel_total : 107065 time to create 1 rle with old method : 0.11420774459838867 create new chi : 2.7093076705932617 time to delete rle : 0.0009248256683349609 batch 1 Loaded 13 chid ids of type : 3594 ++++++++++Number RLEs to save : 7262 TO DO : save crop sub photo not yet done ! save time : 0.5088906288146973 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 1.3596692085266113 time for calcul the mask position with numpy : 0.5004289150238037 nb_pixel_total : 8235401 time to create 1 rle with new method : 0.7411556243896484 time for calcul the mask position with numpy : 0.026466846466064453 nb_pixel_total : 13196 time to create 1 rle with old method : 0.015080451965332031 time for calcul the mask position with numpy : 0.024608135223388672 nb_pixel_total : 25422 time to create 1 rle with old method : 0.028441429138183594 time for calcul the mask position with numpy : 0.026291847229003906 nb_pixel_total : 20381 time to create 1 rle with old method : 0.0228116512298584 create new chi : 1.431603193283081 time to delete rle : 0.0006344318389892578 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3254 TO DO : save crop sub photo not yet done ! save time : 0.2503244876861572 nb_obj : 4 nb_hashtags : 4 time to prepare the origin masks : 1.865319013595581 time for calcul the mask position with numpy : 0.45133018493652344 nb_pixel_total : 8154006 time to create 1 rle with new method : 0.825476884841919 time for calcul the mask position with numpy : 0.0406954288482666 nb_pixel_total : 23782 time to create 1 rle with old method : 0.026816368103027344 time for calcul the mask position with numpy : 0.04198884963989258 nb_pixel_total : 11131 time to create 1 rle with old method : 0.01805257797241211 time for calcul the mask position with numpy : 0.04214215278625488 nb_pixel_total : 26694 time to create 1 rle with old method : 0.031577110290527344 time for calcul the mask position with numpy : 0.02700328826904297 nb_pixel_total : 78787 time to create 1 rle with old method : 0.08620357513427734 create new chi : 1.6372013092041016 time to delete rle : 0.0007085800170898438 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 4060 TO DO : save crop sub photo not yet done ! save time : 0.30701208114624023 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 1.500173568725586 time for calcul the mask position with numpy : 0.47905421257019043 nb_pixel_total : 8226459 time to create 1 rle with new method : 0.5571873188018799 time for calcul the mask position with numpy : 0.024514198303222656 nb_pixel_total : 21947 time to create 1 rle with old method : 0.026044607162475586 time for calcul the mask position with numpy : 0.03810477256774902 nb_pixel_total : 15692 time to create 1 rle with old method : 0.017981767654418945 time for calcul the mask position with numpy : 0.02658247947692871 nb_pixel_total : 30302 time to create 1 rle with old method : 0.03355860710144043 create new chi : 1.2494425773620605 time to delete rle : 0.000682830810546875 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 3936 TO DO : save crop sub photo not yet done ! save time : 0.28709959983825684 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 2.885389804840088 time for calcul the mask position with numpy : 0.7252411842346191 nb_pixel_total : 7944081 time to create 1 rle with new method : 0.6166903972625732 time for calcul the mask position with numpy : 0.024230003356933594 nb_pixel_total : 32201 time to create 1 rle with old method : 0.03562760353088379 time for calcul the mask position with numpy : 0.025045394897460938 nb_pixel_total : 99392 time to create 1 rle with old method : 0.11365914344787598 time for calcul the mask position with numpy : 0.04157090187072754 nb_pixel_total : 6501 time to create 1 rle with old method : 0.007158994674682617 time for calcul the mask position with numpy : 0.025587081909179688 nb_pixel_total : 26525 time to create 1 rle with old method : 0.032353878021240234 time for calcul the mask position with numpy : 0.02834177017211914 nb_pixel_total : 62293 time to create 1 rle with old method : 0.08278679847717285 time for calcul the mask position with numpy : 0.02804255485534668 nb_pixel_total : 22837 time to create 1 rle with old method : 0.026443004608154297 time for calcul the mask position with numpy : 0.03094172477722168 nb_pixel_total : 100570 time to create 1 rle with old method : 0.11164236068725586 create new chi : 2.0009121894836426 time to delete rle : 0.0010654926300048828 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 5694 TO DO : save crop sub photo not yet done ! save time : 0.39331889152526855 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 2.802353858947754 time for calcul the mask position with numpy : 0.42192769050598145 nb_pixel_total : 7923019 time to create 1 rle with new method : 0.8580100536346436 time for calcul the mask position with numpy : 0.026407241821289062 nb_pixel_total : 40289 time to create 1 rle with old method : 0.04530739784240723 time for calcul the mask position with numpy : 0.025212764739990234 nb_pixel_total : 145162 time to create 1 rle with old method : 0.15837812423706055 time for calcul the mask position with numpy : 0.024250507354736328 nb_pixel_total : 72832 time to create 1 rle with old method : 0.07757067680358887 time for calcul the mask position with numpy : 0.02421736717224121 nb_pixel_total : 55685 time to create 1 rle with old method : 0.0605313777923584 time for calcul the mask position with numpy : 0.025198698043823242 nb_pixel_total : 12216 time to create 1 rle with old method : 0.013676881790161133 time for calcul the mask position with numpy : 0.026144981384277344 nb_pixel_total : 22469 time to create 1 rle with old method : 0.02471613883972168 time for calcul the mask position with numpy : 0.024725675582885742 nb_pixel_total : 22728 time to create 1 rle with old method : 0.02483367919921875 create new chi : 1.9168908596038818 time to delete rle : 0.0008885860443115234 batch 1 Loaded 15 chid ids of type : 3594 +++++++++++++Number RLEs to save : 6370 TO DO : save crop sub photo not yet done ! save time : 0.4592864513397217 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 3.433288812637329 time for calcul the mask position with numpy : 0.6857194900512695 nb_pixel_total : 7913692 time to create 1 rle with new method : 0.7531888484954834 time for calcul the mask position with numpy : 0.024343490600585938 nb_pixel_total : 114683 time to create 1 rle with old method : 0.1217958927154541 time for calcul the mask position with numpy : 0.023606300354003906 nb_pixel_total : 16266 time to create 1 rle with old method : 0.017260074615478516 time for calcul the mask position with numpy : 0.023576736450195312 nb_pixel_total : 27100 time to create 1 rle with old method : 0.02929997444152832 time for calcul the mask position with numpy : 0.024026155471801758 nb_pixel_total : 20700 time to create 1 rle with old method : 0.022451400756835938 time for calcul the mask position with numpy : 0.02407383918762207 nb_pixel_total : 8813 time to create 1 rle with old method : 0.009387016296386719 time for calcul the mask position with numpy : 0.02457714080810547 nb_pixel_total : 70816 time to create 1 rle with old method : 0.07726454734802246 time for calcul the mask position with numpy : 0.024850845336914062 nb_pixel_total : 64697 time to create 1 rle with old method : 0.06794333457946777 time for calcul the mask position with numpy : 0.023937463760375977 nb_pixel_total : 57633 time to create 1 rle with old method : 0.06022381782531738 create new chi : 2.0808277130126953 time to delete rle : 0.0009210109710693359 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 6110 TO DO : save crop sub photo not yet done ! save time : 0.44864344596862793 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 1.8615062236785889 time for calcul the mask position with numpy : 0.5055654048919678 nb_pixel_total : 7954311 time to create 1 rle with new method : 0.743790864944458 time for calcul the mask position with numpy : 0.027177810668945312 nb_pixel_total : 142827 time to create 1 rle with old method : 0.16034555435180664 time for calcul the mask position with numpy : 0.02522587776184082 nb_pixel_total : 25395 time to create 1 rle with old method : 0.028493881225585938 time for calcul the mask position with numpy : 0.02661609649658203 nb_pixel_total : 119006 time to create 1 rle with old method : 0.132249116897583 time for calcul the mask position with numpy : 0.02547740936279297 nb_pixel_total : 19164 time to create 1 rle with old method : 0.02112889289855957 time for calcul the mask position with numpy : 0.025236845016479492 nb_pixel_total : 33697 time to create 1 rle with old method : 0.037992000579833984 create new chi : 1.8047385215759277 time to delete rle : 0.0008575916290283203 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 5472 TO DO : save crop sub photo not yet done ! save time : 0.3756716251373291 map_output_result : {1397182147: (0.0, 'Should be the crop_list due to order', 0), 1397182145: (0.0, 'Should be the crop_list due to order', 0), 1397182142: (0.0, 'Should be the crop_list due to order', 0), 1397182091: (0.0, 'Should be the crop_list due to order', 0), 1397182087: (0.0, 'Should be the crop_list due to order', 0), 1397182084: (0.0, 'Should be the crop_list due to order', 0), 1397182080: (0.0, 'Should be the crop_list due to order', 0), 1397182079: (0.0, 'Should be the crop_list due to order', 0), 1397182077: (0.0, 'Should be the crop_list due to order', 0), 1397182065: (0.0, 'Should be the crop_list due to order', 0), 1397182061: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1397182147, 1397182145, 1397182142, 1397182091, 1397182087, 1397182084, 1397182080, 1397182079, 1397182077, 1397182065, 1397182061] Looping around the photos to save general results len do output : 11 /1397182147.Didn't retrieve data . /1397182145.Didn't retrieve data . /1397182142.Didn't retrieve data . /1397182091.Didn't retrieve data . /1397182087.Didn't retrieve data . /1397182084.Didn't retrieve data . /1397182080.Didn't retrieve data . /1397182079.Didn't retrieve data . /1397182077.Didn't retrieve data . /1397182065.Didn't retrieve data . /1397182061.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182147', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182145', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182142', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182091', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182087', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182084', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182080', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182079', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182077', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182065', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182061', None, None, None, None, None, '4144082') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.015135526657104492 save_final save missing photos in datou_result : time spend for datou_step_exec : 54.92983865737915 time spend to save output : 0.015577316284179688 total time spend for step 3 : 54.94541597366333 step4:ventilate_hashtags_in_portfolio Mon Dec 1 10:13:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 29043561 get user id for portfolio 29043561 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29043561 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','pet_clair','flou','environnement','carton','metal','papier','background','pehd','autre','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29043561 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','pet_clair','flou','environnement','carton','metal','papier','background','pehd','autre','pet_fonce')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29043561 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','pet_clair','flou','environnement','carton','metal','papier','background','pehd','autre','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/29043877,29043878,29043879,29043880,29043881,29043882,29043883,29043884,29043885,29043886,29043887?tags=mal_croppe,pet_clair,flou,environnement,carton,metal,papier,background,pehd,autre,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1397182147, 1397182145, 1397182142, 1397182091, 1397182087, 1397182084, 1397182080, 1397182079, 1397182077, 1397182065, 1397182061] Looping around the photos to save general results len do output : 1 /29043561. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182147', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182145', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182142', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182091', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182087', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182084', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182080', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182079', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182077', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182065', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182061', None, None, None, None, None, '4144082') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.016021728515625 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.9376485347747803 time spend to save output : 0.016277790069580078 total time spend for step 4 : 1.9539263248443604 step5:final Mon Dec 1 10:13:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1397182147: ('0.0328162045805275',), 1397182145: ('0.0328162045805275',), 1397182142: ('0.0328162045805275',), 1397182091: ('0.0328162045805275',), 1397182087: ('0.0328162045805275',), 1397182084: ('0.0328162045805275',), 1397182080: ('0.0328162045805275',), 1397182079: ('0.0328162045805275',), 1397182077: ('0.0328162045805275',), 1397182065: ('0.0328162045805275',), 1397182061: ('0.0328162045805275',)} new output for save of step final : {1397182147: ('0.0328162045805275',), 1397182145: ('0.0328162045805275',), 1397182142: ('0.0328162045805275',), 1397182091: ('0.0328162045805275',), 1397182087: ('0.0328162045805275',), 1397182084: ('0.0328162045805275',), 1397182080: ('0.0328162045805275',), 1397182079: ('0.0328162045805275',), 1397182077: ('0.0328162045805275',), 1397182065: ('0.0328162045805275',), 1397182061: ('0.0328162045805275',)} [1397182147, 1397182145, 1397182142, 1397182091, 1397182087, 1397182084, 1397182080, 1397182079, 1397182077, 1397182065, 1397182061] Looping around the photos to save general results len do output : 11 /1397182147.Didn't retrieve data . /1397182145.Didn't retrieve data . /1397182142.Didn't retrieve data . /1397182091.Didn't retrieve data . /1397182087.Didn't retrieve data . /1397182084.Didn't retrieve data . /1397182080.Didn't retrieve data . /1397182079.Didn't retrieve data . /1397182077.Didn't retrieve data . /1397182065.Didn't retrieve data . /1397182061.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182147', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182145', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182142', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182091', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182087', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182084', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182080', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182079', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182077', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182065', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182061', None, None, None, None, None, '4144082') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.02223944664001465 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13675546646118164 time spend to save output : 0.02276897430419922 total time spend for step 5 : 0.15952444076538086 step6:blur_detection Mon Dec 1 10:13:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1764580230_1899611_1397182147_21a757c278c9118c66a5d66abca10083.jpg resize: (2160, 3840) 1397182147 -6.943340256448597 treat image : temp/1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445.jpg resize: (2160, 3840) 1397182145 -6.8463005675776705 treat image : temp/1764580230_1899611_1397182142_adc6f7476aaef24d60645347d080beba.jpg resize: (2160, 3840) 1397182142 -6.893098084079087 treat image : temp/1764580230_1899611_1397182091_393fff2a82bb5cbc6f5633bb96269745.jpg resize: (2160, 3840) 1397182091 -6.968432352441341 treat image : temp/1764580230_1899611_1397182087_a78893aefa4a88106ce3b8bcd0557e6c.jpg resize: (2160, 3840) 1397182087 -7.06929741095343 treat image : temp/1764580230_1899611_1397182084_eaddfc83c176987035a966f071cd1460.jpg resize: (2160, 3840) 1397182084 -7.059095848014719 treat image : temp/1764580230_1899611_1397182080_a8bb22ded8396f22412b8339e2609bae.jpg resize: (2160, 3840) 1397182080 -7.0524294464090165 treat image : temp/1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5.jpg resize: (2160, 3840) 1397182079 -7.057308552509606 treat image : temp/1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b.jpg resize: (2160, 3840) 1397182077 -6.915665763225433 treat image : temp/1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b.jpg resize: (2160, 3840) 1397182065 -6.707530926287318 treat image : temp/1764580230_1899611_1397182061_cc847e671070762ef607943e200c2cd6.jpg resize: (2160, 3840) 1397182061 -6.443586609856261 treat image : temp/1764580230_1899611_1397182147_21a757c278c9118c66a5d66abca10083_rle_crop_4053477812_0.png resize: (104, 244) 1397187112 -4.065194902317814 treat image : temp/1764580230_1899611_1397182147_21a757c278c9118c66a5d66abca10083_rle_crop_4053477814_0.png resize: (292, 444) 1397187113 -4.937824297831739 treat image : temp/1764580230_1899611_1397182147_21a757c278c9118c66a5d66abca10083_rle_crop_4053477816_0.png resize: (521, 258) 1397187114 -3.8045273189325948 treat image : temp/1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477822_0.png resize: (237, 242) 1397187115 -4.7082847143873545 treat image : temp/1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477823_0.png resize: (239, 339) 1397187116 -3.7738124950870695 treat image : temp/1764580230_1899611_1397182142_adc6f7476aaef24d60645347d080beba_rle_crop_4053477827_0.png resize: (232, 203) 1397187117 -3.888312739519459 treat image : temp/1764580230_1899611_1397182091_393fff2a82bb5cbc6f5633bb96269745_rle_crop_4053477828_0.png resize: (371, 501) 1397187118 -3.0486669009505567 treat image : temp/1764580230_1899611_1397182091_393fff2a82bb5cbc6f5633bb96269745_rle_crop_4053477830_0.png resize: (541, 473) 1397187120 -3.849462127943897 treat image : temp/1764580230_1899611_1397182091_393fff2a82bb5cbc6f5633bb96269745_rle_crop_4053477832_0.png resize: (420, 151) 1397187121 -4.726692722048747 treat image : temp/1764580230_1899611_1397182091_393fff2a82bb5cbc6f5633bb96269745_rle_crop_4053477833_0.png resize: (225, 349) 1397187122 -3.8896375584066796 treat image : temp/1764580230_1899611_1397182084_eaddfc83c176987035a966f071cd1460_rle_crop_4053477839_0.png resize: (107, 147) 1397187123 -4.099145638537203 treat image : temp/1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5_rle_crop_4053477850_0.png resize: (386, 123) 1397187124 -4.859219671673679 treat image : temp/1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b_rle_crop_4053477851_0.png resize: (173, 188) 1397187125 -4.191125847361876 treat image : temp/1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b_rle_crop_4053477853_0.png resize: (174, 128) 1397187126 -3.100354524813518 treat image : temp/1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b_rle_crop_4053477854_0.png resize: (287, 335) 1397187127 -3.697356159663269 treat image : temp/1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b_rle_crop_4053477856_0.png resize: (386, 577) 1397187128 -5.3011676229405635 treat image : temp/1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b_rle_crop_4053477857_0.png resize: (318, 254) 1397187129 -4.682655752573119 treat image : temp/1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477858_0.png resize: (363, 224) 1397187130 -4.504546527346447 treat image : temp/1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477864_0.png resize: (164, 125) 1397187131 -3.331747801734093 treat image : temp/1764580230_1899611_1397182061_cc847e671070762ef607943e200c2cd6_rle_crop_4053477866_0.png resize: (269, 192) 1397187132 -3.7455604961634634 treat image : temp/1764580230_1899611_1397182061_cc847e671070762ef607943e200c2cd6_rle_crop_4053477867_0.png resize: (225, 210) 1397187133 -3.3721583998021605 treat image : temp/1764580230_1899611_1397182061_cc847e671070762ef607943e200c2cd6_rle_crop_4053477868_0.png resize: (471, 434) 1397187134 -4.269779058371747 treat image : temp/1764580230_1899611_1397182061_cc847e671070762ef607943e200c2cd6_rle_crop_4053477869_0.png resize: (201, 228) 1397187135 -3.6342272456661133 treat image : temp/1764580230_1899611_1397182147_21a757c278c9118c66a5d66abca10083_rle_crop_4053477815_0.png resize: (260, 237) 1397187137 -2.470604182647443 treat image : temp/1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477818_0.png resize: (149, 165) 1397187138 -2.726194913845097 treat image : temp/1764580230_1899611_1397182142_adc6f7476aaef24d60645347d080beba_rle_crop_4053477826_0.png resize: (170, 182) 1397187139 -1.5985438748034875 treat image : temp/1764580230_1899611_1397182087_a78893aefa4a88106ce3b8bcd0557e6c_rle_crop_4053477834_0.png resize: (210, 130) 1397187140 -4.697491038680033 treat image : temp/1764580230_1899611_1397182087_a78893aefa4a88106ce3b8bcd0557e6c_rle_crop_4053477836_0.png resize: (175, 133) 1397187141 -3.84328062490805 treat image : temp/1764580230_1899611_1397182080_a8bb22ded8396f22412b8339e2609bae_rle_crop_4053477843_0.png resize: (219, 158) 1397187142 -4.055698134207214 treat image : temp/1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5_rle_crop_4053477845_0.png resize: (215, 160) 1397187143 -2.4082893700741272 treat image : temp/1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5_rle_crop_4053477848_0.png resize: (95, 98) 1397187144 -3.8566126448549443 treat image : temp/1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b_rle_crop_4053477855_0.png resize: (382, 279) 1397187145 -4.618677229991246 treat image : temp/1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477859_0.png resize: (348, 265) 1397187146 -4.864801965368636 treat image : temp/1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477860_0.png resize: (282, 358) 1397187147 -4.106958599283136 treat image : temp/1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477820_0.png resize: (113, 134) 1397187149 -4.756301628277399 treat image : temp/1764580230_1899611_1397182084_eaddfc83c176987035a966f071cd1460_rle_crop_4053477840_0.png resize: (173, 212) 1397187150 -4.274958986780503 treat image : temp/1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5_rle_crop_4053477847_0.png resize: (256, 127) 1397187151 -4.0287315620514565 treat image : temp/1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477861_0.png resize: (122, 95) 1397187152 -5.087031257772029 treat image : temp/1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477862_0.png resize: (184, 147) 1397187153 -4.849088088323618 treat image : temp/1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477863_0.png resize: (188, 208) 1397187154 -5.213773462415744 treat image : temp/1764580230_1899611_1397182147_21a757c278c9118c66a5d66abca10083_rle_crop_4053477813_0.png resize: (426, 342) 1397187162 -5.32042784369162 treat image : temp/1764580230_1899611_1397182147_21a757c278c9118c66a5d66abca10083_rle_crop_4053477817_0.png resize: (176, 268) 1397187163 -3.569337157424578 treat image : temp/1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477819_0.png resize: (310, 424) 1397187164 -5.4608658862342345 treat image : temp/1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477821_0.png resize: (159, 179) 1397187165 -4.29862395873871 treat image : temp/1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477824_0.png resize: (280, 268) 1397187166 -5.604261017125429 treat image : temp/1764580230_1899611_1397182091_393fff2a82bb5cbc6f5633bb96269745_rle_crop_4053477829_0.png resize: (310, 376) 1397187167 -6.558402617082446 treat image : temp/1764580230_1899611_1397182091_393fff2a82bb5cbc6f5633bb96269745_rle_crop_4053477831_0.png resize: (384, 276) 1397187168 -5.448763476435982 treat image : temp/1764580230_1899611_1397182087_a78893aefa4a88106ce3b8bcd0557e6c_rle_crop_4053477835_0.png resize: (134, 263) 1397187169 -4.431091248734225 treat image : temp/1764580230_1899611_1397182084_eaddfc83c176987035a966f071cd1460_rle_crop_4053477837_0.png resize: (445, 237) 1397187170 -4.978533531503721 treat image : temp/1764580230_1899611_1397182080_a8bb22ded8396f22412b8339e2609bae_rle_crop_4053477841_0.png resize: (192, 195) 1397187171 -4.402311732771032 treat image : temp/1764580230_1899611_1397182080_a8bb22ded8396f22412b8339e2609bae_rle_crop_4053477842_0.png resize: (298, 129) 1397187172 -3.558872923781676 treat image : temp/1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5_rle_crop_4053477844_0.png resize: (252, 508) 1397187173 -5.879691525369378 treat image : temp/1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5_rle_crop_4053477846_0.png resize: (218, 366) 1397187174 -6.118578905255525 treat image : temp/1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5_rle_crop_4053477849_0.png resize: (346, 380) 1397187175 -5.3705752260578965 treat image : temp/1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477865_0.png resize: (256, 554) 1397187176 -5.276968956215036 treat image : temp/1764580230_1899611_1397182061_cc847e671070762ef607943e200c2cd6_rle_crop_4053477870_0.png resize: (490, 483) 1397187177 -4.388496938953343 treat image : temp/1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477825_0.png resize: (225, 239) 1397187179 -1.8789574649914722 treat image : temp/1764580230_1899611_1397182084_eaddfc83c176987035a966f071cd1460_rle_crop_4053477838_0.png resize: (188, 183) 1397187181 -3.1916812686901754 treat image : temp/1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b_rle_crop_4053477852_0.png resize: (183, 157) 1397187182 -4.836461098782747 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 70 time used for this insertion : 0.01841282844543457 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 70 time used for this insertion : 0.017436981201171875 save missing photos in datou_result : time spend for datou_step_exec : 39.33072638511658 time spend to save output : 0.0415804386138916 total time spend for step 6 : 39.37230682373047 step7:brightness Mon Dec 1 10:13:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1764580230_1899611_1397182147_21a757c278c9118c66a5d66abca10083.jpg treat image : temp/1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445.jpg treat image : temp/1764580230_1899611_1397182142_adc6f7476aaef24d60645347d080beba.jpg treat image : temp/1764580230_1899611_1397182091_393fff2a82bb5cbc6f5633bb96269745.jpg treat image : temp/1764580230_1899611_1397182087_a78893aefa4a88106ce3b8bcd0557e6c.jpg treat image : temp/1764580230_1899611_1397182084_eaddfc83c176987035a966f071cd1460.jpg treat image : temp/1764580230_1899611_1397182080_a8bb22ded8396f22412b8339e2609bae.jpg treat image : temp/1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5.jpg treat image : temp/1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b.jpg treat image : temp/1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b.jpg treat image : temp/1764580230_1899611_1397182061_cc847e671070762ef607943e200c2cd6.jpg treat image : temp/1764580230_1899611_1397182147_21a757c278c9118c66a5d66abca10083_rle_crop_4053477812_0.png treat image : temp/1764580230_1899611_1397182147_21a757c278c9118c66a5d66abca10083_rle_crop_4053477814_0.png treat image : temp/1764580230_1899611_1397182147_21a757c278c9118c66a5d66abca10083_rle_crop_4053477816_0.png treat image : temp/1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477822_0.png treat image : temp/1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477823_0.png treat image : temp/1764580230_1899611_1397182142_adc6f7476aaef24d60645347d080beba_rle_crop_4053477827_0.png treat image : temp/1764580230_1899611_1397182091_393fff2a82bb5cbc6f5633bb96269745_rle_crop_4053477828_0.png treat image : temp/1764580230_1899611_1397182091_393fff2a82bb5cbc6f5633bb96269745_rle_crop_4053477830_0.png treat image : temp/1764580230_1899611_1397182091_393fff2a82bb5cbc6f5633bb96269745_rle_crop_4053477832_0.png treat image : temp/1764580230_1899611_1397182091_393fff2a82bb5cbc6f5633bb96269745_rle_crop_4053477833_0.png treat image : temp/1764580230_1899611_1397182084_eaddfc83c176987035a966f071cd1460_rle_crop_4053477839_0.png treat image : temp/1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5_rle_crop_4053477850_0.png treat image : temp/1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b_rle_crop_4053477851_0.png treat image : temp/1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b_rle_crop_4053477853_0.png treat image : temp/1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b_rle_crop_4053477854_0.png treat image : temp/1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b_rle_crop_4053477856_0.png treat image : temp/1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b_rle_crop_4053477857_0.png treat image : temp/1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477858_0.png treat image : temp/1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477864_0.png treat image : temp/1764580230_1899611_1397182061_cc847e671070762ef607943e200c2cd6_rle_crop_4053477866_0.png treat image : temp/1764580230_1899611_1397182061_cc847e671070762ef607943e200c2cd6_rle_crop_4053477867_0.png treat image : temp/1764580230_1899611_1397182061_cc847e671070762ef607943e200c2cd6_rle_crop_4053477868_0.png treat image : temp/1764580230_1899611_1397182061_cc847e671070762ef607943e200c2cd6_rle_crop_4053477869_0.png treat image : temp/1764580230_1899611_1397182147_21a757c278c9118c66a5d66abca10083_rle_crop_4053477815_0.png treat image : temp/1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477818_0.png treat image : temp/1764580230_1899611_1397182142_adc6f7476aaef24d60645347d080beba_rle_crop_4053477826_0.png treat image : temp/1764580230_1899611_1397182087_a78893aefa4a88106ce3b8bcd0557e6c_rle_crop_4053477834_0.png treat image : temp/1764580230_1899611_1397182087_a78893aefa4a88106ce3b8bcd0557e6c_rle_crop_4053477836_0.png treat image : temp/1764580230_1899611_1397182080_a8bb22ded8396f22412b8339e2609bae_rle_crop_4053477843_0.png treat image : temp/1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5_rle_crop_4053477845_0.png treat image : temp/1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5_rle_crop_4053477848_0.png treat image : temp/1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b_rle_crop_4053477855_0.png treat image : temp/1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477859_0.png treat image : temp/1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477860_0.png treat image : temp/1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477820_0.png treat image : temp/1764580230_1899611_1397182084_eaddfc83c176987035a966f071cd1460_rle_crop_4053477840_0.png treat image : temp/1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5_rle_crop_4053477847_0.png treat image : temp/1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477861_0.png treat image : temp/1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477862_0.png treat image : temp/1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477863_0.png treat image : temp/1764580230_1899611_1397182147_21a757c278c9118c66a5d66abca10083_rle_crop_4053477813_0.png treat image : temp/1764580230_1899611_1397182147_21a757c278c9118c66a5d66abca10083_rle_crop_4053477817_0.png treat image : temp/1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477819_0.png treat image : temp/1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477821_0.png treat image : temp/1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477824_0.png treat image : temp/1764580230_1899611_1397182091_393fff2a82bb5cbc6f5633bb96269745_rle_crop_4053477829_0.png treat image : temp/1764580230_1899611_1397182091_393fff2a82bb5cbc6f5633bb96269745_rle_crop_4053477831_0.png treat image : temp/1764580230_1899611_1397182087_a78893aefa4a88106ce3b8bcd0557e6c_rle_crop_4053477835_0.png treat image : temp/1764580230_1899611_1397182084_eaddfc83c176987035a966f071cd1460_rle_crop_4053477837_0.png treat image : temp/1764580230_1899611_1397182080_a8bb22ded8396f22412b8339e2609bae_rle_crop_4053477841_0.png treat image : temp/1764580230_1899611_1397182080_a8bb22ded8396f22412b8339e2609bae_rle_crop_4053477842_0.png treat image : temp/1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5_rle_crop_4053477844_0.png treat image : temp/1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5_rle_crop_4053477846_0.png treat image : temp/1764580230_1899611_1397182079_0f7cc03e6df192f7acf085b0feaa3dd5_rle_crop_4053477849_0.png treat image : temp/1764580230_1899611_1397182065_e2af0b1719326f7126617bfaecc05b4b_rle_crop_4053477865_0.png treat image : temp/1764580230_1899611_1397182061_cc847e671070762ef607943e200c2cd6_rle_crop_4053477870_0.png treat image : temp/1764580230_1899611_1397182145_b5f3c293d53c2b7559d94c63f4c07445_rle_crop_4053477825_0.png treat image : temp/1764580230_1899611_1397182084_eaddfc83c176987035a966f071cd1460_rle_crop_4053477838_0.png treat image : temp/1764580230_1899611_1397182077_5dd3699432a2ac9f035512e470d3904b_rle_crop_4053477852_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 70 time used for this insertion : 0.018797874450683594 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 70 time used for this insertion : 0.017206668853759766 save missing photos in datou_result : time spend for datou_step_exec : 9.956092834472656 time spend to save output : 0.041284799575805664 total time spend for step 7 : 9.997377634048462 step8:velours_tree Mon Dec 1 10:13:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09000492095947266 time spend to save output : 3.647804260253906e-05 total time spend for step 8 : 0.0900413990020752 step9:send_mail_cod Mon Dec 1 10:13:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P29043561_01-12-2025_10_13_59.pdf 29043877 imagette290438771764580439 29043878 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette290438781764580439 29043879 imagette290438791764580440 29043881 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette290438811764580440 29043882 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette290438821764580441 29043883 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette290438831764580442 29043884 imagette290438841764580444 29043885 imagette290438851764580444 29043886 change filename to text .change filename to text .change filename to text .imagette290438861764580444 29043887 imagette290438871764580444 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=29043561 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/29043877,29043878,29043879,29043880,29043881,29043882,29043883,29043884,29043885,29043886,29043887?tags=mal_croppe,pet_clair,flou,environnement,carton,metal,papier,background,pehd,autre,pet_fonce your option no_mail is active, we will not send the real mail to your client args[1397182147] : ((1397182147, -6.943340256448597, 492609224), (1397182147, -0.25848102068773116, 496442774), '0.0328162045805275') We are sending mail with results at report@fotonower.com args[1397182145] : ((1397182145, -6.8463005675776705, 492609224), (1397182145, -0.22229297068109075, 496442774), '0.0328162045805275') We are sending mail with results at report@fotonower.com args[1397182142] : ((1397182142, -6.893098084079087, 492609224), (1397182142, -0.3418614036909734, 496442774), '0.0328162045805275') We are sending mail with results at report@fotonower.com args[1397182091] : ((1397182091, -6.968432352441341, 492609224), (1397182091, -0.10977830783993053, 496442774), '0.0328162045805275') We are sending mail with results at report@fotonower.com args[1397182087] : ((1397182087, -7.06929741095343, 492609224), (1397182087, -0.2882213981622675, 496442774), '0.0328162045805275') We are sending mail with results at report@fotonower.com args[1397182084] : ((1397182084, -7.059095848014719, 492609224), (1397182084, -0.2759207691002923, 496442774), '0.0328162045805275') We are sending mail with results at report@fotonower.com args[1397182080] : ((1397182080, -7.0524294464090165, 492609224), (1397182080, -0.27104899534206284, 496442774), '0.0328162045805275') We are sending mail with results at report@fotonower.com args[1397182079] : ((1397182079, -7.057308552509606, 492609224), (1397182079, -0.08211342545573076, 496442774), '0.0328162045805275') We are sending mail with results at report@fotonower.com args[1397182077] : ((1397182077, -6.915665763225433, 492609224), (1397182077, -0.20616953184851525, 496442774), '0.0328162045805275') We are sending mail with results at report@fotonower.com args[1397182065] : ((1397182065, -6.707530926287318, 492609224), (1397182065, -0.30969413468497775, 496442774), '0.0328162045805275') We are sending mail with results at report@fotonower.com args[1397182061] : ((1397182061, -6.443586609856261, 492609224), (1397182061, -0.2907683964755714, 496442774), '0.0328162045805275') We are sending mail with results at report@fotonower.com refus_total : 0.0328162045805275 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=29043561 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29043561_01-12-2025_10_13_59.pdf results_Auto_P29043561_01-12-2025_10_13_59.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29043561_01-12-2025_10_13_59.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','29043561','results_Auto_P29043561_01-12-2025_10_13_59.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29043561_01-12-2025_10_13_59.pdf','pdf','','0.73','0.0328162045805275') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1397182147, 1397182145, 1397182142, 1397182091, 1397182087, 1397182084, 1397182080, 1397182079, 1397182077, 1397182065, 1397182061] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182147', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182145', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182142', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182091', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182087', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182084', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182080', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182079', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182077', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182065', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182061', None, None, None, None, None, '4144082') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.015949487686157227 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.412285804748535 time spend to save output : 0.016245365142822266 total time spend for step 9 : 8.428531169891357 step10:split_time_score Mon Dec 1 10:14:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('09', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 01122025 29043561 Nombre de photos uploadées : 11 / 23040 (0%) 01122025 29043561 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 01122025 29043561 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 1.2874603271484375e-05 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0006632804870605469 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.23635292053222656 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.0328162045805275 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29043561_01-12-2025_10_13_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29043561 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29043561 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'01122025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1397182147, 1397182145, 1397182142, 1397182091, 1397182087, 1397182084, 1397182080, 1397182079, 1397182077, 1397182065, 1397182061] Looping around the photos to save general results len do output : 1 /29043561Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182147', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182145', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182142', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182091', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182087', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182084', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182080', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182079', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182077', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182065', None, None, None, None, None, '4144082') ('3318', None, None, None, None, None, None, None, '4144082') ('3318', '29043561', '1397182061', None, None, None, None, None, '4144082') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.017278194427490234 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.5277976989746094 time spend to save output : 0.017557859420776367 total time spend for step 10 : 0.5453555583953857 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 105.26user 85.02system 3:41.95elapsed 85%CPU (0avgtext+0avgdata 4097836maxresident)k 602800inputs+93936outputs (7194major+9154843minor)pagefaults 0swaps