python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2264696 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3933090'] with mtr_portfolio_ids : ['27756449'] and first list_photo_ids : [] new path : /proc/2264696/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 23 ; length of list_pids : 23 ; length of list_args : 23 time to download the photos : 3.413041114807129 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Oct 13 14:30:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10842 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-10-13 14:30:35.382919: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-10-13 14:30:35.410532: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-10-13 14:30:35.412675: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fce80000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-10-13 14:30:35.412729: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-10-13 14:30:35.416528: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-10-13 14:30:35.548963: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x38954f00 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-10-13 14:30:35.549018: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-10-13 14:30:35.550495: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-13 14:30:35.550880: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-13 14:30:35.553682: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-13 14:30:35.556215: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-13 14:30:35.556722: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-13 14:30:35.559492: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-13 14:30:35.560525: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-13 14:30:35.564437: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-13 14:30:35.565949: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-13 14:30:35.566017: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-13 14:30:35.566825: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-13 14:30:35.566843: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-13 14:30:35.566862: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-13 14:30:35.568254: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10049 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-10-13 14:30:35.973574: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-13 14:30:35.973684: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-13 14:30:35.973715: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-13 14:30:35.973744: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-13 14:30:35.973772: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-13 14:30:35.973799: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-13 14:30:35.973826: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-13 14:30:35.973853: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-13 14:30:35.976010: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-13 14:30:35.977141: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-13 14:30:35.977192: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-13 14:30:35.977208: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-13 14:30:35.977223: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-13 14:30:35.977237: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-13 14:30:35.977251: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-13 14:30:35.977266: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-13 14:30:35.977280: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-13 14:30:35.978524: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-13 14:30:35.978552: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-13 14:30:35.978561: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-13 14:30:35.978568: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-13 14:30:35.979914: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10049 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-10-13 14:30:43.312985: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-13 14:30:43.527546: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 23 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 0 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 Detection mask done ! Trying to reset tf kernel 2265502 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1130 tf kernel not reseted sub process len(results) : 23 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 23 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4983 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0008625984191894531 nb_pixel_total : 25180 time to create 1 rle with old method : 0.030369043350219727 length of segment : 311 time for calcul the mask position with numpy : 0.00016188621520996094 nb_pixel_total : 5673 time to create 1 rle with old method : 0.006983041763305664 length of segment : 63 time for calcul the mask position with numpy : 0.0001480579376220703 nb_pixel_total : 5156 time to create 1 rle with old method : 0.006227254867553711 length of segment : 93 time for calcul the mask position with numpy : 0.0018656253814697266 nb_pixel_total : 106237 time to create 1 rle with old method : 0.11817121505737305 length of segment : 517 time for calcul the mask position with numpy : 0.00042939186096191406 nb_pixel_total : 10511 time to create 1 rle with old method : 0.012519598007202148 length of segment : 237 time for calcul the mask position with numpy : 0.00037407875061035156 nb_pixel_total : 23865 time to create 1 rle with old method : 0.02734851837158203 length of segment : 128 time for calcul the mask position with numpy : 0.0017650127410888672 nb_pixel_total : 111241 time to create 1 rle with old method : 0.13443470001220703 length of segment : 524 time for calcul the mask position with numpy : 0.000152587890625 nb_pixel_total : 8425 time to create 1 rle with old method : 0.010090351104736328 length of segment : 67 time for calcul the mask position with numpy : 0.000774383544921875 nb_pixel_total : 58797 time to create 1 rle with old method : 0.07015442848205566 length of segment : 287 time for calcul the mask position with numpy : 0.0004832744598388672 nb_pixel_total : 33150 time to create 1 rle with old method : 0.03735542297363281 length of segment : 209 time for calcul the mask position with numpy : 0.0001914501190185547 nb_pixel_total : 8529 time to create 1 rle with old method : 0.011276483535766602 length of segment : 82 time for calcul the mask position with numpy : 9.918212890625e-05 nb_pixel_total : 2086 time to create 1 rle with old method : 0.002971649169921875 length of segment : 39 time for calcul the mask position with numpy : 0.0005385875701904297 nb_pixel_total : 26685 time to create 1 rle with old method : 0.03161358833312988 length of segment : 155 time for calcul the mask position with numpy : 0.000110626220703125 nb_pixel_total : 4912 time to create 1 rle with old method : 0.005750179290771484 length of segment : 97 time for calcul the mask position with numpy : 0.0003840923309326172 nb_pixel_total : 22734 time to create 1 rle with old method : 0.028127431869506836 length of segment : 212 time for calcul the mask position with numpy : 0.00020003318786621094 nb_pixel_total : 12540 time to create 1 rle with old method : 0.017950773239135742 length of segment : 113 time for calcul the mask position with numpy : 0.00027632713317871094 nb_pixel_total : 16329 time to create 1 rle with old method : 0.020476579666137695 length of segment : 72 time for calcul the mask position with numpy : 0.0002677440643310547 nb_pixel_total : 9652 time to create 1 rle with old method : 0.011294364929199219 length of segment : 123 time for calcul the mask position with numpy : 0.0017693042755126953 nb_pixel_total : 108091 time to create 1 rle with old method : 0.12428736686706543 length of segment : 525 time for calcul the mask position with numpy : 0.00014019012451171875 nb_pixel_total : 3076 time to create 1 rle with old method : 0.003750324249267578 length of segment : 47 time for calcul the mask position with numpy : 0.0006527900695800781 nb_pixel_total : 23918 time to create 1 rle with old method : 0.02678990364074707 length of segment : 208 time for calcul the mask position with numpy : 0.00051116943359375 nb_pixel_total : 11160 time to create 1 rle with old method : 0.012839078903198242 length of segment : 149 time for calcul the mask position with numpy : 0.0002472400665283203 nb_pixel_total : 4667 time to create 1 rle with old method : 0.0054972171783447266 length of segment : 101 time for calcul the mask position with numpy : 0.0007467269897460938 nb_pixel_total : 29191 time to create 1 rle with old method : 0.03366899490356445 length of segment : 185 time for calcul the mask position with numpy : 0.0008187294006347656 nb_pixel_total : 39588 time to create 1 rle with old method : 0.04561758041381836 length of segment : 144 time for calcul the mask position with numpy : 0.0005822181701660156 nb_pixel_total : 14699 time to create 1 rle with old method : 0.016782283782958984 length of segment : 145 time for calcul the mask position with numpy : 0.0004661083221435547 nb_pixel_total : 18214 time to create 1 rle with old method : 0.020946502685546875 length of segment : 120 time for calcul the mask position with numpy : 0.0003452301025390625 nb_pixel_total : 17929 time to create 1 rle with old method : 0.020972251892089844 length of segment : 122 time for calcul the mask position with numpy : 0.00044226646423339844 nb_pixel_total : 24075 time to create 1 rle with old method : 0.027793407440185547 length of segment : 136 time for calcul the mask position with numpy : 0.0005919933319091797 nb_pixel_total : 15526 time to create 1 rle with old method : 0.017834901809692383 length of segment : 156 time for calcul the mask position with numpy : 0.0006535053253173828 nb_pixel_total : 28720 time to create 1 rle with old method : 0.03281593322753906 length of segment : 166 time for calcul the mask position with numpy : 0.0003440380096435547 nb_pixel_total : 8866 time to create 1 rle with old method : 0.010261058807373047 length of segment : 133 time for calcul the mask position with numpy : 0.0006389617919921875 nb_pixel_total : 26469 time to create 1 rle with old method : 0.030420541763305664 length of segment : 145 time for calcul the mask position with numpy : 0.0007302761077880859 nb_pixel_total : 27643 time to create 1 rle with old method : 0.03415679931640625 length of segment : 220 time for calcul the mask position with numpy : 0.0003833770751953125 nb_pixel_total : 8291 time to create 1 rle with old method : 0.010154962539672852 length of segment : 89 time for calcul the mask position with numpy : 0.0007174015045166016 nb_pixel_total : 16303 time to create 1 rle with old method : 0.018659591674804688 length of segment : 254 time for calcul the mask position with numpy : 0.0007874965667724609 nb_pixel_total : 30593 time to create 1 rle with old method : 0.037279367446899414 length of segment : 240 time for calcul the mask position with numpy : 0.000335693359375 nb_pixel_total : 8438 time to create 1 rle with old method : 0.009990215301513672 length of segment : 131 time for calcul the mask position with numpy : 0.0001685619354248047 nb_pixel_total : 3717 time to create 1 rle with old method : 0.00461578369140625 length of segment : 80 time for calcul the mask position with numpy : 0.0002541542053222656 nb_pixel_total : 8233 time to create 1 rle with old method : 0.00974416732788086 length of segment : 79 time for calcul the mask position with numpy : 0.0002071857452392578 nb_pixel_total : 3884 time to create 1 rle with old method : 0.004633426666259766 length of segment : 80 time for calcul the mask position with numpy : 0.002688884735107422 nb_pixel_total : 111142 time to create 1 rle with old method : 0.1219627857208252 length of segment : 532 time for calcul the mask position with numpy : 0.00013327598571777344 nb_pixel_total : 3445 time to create 1 rle with old method : 0.004073143005371094 length of segment : 79 time for calcul the mask position with numpy : 0.0007035732269287109 nb_pixel_total : 11970 time to create 1 rle with old method : 0.014014005661010742 length of segment : 260 time for calcul the mask position with numpy : 0.0003333091735839844 nb_pixel_total : 10107 time to create 1 rle with old method : 0.01430511474609375 length of segment : 127 time for calcul the mask position with numpy : 0.0009036064147949219 nb_pixel_total : 14129 time to create 1 rle with old method : 0.0193328857421875 length of segment : 181 time for calcul the mask position with numpy : 0.0020258426666259766 nb_pixel_total : 97537 time to create 1 rle with old method : 0.10850834846496582 length of segment : 358 time for calcul the mask position with numpy : 0.0026082992553710938 nb_pixel_total : 104196 time to create 1 rle with old method : 0.1161506175994873 length of segment : 568 time for calcul the mask position with numpy : 0.0005927085876464844 nb_pixel_total : 11709 time to create 1 rle with old method : 0.013342618942260742 length of segment : 265 time for calcul the mask position with numpy : 0.00019741058349609375 nb_pixel_total : 4122 time to create 1 rle with old method : 0.005012989044189453 length of segment : 85 time for calcul the mask position with numpy : 0.0002510547637939453 nb_pixel_total : 8803 time to create 1 rle with old method : 0.010492563247680664 length of segment : 91 time for calcul the mask position with numpy : 0.0004589557647705078 nb_pixel_total : 14536 time to create 1 rle with old method : 0.016873598098754883 length of segment : 167 time for calcul the mask position with numpy : 0.0002827644348144531 nb_pixel_total : 5537 time to create 1 rle with old method : 0.006576061248779297 length of segment : 129 time for calcul the mask position with numpy : 0.0005621910095214844 nb_pixel_total : 17987 time to create 1 rle with old method : 0.020494937896728516 length of segment : 221 time for calcul the mask position with numpy : 0.00024819374084472656 nb_pixel_total : 4415 time to create 1 rle with old method : 0.0052280426025390625 length of segment : 116 time for calcul the mask position with numpy : 0.00045609474182128906 nb_pixel_total : 13949 time to create 1 rle with old method : 0.01639723777770996 length of segment : 92 time for calcul the mask position with numpy : 0.0003879070281982422 nb_pixel_total : 16003 time to create 1 rle with old method : 0.018341064453125 length of segment : 156 time for calcul the mask position with numpy : 0.00028204917907714844 nb_pixel_total : 7472 time to create 1 rle with old method : 0.008935689926147461 length of segment : 98 time for calcul the mask position with numpy : 0.0003414154052734375 nb_pixel_total : 12743 time to create 1 rle with old method : 0.014756441116333008 length of segment : 111 time for calcul the mask position with numpy : 0.0007214546203613281 nb_pixel_total : 23401 time to create 1 rle with old method : 0.026616573333740234 length of segment : 286 time for calcul the mask position with numpy : 0.000225067138671875 nb_pixel_total : 5000 time to create 1 rle with old method : 0.005724906921386719 length of segment : 111 time for calcul the mask position with numpy : 0.00016045570373535156 nb_pixel_total : 3727 time to create 1 rle with old method : 0.0044972896575927734 length of segment : 59 time for calcul the mask position with numpy : 0.0005180835723876953 nb_pixel_total : 19727 time to create 1 rle with old method : 0.022529125213623047 length of segment : 139 time for calcul the mask position with numpy : 0.0003833770751953125 nb_pixel_total : 11148 time to create 1 rle with old method : 0.012880325317382812 length of segment : 130 time for calcul the mask position with numpy : 0.00020885467529296875 nb_pixel_total : 3959 time to create 1 rle with old method : 0.004809856414794922 length of segment : 82 time for calcul the mask position with numpy : 0.00015497207641601562 nb_pixel_total : 4444 time to create 1 rle with old method : 0.005446672439575195 length of segment : 66 time for calcul the mask position with numpy : 0.0002608299255371094 nb_pixel_total : 6449 time to create 1 rle with old method : 0.007676124572753906 length of segment : 139 time for calcul the mask position with numpy : 0.00035190582275390625 nb_pixel_total : 10713 time to create 1 rle with old method : 0.012609004974365234 length of segment : 123 time for calcul the mask position with numpy : 0.00021648406982421875 nb_pixel_total : 7848 time to create 1 rle with old method : 0.009183645248413086 length of segment : 65 time for calcul the mask position with numpy : 0.0002899169921875 nb_pixel_total : 4857 time to create 1 rle with old method : 0.005759000778198242 length of segment : 87 time for calcul the mask position with numpy : 0.0024373531341552734 nb_pixel_total : 105575 time to create 1 rle with old method : 0.11768674850463867 length of segment : 531 time for calcul the mask position with numpy : 0.0016026496887207031 nb_pixel_total : 69662 time to create 1 rle with old method : 0.07783293724060059 length of segment : 269 time for calcul the mask position with numpy : 0.00028324127197265625 nb_pixel_total : 6031 time to create 1 rle with old method : 0.0071582794189453125 length of segment : 95 time for calcul the mask position with numpy : 0.000469207763671875 nb_pixel_total : 17809 time to create 1 rle with old method : 0.02028036117553711 length of segment : 134 time for calcul the mask position with numpy : 0.0007259845733642578 nb_pixel_total : 22664 time to create 1 rle with old method : 0.025676965713500977 length of segment : 175 time for calcul the mask position with numpy : 0.00038433074951171875 nb_pixel_total : 10154 time to create 1 rle with old method : 0.011722803115844727 length of segment : 134 time for calcul the mask position with numpy : 0.00016427040100097656 nb_pixel_total : 8227 time to create 1 rle with old method : 0.009751319885253906 length of segment : 108 time for calcul the mask position with numpy : 0.00040841102600097656 nb_pixel_total : 11531 time to create 1 rle with old method : 0.013289213180541992 length of segment : 132 time spent for convertir_results : 4.378760576248169 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 78 chid ids of type : 3594 Number RLEs to save : 13485 save missing photos in datou_result : time spend for datou_step_exec : 29.4134304523468 time spend to save output : 1.549288272857666 total time spend for step 1 : 30.962718725204468 step2:crop_condition Mon Oct 13 14:31:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 23 ! batch 1 Loaded 78 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 35 About to insert : list_path_to_insert length 35 new photo from crops ! About to upload 35 photos upload in portfolio : 3736932 init cache_photo without model_param we have 35 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760358666_2264696 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194900_fcc07c5bd26fd31400cf90d292c653b9_rle_crop_3996267762_0.png', 0, 270, 220, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194900_fcc07c5bd26fd31400cf90d292c653b9_rle_crop_3996267764_0.png', 0, 69, 92, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194900_fcc07c5bd26fd31400cf90d292c653b9_rle_crop_3996267763_0.png', 0, 133, 62, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194880_87e0096176c6d1ffb9b3e5c7a6f61f18_rle_crop_3996267769_0.png', 0, 175, 65, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194865_091f0b8419dd767d485c8362ae3a1f64_rle_crop_3996267770_0.png', 0, 263, 286, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194865_091f0b8419dd767d485c8362ae3a1f64_rle_crop_3996267771_0.png', 0, 296, 164, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194865_091f0b8419dd767d485c8362ae3a1f64_rle_crop_3996267773_0.png', 0, 74, 39, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194863_a868c434f5089805d4678fa6ccbd850e_rle_crop_3996267778_0.png', 0, 402, 64, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194863_a868c434f5089805d4678fa6ccbd850e_rle_crop_3996267775_0.png', 0, 79, 97, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194860_366ab7f081578bbc9af2ecf1b1d80a63_rle_crop_3996267779_0.png', 0, 165, 123, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194857_c0a09f5d5b62ae2de5729c2d1b6b85b6_rle_crop_3996267782_0.png', 0, 231, 191, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194857_c0a09f5d5b62ae2de5729c2d1b6b85b6_rle_crop_3996267784_0.png', 0, 75, 101, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194857_c0a09f5d5b62ae2de5729c2d1b6b85b6_rle_crop_3996267783_0.png', 0, 133, 149, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194849_2ae36bcba212bc8e73f8e61eff82b5d5_rle_crop_3996267793_0.png', 0, 125, 125, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194831_b7d8fdafe1bc20d0838844e9cbb0d33a_rle_crop_3996267794_0.png', 0, 250, 142, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194830_13e37b706bc7dd668c08d501cc1aad49_rle_crop_3996267796_0.png', 0, 154, 88, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194828_2a562c1b09984b82d3f4d1b07005c28e_rle_crop_3996267800_0.png', 0, 113, 74, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194828_2a562c1b09984b82d3f4d1b07005c28e_rle_crop_3996267799_0.png', 0, 170, 112, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194825_9b972663dbf0cf7f12358d04e3bd9e6b_rle_crop_3996267806_0.png', 0, 145, 126, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194825_9b972663dbf0cf7f12358d04e3bd9e6b_rle_crop_3996267801_0.png', 0, 121, 79, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194825_9b972663dbf0cf7f12358d04e3bd9e6b_rle_crop_3996267802_0.png', 0, 60, 80, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194825_9b972663dbf0cf7f12358d04e3bd9e6b_rle_crop_3996267804_0.png', 0, 56, 78, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194801_082bd67346d312fd7c6e0b9ad7e98e3c_rle_crop_3996267807_0.png', 0, 110, 181, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194784_25cdae8c79b8ecb78672862ee4b9b91b_rle_crop_3996267811_0.png', 0, 89, 84, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194773_ffd2c9671420e97614c32653aa44c0d5_rle_crop_3996267814_0.png', 0, 68, 129, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194773_ffd2c9671420e97614c32653aa44c0d5_rle_crop_3996267818_0.png', 0, 163, 120, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194773_ffd2c9671420e97614c32653aa44c0d5_rle_crop_3996267816_0.png', 0, 57, 116, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194755_ac21daf8a080d7cc71340e2d286beffe_rle_crop_3996267824_0.png', 0, 197, 139, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194680_9415415b3cafe7736f1d87127cb5b572_rle_crop_3996267828_0.png', 0, 105, 119, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194680_9415415b3cafe7736f1d87127cb5b572_rle_crop_3996267827_0.png', 0, 94, 66, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194680_9415415b3cafe7736f1d87127cb5b572_rle_crop_3996267826_0.png', 0, 96, 82, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194680_9415415b3cafe7736f1d87127cb5b572_rle_crop_3996267825_0.png', 0, 137, 130, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194677_747be736ac7d7da57ac1b28e635e1a07_rle_crop_3996267834_0.png', 0, 128, 93, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194677_747be736ac7d7da57ac1b28e635e1a07_rle_crop_3996267829_0.png', 0, 140, 123, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358672), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194673_4302985ba11cb9979dc66203335f0fb1_rle_crop_3996267839_0.png', 0, 143, 132, 0, 1760358672,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 35 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.119124174118042 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760358677_2264696 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358678), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194900_fcc07c5bd26fd31400cf90d292c653b9_rle_crop_3996267766_0.png', 0, 157, 237, 0, 1760358678,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358678), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194776_8250bff7c267d873697ac2339dad72fa_rle_crop_3996267812_0.png', 0, 126, 91, 0, 1760358678,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358678), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194773_ffd2c9671420e97614c32653aa44c0d5_rle_crop_3996267819_0.png', 0, 91, 97, 0, 1760358678,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358678), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194677_747be736ac7d7da57ac1b28e635e1a07_rle_crop_3996267831_0.png', 0, 82, 87, 0, 1760358678,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358678), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194677_747be736ac7d7da57ac1b28e635e1a07_rle_crop_3996267832_0.png', 0, 337, 528, 0, 1760358678,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.7321248054504395 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760358680_2264696 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358680), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194673_4302985ba11cb9979dc66203335f0fb1_rle_crop_3996267837_0.png', 0, 95, 134, 0, 1760358680,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7295022010803223 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 34 About to insert : list_path_to_insert length 34 new photo from crops ! About to upload 34 photos upload in portfolio : 3736932 init cache_photo without model_param we have 34 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760358686_2264696 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194900_fcc07c5bd26fd31400cf90d292c653b9_rle_crop_3996267765_0.png', 0, 329, 516, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194880_87e0096176c6d1ffb9b3e5c7a6f61f18_rle_crop_3996267767_0.png', 0, 253, 128, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194880_87e0096176c6d1ffb9b3e5c7a6f61f18_rle_crop_3996267768_0.png', 0, 348, 524, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194863_a868c434f5089805d4678fa6ccbd850e_rle_crop_3996267777_0.png', 0, 149, 106, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194863_a868c434f5089805d4678fa6ccbd850e_rle_crop_3996267774_0.png', 0, 222, 155, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194863_a868c434f5089805d4678fa6ccbd850e_rle_crop_3996267776_0.png', 0, 152, 209, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194860_366ab7f081578bbc9af2ecf1b1d80a63_rle_crop_3996267780_0.png', 0, 340, 525, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194857_c0a09f5d5b62ae2de5729c2d1b6b85b6_rle_crop_3996267781_0.png', 0, 84, 47, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194854_4f9ebd80c81f48c7f654e14fb7582583_rle_crop_3996267787_0.png', 0, 148, 134, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194854_4f9ebd80c81f48c7f654e14fb7582583_rle_crop_3996267790_0.png', 0, 258, 133, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194854_4f9ebd80c81f48c7f654e14fb7582583_rle_crop_3996267789_0.png', 0, 193, 120, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194854_4f9ebd80c81f48c7f654e14fb7582583_rle_crop_3996267786_0.png', 0, 371, 134, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194854_4f9ebd80c81f48c7f654e14fb7582583_rle_crop_3996267785_0.png', 0, 236, 178, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194854_4f9ebd80c81f48c7f654e14fb7582583_rle_crop_3996267788_0.png', 0, 197, 119, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194849_2ae36bcba212bc8e73f8e61eff82b5d5_rle_crop_3996267791_0.png', 0, 153, 143, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194849_2ae36bcba212bc8e73f8e61eff82b5d5_rle_crop_3996267792_0.png', 0, 244, 164, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194831_b7d8fdafe1bc20d0838844e9cbb0d33a_rle_crop_3996267795_0.png', 0, 189, 183, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194830_13e37b706bc7dd668c08d501cc1aad49_rle_crop_3996267797_0.png', 0, 138, 227, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194830_13e37b706bc7dd668c08d501cc1aad49_rle_crop_3996267798_0.png', 0, 219, 239, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194825_9b972663dbf0cf7f12358d04e3bd9e6b_rle_crop_3996267805_0.png', 0, 155, 251, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194825_9b972663dbf0cf7f12358d04e3bd9e6b_rle_crop_3996267803_0.png', 0, 329, 532, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194784_25cdae8c79b8ecb78672862ee4b9b91b_rle_crop_3996267808_0.png', 0, 475, 357, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194784_25cdae8c79b8ecb78672862ee4b9b91b_rle_crop_3996267809_0.png', 0, 331, 564, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194776_8250bff7c267d873697ac2339dad72fa_rle_crop_3996267813_0.png', 0, 107, 167, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194773_ffd2c9671420e97614c32653aa44c0d5_rle_crop_3996267815_0.png', 0, 141, 186, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194773_ffd2c9671420e97614c32653aa44c0d5_rle_crop_3996267817_0.png', 0, 203, 91, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194765_0d676a031e88fccf7fb4f49134bc63ef_rle_crop_3996267821_0.png', 0, 148, 276, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194765_0d676a031e88fccf7fb4f49134bc63ef_rle_crop_3996267820_0.png', 0, 168, 111, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194755_ac21daf8a080d7cc71340e2d286beffe_rle_crop_3996267823_0.png', 0, 82, 59, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194677_747be736ac7d7da57ac1b28e635e1a07_rle_crop_3996267830_0.png', 0, 134, 65, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194677_747be736ac7d7da57ac1b28e635e1a07_rle_crop_3996267833_0.png', 0, 345, 266, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194673_4302985ba11cb9979dc66203335f0fb1_rle_crop_3996267835_0.png', 0, 159, 128, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194673_4302985ba11cb9979dc66203335f0fb1_rle_crop_3996267838_0.png', 0, 97, 104, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358697), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194673_4302985ba11cb9979dc66203335f0fb1_rle_crop_3996267836_0.png', 0, 167, 175, 0, 1760358697,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 34 photos in the portfolio 3736932 time of upload the photos Elapsed time : 14.804974555969238 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760358701_2264696 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358702), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194865_091f0b8419dd767d485c8362ae3a1f64_rle_crop_3996267772_0.png', 0, 130, 79, 0, 1760358702,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358702), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194755_ac21daf8a080d7cc71340e2d286beffe_rle_crop_3996267822_0.png', 0, 59, 111, 0, 1760358702,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1777839660644531 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760358703_2264696 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760358703), 0.0, 0.0, 14, '', 0, 0, '1760358629_2264696_1389194784_25cdae8c79b8ecb78672862ee4b9b91b_rle_crop_3996267810_0.png', 0, 136, 238, 0, 1760358703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7463774681091309 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1389194900, 1389194880, 1389194865, 1389194863, 1389194860, 1389194857, 1389194854, 1389194849, 1389194833, 1389194831, 1389194830, 1389194828, 1389194825, 1389194820, 1389194801, 1389194784, 1389194776, 1389194773, 1389194765, 1389194755, 1389194680, 1389194677, 1389194673] Looping around the photos to save general results len do output : 78 /1389220971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389220999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389221069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194900', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194880', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194865', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194863', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194860', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194857', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194854', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194849', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194833', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194831', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194830', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194828', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194825', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194820', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194801', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194784', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194776', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194773', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194765', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194755', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194680', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194677', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194673', None, None, None, None, None, '3933090') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 257 time used for this insertion : 0.0411224365234375 save_final save missing photos in datou_result : time spend for datou_step_exec : 40.559905767440796 time spend to save output : 0.04429364204406738 total time spend for step 2 : 40.60419940948486 step3:rle_unique_nms_with_priority Mon Oct 13 14:31:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 78 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.15624308586120605 time for calcul the mask position with numpy : 0.02429509162902832 nb_pixel_total : 1920843 time to create 1 rle with new method : 0.04398465156555176 time for calcul the mask position with numpy : 0.006406545639038086 nb_pixel_total : 10511 time to create 1 rle with old method : 0.011809587478637695 time for calcul the mask position with numpy : 0.0069963932037353516 nb_pixel_total : 106237 time to create 1 rle with old method : 0.1171419620513916 time for calcul the mask position with numpy : 0.0061435699462890625 nb_pixel_total : 5156 time to create 1 rle with old method : 0.005690097808837891 time for calcul the mask position with numpy : 0.006259441375732422 nb_pixel_total : 5673 time to create 1 rle with old method : 0.006104469299316406 time for calcul the mask position with numpy : 0.0062367916107177734 nb_pixel_total : 25180 time to create 1 rle with old method : 0.027325868606567383 create new chi : 0.27353572845458984 time to delete rle : 0.06793785095214844 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 3522 TO DO : save crop sub photo not yet done ! save time : 0.5085117816925049 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.049948930740356445 time for calcul the mask position with numpy : 0.01870131492614746 nb_pixel_total : 1930069 time to create 1 rle with new method : 0.03687620162963867 time for calcul the mask position with numpy : 0.006037235260009766 nb_pixel_total : 8425 time to create 1 rle with old method : 0.009034156799316406 time for calcul the mask position with numpy : 0.00652623176574707 nb_pixel_total : 111241 time to create 1 rle with old method : 0.11766362190246582 time for calcul the mask position with numpy : 0.006266117095947266 nb_pixel_total : 23865 time to create 1 rle with old method : 0.025691509246826172 create new chi : 0.2272028923034668 time to delete rle : 0.00038361549377441406 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2518 TO DO : save crop sub photo not yet done ! save time : 0.40009450912475586 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.05904722213745117 time for calcul the mask position with numpy : 0.022517681121826172 nb_pixel_total : 1972958 time to create 1 rle with new method : 0.03669261932373047 time for calcul the mask position with numpy : 0.005792856216430664 nb_pixel_total : 166 time to create 1 rle with old method : 0.00023937225341796875 time for calcul the mask position with numpy : 0.006535053253173828 nb_pixel_total : 8529 time to create 1 rle with old method : 0.009523630142211914 time for calcul the mask position with numpy : 0.006077289581298828 nb_pixel_total : 33150 time to create 1 rle with old method : 0.03539323806762695 time for calcul the mask position with numpy : 0.006331443786621094 nb_pixel_total : 58797 time to create 1 rle with old method : 0.0633094310760498 create new chi : 0.19311022758483887 time to delete rle : 0.0003616809844970703 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 2251 TO DO : save crop sub photo not yet done ! save time : 0.37092089653015137 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.09424352645874023 time for calcul the mask position with numpy : 0.025041580200195312 nb_pixel_total : 1990400 time to create 1 rle with new method : 0.04792356491088867 time for calcul the mask position with numpy : 0.0061419010162353516 nb_pixel_total : 16329 time to create 1 rle with old method : 0.017815589904785156 time for calcul the mask position with numpy : 0.006150245666503906 nb_pixel_total : 12540 time to create 1 rle with old method : 0.013336181640625 time for calcul the mask position with numpy : 0.005814552307128906 nb_pixel_total : 22734 time to create 1 rle with old method : 0.023821353912353516 time for calcul the mask position with numpy : 0.005674600601196289 nb_pixel_total : 4912 time to create 1 rle with old method : 0.0051288604736328125 time for calcul the mask position with numpy : 0.005670309066772461 nb_pixel_total : 26685 time to create 1 rle with old method : 0.02805328369140625 create new chi : 0.1958005428314209 time to delete rle : 0.0003840923309326172 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2378 TO DO : save crop sub photo not yet done ! save time : 0.36047816276550293 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04626798629760742 time for calcul the mask position with numpy : 0.018430233001708984 nb_pixel_total : 1955857 time to create 1 rle with new method : 0.04425978660583496 time for calcul the mask position with numpy : 0.006866455078125 nb_pixel_total : 108091 time to create 1 rle with old method : 0.11409854888916016 time for calcul the mask position with numpy : 0.006155967712402344 nb_pixel_total : 9652 time to create 1 rle with old method : 0.010218381881713867 create new chi : 0.20328569412231445 time to delete rle : 0.0004494190216064453 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2376 TO DO : save crop sub photo not yet done ! save time : 0.36545467376708984 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.07225537300109863 time for calcul the mask position with numpy : 0.022596359252929688 nb_pixel_total : 2030779 time to create 1 rle with new method : 0.03949904441833496 time for calcul the mask position with numpy : 0.005878925323486328 nb_pixel_total : 4667 time to create 1 rle with old method : 0.004701375961303711 time for calcul the mask position with numpy : 0.0057489871978759766 nb_pixel_total : 11160 time to create 1 rle with old method : 0.011358022689819336 time for calcul the mask position with numpy : 0.0058209896087646484 nb_pixel_total : 23918 time to create 1 rle with old method : 0.025308847427368164 time for calcul the mask position with numpy : 0.005961179733276367 nb_pixel_total : 3076 time to create 1 rle with old method : 0.003418445587158203 create new chi : 0.13506746292114258 time to delete rle : 0.0003361701965332031 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 2090 TO DO : save crop sub photo not yet done ! save time : 0.3532111644744873 nb_obj : 6 nb_hashtags : 1 time to prepare the origin masks : 0.08381438255310059 time for calcul the mask position with numpy : 0.022670745849609375 nb_pixel_total : 1929906 time to create 1 rle with new method : 0.04261374473571777 time for calcul the mask position with numpy : 0.006309986114501953 nb_pixel_total : 24075 time to create 1 rle with old method : 0.02620220184326172 time for calcul the mask position with numpy : 0.006140947341918945 nb_pixel_total : 17929 time to create 1 rle with old method : 0.01951313018798828 time for calcul the mask position with numpy : 0.005815982818603516 nb_pixel_total : 18214 time to create 1 rle with old method : 0.019302845001220703 time for calcul the mask position with numpy : 0.0056607723236083984 nb_pixel_total : 14699 time to create 1 rle with old method : 0.015931367874145508 time for calcul the mask position with numpy : 0.006079196929931641 nb_pixel_total : 39586 time to create 1 rle with old method : 0.043877363204956055 time for calcul the mask position with numpy : 0.006384611129760742 nb_pixel_total : 29191 time to create 1 rle with old method : 0.03171515464782715 create new chi : 0.2631962299346924 time to delete rle : 0.00027823448181152344 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 2781 TO DO : save crop sub photo not yet done ! save time : 0.4255068302154541 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05012106895446777 time for calcul the mask position with numpy : 0.01884627342224121 nb_pixel_total : 2020488 time to create 1 rle with new method : 0.04031682014465332 time for calcul the mask position with numpy : 0.005881547927856445 nb_pixel_total : 8866 time to create 1 rle with old method : 0.009378433227539062 time for calcul the mask position with numpy : 0.0059473514556884766 nb_pixel_total : 28720 time to create 1 rle with old method : 0.030205965042114258 time for calcul the mask position with numpy : 0.00583958625793457 nb_pixel_total : 15526 time to create 1 rle with old method : 0.016181468963623047 create new chi : 0.1370222568511963 time to delete rle : 0.00029921531677246094 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1990 TO DO : save crop sub photo not yet done ! save time : 0.39704418182373047 No data in photo_id : 1389194833 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.042014122009277344 time for calcul the mask position with numpy : 0.02323007583618164 nb_pixel_total : 2019488 time to create 1 rle with new method : 0.04055428504943848 time for calcul the mask position with numpy : 0.0060520172119140625 nb_pixel_total : 27643 time to create 1 rle with old method : 0.028530597686767578 time for calcul the mask position with numpy : 0.0057451725006103516 nb_pixel_total : 26469 time to create 1 rle with old method : 0.02779412269592285 create new chi : 0.1365947723388672 time to delete rle : 0.000301361083984375 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1810 TO DO : save crop sub photo not yet done ! save time : 0.3280823230743408 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05503582954406738 time for calcul the mask position with numpy : 0.02598428726196289 nb_pixel_total : 2018413 time to create 1 rle with new method : 0.043358564376831055 time for calcul the mask position with numpy : 0.0065042972564697266 nb_pixel_total : 30593 time to create 1 rle with old method : 0.033875226974487305 time for calcul the mask position with numpy : 0.0061833858489990234 nb_pixel_total : 16303 time to create 1 rle with old method : 0.018158674240112305 time for calcul the mask position with numpy : 0.0061757564544677734 nb_pixel_total : 8291 time to create 1 rle with old method : 0.009296894073486328 create new chi : 0.15448737144470215 time to delete rle : 0.0003943443298339844 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 2246 TO DO : save crop sub photo not yet done ! save time : 0.3627450466156006 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.042897939682006836 time for calcul the mask position with numpy : 0.02444911003112793 nb_pixel_total : 2061445 time to create 1 rle with new method : 0.03386330604553223 time for calcul the mask position with numpy : 0.0061147212982177734 nb_pixel_total : 3717 time to create 1 rle with old method : 0.004132509231567383 time for calcul the mask position with numpy : 0.005973339080810547 nb_pixel_total : 8438 time to create 1 rle with old method : 0.009432554244995117 create new chi : 0.08538651466369629 time to delete rle : 0.0002624988555908203 batch 1 Loaded 5 chid ids of type : 3594 +++++Number RLEs to save : 1502 TO DO : save crop sub photo not yet done ! save time : 0.3959536552429199 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.0845646858215332 time for calcul the mask position with numpy : 0.022983074188232422 nb_pixel_total : 1924819 time to create 1 rle with new method : 0.04118800163269043 time for calcul the mask position with numpy : 0.005908966064453125 nb_pixel_total : 10107 time to create 1 rle with old method : 0.010874509811401367 time for calcul the mask position with numpy : 0.005950927734375 nb_pixel_total : 11970 time to create 1 rle with old method : 0.013097763061523438 time for calcul the mask position with numpy : 0.009477853775024414 nb_pixel_total : 3445 time to create 1 rle with old method : 0.0528264045715332 time for calcul the mask position with numpy : 0.006818056106567383 nb_pixel_total : 111142 time to create 1 rle with old method : 0.11487126350402832 time for calcul the mask position with numpy : 0.005917072296142578 nb_pixel_total : 3884 time to create 1 rle with old method : 0.0041294097900390625 time for calcul the mask position with numpy : 0.005620479583740234 nb_pixel_total : 8233 time to create 1 rle with old method : 0.008524894714355469 create new chi : 0.313129186630249 time to delete rle : 0.0004925727844238281 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 3394 TO DO : save crop sub photo not yet done ! save time : 0.4711582660675049 No data in photo_id : 1389194820 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.032026052474975586 time for calcul the mask position with numpy : 0.020121097564697266 nb_pixel_total : 2059471 time to create 1 rle with new method : 0.028061628341674805 time for calcul the mask position with numpy : 0.0059909820556640625 nb_pixel_total : 14129 time to create 1 rle with old method : 0.015026330947875977 create new chi : 0.07036137580871582 time to delete rle : 0.00021791458129882812 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1442 TO DO : save crop sub photo not yet done ! save time : 0.2726426124572754 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.06259608268737793 time for calcul the mask position with numpy : 0.02235102653503418 nb_pixel_total : 1856036 time to create 1 rle with new method : 0.042328834533691406 time for calcul the mask position with numpy : 0.006119489669799805 nb_pixel_total : 4122 time to create 1 rle with old method : 0.00444340705871582 time for calcul the mask position with numpy : 0.005780935287475586 nb_pixel_total : 11709 time to create 1 rle with old method : 0.012906551361083984 time for calcul the mask position with numpy : 0.006841182708740234 nb_pixel_total : 104196 time to create 1 rle with old method : 0.11072421073913574 time for calcul the mask position with numpy : 0.00658416748046875 nb_pixel_total : 97537 time to create 1 rle with old method : 0.10694360733032227 create new chi : 0.3300020694732666 time to delete rle : 0.0006008148193359375 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3632 TO DO : save crop sub photo not yet done ! save time : 0.577967643737793 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.03832817077636719 time for calcul the mask position with numpy : 0.018534421920776367 nb_pixel_total : 2050261 time to create 1 rle with new method : 0.030842065811157227 time for calcul the mask position with numpy : 0.005934953689575195 nb_pixel_total : 14536 time to create 1 rle with old method : 0.015474796295166016 time for calcul the mask position with numpy : 0.005617856979370117 nb_pixel_total : 8803 time to create 1 rle with old method : 0.0093536376953125 create new chi : 0.08603501319885254 time to delete rle : 0.00031375885009765625 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1596 TO DO : save crop sub photo not yet done ! save time : 0.3149402141571045 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.08134698867797852 time for calcul the mask position with numpy : 0.02229022979736328 nb_pixel_total : 2008237 time to create 1 rle with new method : 0.049829959869384766 time for calcul the mask position with numpy : 0.006822347640991211 nb_pixel_total : 7472 time to create 1 rle with old method : 0.012457609176635742 time for calcul the mask position with numpy : 0.006319761276245117 nb_pixel_total : 16003 time to create 1 rle with old method : 0.018001794815063477 time for calcul the mask position with numpy : 0.006113290786743164 nb_pixel_total : 13949 time to create 1 rle with old method : 0.018480539321899414 time for calcul the mask position with numpy : 0.006574392318725586 nb_pixel_total : 4415 time to create 1 rle with old method : 0.007351398468017578 time for calcul the mask position with numpy : 0.006559610366821289 nb_pixel_total : 17987 time to create 1 rle with old method : 0.020139217376708984 time for calcul the mask position with numpy : 0.006053924560546875 nb_pixel_total : 5537 time to create 1 rle with old method : 0.006418704986572266 create new chi : 0.19952058792114258 time to delete rle : 0.00029087066650390625 batch 1 Loaded 13 chid ids of type : 3594 +++++++++Number RLEs to save : 2704 TO DO : save crop sub photo not yet done ! save time : 0.41006922721862793 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04441428184509277 time for calcul the mask position with numpy : 0.020865917205810547 nb_pixel_total : 2037456 time to create 1 rle with new method : 0.030317306518554688 time for calcul the mask position with numpy : 0.006923675537109375 nb_pixel_total : 23401 time to create 1 rle with old method : 0.026123523712158203 time for calcul the mask position with numpy : 0.0063648223876953125 nb_pixel_total : 12743 time to create 1 rle with old method : 0.014227628707885742 create new chi : 0.10519671440124512 time to delete rle : 0.00035309791564941406 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1874 TO DO : save crop sub photo not yet done ! save time : 0.3251655101776123 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.04534339904785156 time for calcul the mask position with numpy : 0.018844127655029297 nb_pixel_total : 2045146 time to create 1 rle with new method : 0.03173017501831055 time for calcul the mask position with numpy : 0.006130218505859375 nb_pixel_total : 19727 time to create 1 rle with old method : 0.021125078201293945 time for calcul the mask position with numpy : 0.005891323089599609 nb_pixel_total : 3727 time to create 1 rle with old method : 0.003958940505981445 time for calcul the mask position with numpy : 0.00558924674987793 nb_pixel_total : 5000 time to create 1 rle with old method : 0.005643606185913086 create new chi : 0.10030364990234375 time to delete rle : 0.0003123283386230469 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1698 TO DO : save crop sub photo not yet done ! save time : 0.392902135848999 nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 0.06519055366516113 time for calcul the mask position with numpy : 0.021781444549560547 nb_pixel_total : 2047600 time to create 1 rle with new method : 0.03897881507873535 time for calcul the mask position with numpy : 0.005838632583618164 nb_pixel_total : 6449 time to create 1 rle with old method : 0.00816488265991211 time for calcul the mask position with numpy : 0.01057744026184082 nb_pixel_total : 4444 time to create 1 rle with old method : 0.006133556365966797 time for calcul the mask position with numpy : 0.007690906524658203 nb_pixel_total : 3959 time to create 1 rle with old method : 0.004274129867553711 time for calcul the mask position with numpy : 0.011762619018554688 nb_pixel_total : 11148 time to create 1 rle with old method : 0.011556863784790039 create new chi : 0.12974762916564941 time to delete rle : 0.0005223751068115234 batch 1 Loaded 9 chid ids of type : 3594 +++++++Number RLEs to save : 1914 TO DO : save crop sub photo not yet done ! save time : 0.32036900520324707 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.1148834228515625 time for calcul the mask position with numpy : 0.02091217041015625 nb_pixel_total : 1868914 time to create 1 rle with new method : 0.04549098014831543 time for calcul the mask position with numpy : 0.006553173065185547 nb_pixel_total : 6031 time to create 1 rle with old method : 0.006390810012817383 time for calcul the mask position with numpy : 0.006531238555908203 nb_pixel_total : 69662 time to create 1 rle with old method : 0.07464313507080078 time for calcul the mask position with numpy : 0.0069501399993896484 nb_pixel_total : 105575 time to create 1 rle with old method : 0.11321091651916504 time for calcul the mask position with numpy : 0.006394386291503906 nb_pixel_total : 4857 time to create 1 rle with old method : 0.00526881217956543 time for calcul the mask position with numpy : 0.006463050842285156 nb_pixel_total : 7848 time to create 1 rle with old method : 0.008356094360351562 time for calcul the mask position with numpy : 0.006966590881347656 nb_pixel_total : 10713 time to create 1 rle with old method : 0.011647701263427734 create new chi : 0.3302786350250244 time to delete rle : 0.0005376338958740234 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 3420 TO DO : save crop sub photo not yet done ! save time : 0.49872422218322754 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.07740616798400879 time for calcul the mask position with numpy : 0.02375173568725586 nb_pixel_total : 2003215 time to create 1 rle with new method : 0.03580975532531738 time for calcul the mask position with numpy : 0.00615692138671875 nb_pixel_total : 11531 time to create 1 rle with old method : 0.012613773345947266 time for calcul the mask position with numpy : 0.0055735111236572266 nb_pixel_total : 8227 time to create 1 rle with old method : 0.00878763198852539 time for calcul the mask position with numpy : 0.0057561397552490234 nb_pixel_total : 10154 time to create 1 rle with old method : 0.01159048080444336 time for calcul the mask position with numpy : 0.005921602249145508 nb_pixel_total : 22664 time to create 1 rle with old method : 0.02438521385192871 time for calcul the mask position with numpy : 0.005961894989013672 nb_pixel_total : 17809 time to create 1 rle with old method : 0.01953911781311035 create new chi : 0.16888642311096191 time to delete rle : 0.0006682872772216797 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2446 TO DO : save crop sub photo not yet done ! save time : 0.37648987770080566 map_output_result : {1389194900: (0.0, 'Should be the crop_list due to order', 0), 1389194880: (0.0, 'Should be the crop_list due to order', 0), 1389194865: (0.0, 'Should be the crop_list due to order', 0), 1389194863: (0.0, 'Should be the crop_list due to order', 0), 1389194860: (0.0, 'Should be the crop_list due to order', 0), 1389194857: (0.0, 'Should be the crop_list due to order', 0), 1389194854: (0.0, 'Should be the crop_list due to order', 0), 1389194849: (0.0, 'Should be the crop_list due to order', 0), 1389194833: (0.0, 'Should be the crop_list due to order', 0.0), 1389194831: (0.0, 'Should be the crop_list due to order', 0), 1389194830: (0.0, 'Should be the crop_list due to order', 0), 1389194828: (0.0, 'Should be the crop_list due to order', 0), 1389194825: (0.0, 'Should be the crop_list due to order', 0), 1389194820: (0.0, 'Should be the crop_list due to order', 0.0), 1389194801: (0.0, 'Should be the crop_list due to order', 0), 1389194784: (0.0, 'Should be the crop_list due to order', 0), 1389194776: (0.0, 'Should be the crop_list due to order', 0), 1389194773: (0.0, 'Should be the crop_list due to order', 0), 1389194765: (0.0, 'Should be the crop_list due to order', 0), 1389194755: (0.0, 'Should be the crop_list due to order', 0), 1389194680: (0.0, 'Should be the crop_list due to order', 0), 1389194677: (0.0, 'Should be the crop_list due to order', 0), 1389194673: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1389194900, 1389194880, 1389194865, 1389194863, 1389194860, 1389194857, 1389194854, 1389194849, 1389194833, 1389194831, 1389194830, 1389194828, 1389194825, 1389194820, 1389194801, 1389194784, 1389194776, 1389194773, 1389194765, 1389194755, 1389194680, 1389194677, 1389194673] Looping around the photos to save general results len do output : 23 /1389194900.Didn't retrieve data . /1389194880.Didn't retrieve data . /1389194865.Didn't retrieve data . /1389194863.Didn't retrieve data . /1389194860.Didn't retrieve data . /1389194857.Didn't retrieve data . /1389194854.Didn't retrieve data . /1389194849.Didn't retrieve data . /1389194833.Didn't retrieve data . /1389194831.Didn't retrieve data . /1389194830.Didn't retrieve data . /1389194828.Didn't retrieve data . /1389194825.Didn't retrieve data . /1389194820.Didn't retrieve data . /1389194801.Didn't retrieve data . /1389194784.Didn't retrieve data . /1389194776.Didn't retrieve data . /1389194773.Didn't retrieve data . /1389194765.Didn't retrieve data . /1389194755.Didn't retrieve data . /1389194680.Didn't retrieve data . /1389194677.Didn't retrieve data . /1389194673.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194900', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194880', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194865', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194863', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194860', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194857', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194854', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194849', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194833', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194831', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194830', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194828', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194825', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194820', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194801', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194784', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194776', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194773', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194765', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194755', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194680', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194677', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194673', None, None, None, None, None, '3933090') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 69 time used for this insertion : 0.03679513931274414 save_final save missing photos in datou_result : time spend for datou_step_exec : 14.246887922286987 time spend to save output : 0.03783249855041504 total time spend for step 3 : 14.284720420837402 step4:ventilate_hashtags_in_portfolio Mon Oct 13 14:31:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 27756449 get user id for portfolio 27756449 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27756449 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','environnement','flou','carton','pet_fonce','background','papier','mal_croppe','autre','pet_clair','pehd')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27756449 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','environnement','flou','carton','pet_fonce','background','papier','mal_croppe','autre','pet_clair','pehd')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/27757480,27757481,27757482,27757483,27757484,27757485,27757486,27757487,27757488,27757489,27757490?tags=papier,pehd,pet_fonce,autre,metal,background,carton,pet_clair,environnement,flou,mal_croppe Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1389194900, 1389194880, 1389194865, 1389194863, 1389194860, 1389194857, 1389194854, 1389194849, 1389194833, 1389194831, 1389194830, 1389194828, 1389194825, 1389194820, 1389194801, 1389194784, 1389194776, 1389194773, 1389194765, 1389194755, 1389194680, 1389194677, 1389194673] Looping around the photos to save general results len do output : 1 /27756449. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194900', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194880', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194865', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194863', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194860', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194857', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194854', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194849', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194833', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194831', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194830', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194828', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194825', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194820', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194801', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194784', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194776', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194773', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194765', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194755', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194680', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194677', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194673', None, None, None, None, None, '3933090') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.03776717185974121 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7228269577026367 time spend to save output : 0.03820490837097168 total time spend for step 4 : 1.7610318660736084 step5:final Mon Oct 13 14:32:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1389194900: ('0.041711156427591586',), 1389194880: ('0.041711156427591586',), 1389194865: ('0.041711156427591586',), 1389194863: ('0.041711156427591586',), 1389194860: ('0.041711156427591586',), 1389194857: ('0.041711156427591586',), 1389194854: ('0.041711156427591586',), 1389194849: ('0.041711156427591586',), 1389194833: ('0.041711156427591586',), 1389194831: ('0.041711156427591586',), 1389194830: ('0.041711156427591586',), 1389194828: ('0.041711156427591586',), 1389194825: ('0.041711156427591586',), 1389194820: ('0.041711156427591586',), 1389194801: ('0.041711156427591586',), 1389194784: ('0.041711156427591586',), 1389194776: ('0.041711156427591586',), 1389194773: ('0.041711156427591586',), 1389194765: ('0.041711156427591586',), 1389194755: ('0.041711156427591586',), 1389194680: ('0.041711156427591586',), 1389194677: ('0.041711156427591586',), 1389194673: ('0.041711156427591586',)} new output for save of step final : {1389194900: ('0.041711156427591586',), 1389194880: ('0.041711156427591586',), 1389194865: ('0.041711156427591586',), 1389194863: ('0.041711156427591586',), 1389194860: ('0.041711156427591586',), 1389194857: ('0.041711156427591586',), 1389194854: ('0.041711156427591586',), 1389194849: ('0.041711156427591586',), 1389194833: ('0.041711156427591586',), 1389194831: ('0.041711156427591586',), 1389194830: ('0.041711156427591586',), 1389194828: ('0.041711156427591586',), 1389194825: ('0.041711156427591586',), 1389194820: ('0.041711156427591586',), 1389194801: ('0.041711156427591586',), 1389194784: ('0.041711156427591586',), 1389194776: ('0.041711156427591586',), 1389194773: ('0.041711156427591586',), 1389194765: ('0.041711156427591586',), 1389194755: ('0.041711156427591586',), 1389194680: ('0.041711156427591586',), 1389194677: ('0.041711156427591586',), 1389194673: ('0.041711156427591586',)} [1389194900, 1389194880, 1389194865, 1389194863, 1389194860, 1389194857, 1389194854, 1389194849, 1389194833, 1389194831, 1389194830, 1389194828, 1389194825, 1389194820, 1389194801, 1389194784, 1389194776, 1389194773, 1389194765, 1389194755, 1389194680, 1389194677, 1389194673] Looping around the photos to save general results len do output : 23 /1389194900.Didn't retrieve data . /1389194880.Didn't retrieve data . /1389194865.Didn't retrieve data . /1389194863.Didn't retrieve data . /1389194860.Didn't retrieve data . /1389194857.Didn't retrieve data . /1389194854.Didn't retrieve data . /1389194849.Didn't retrieve data . /1389194833.Didn't retrieve data . /1389194831.Didn't retrieve data . /1389194830.Didn't retrieve data . /1389194828.Didn't retrieve data . /1389194825.Didn't retrieve data . /1389194820.Didn't retrieve data . /1389194801.Didn't retrieve data . /1389194784.Didn't retrieve data . /1389194776.Didn't retrieve data . /1389194773.Didn't retrieve data . /1389194765.Didn't retrieve data . /1389194755.Didn't retrieve data . /1389194680.Didn't retrieve data . /1389194677.Didn't retrieve data . /1389194673.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194900', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194880', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194865', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194863', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194860', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194857', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194854', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194849', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194833', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194831', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194830', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194828', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194825', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194820', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194801', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194784', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194776', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194773', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194765', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194755', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194680', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194677', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194673', None, None, None, None, None, '3933090') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 69 time used for this insertion : 0.03799629211425781 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.3853886127471924 time spend to save output : 0.03911614418029785 total time spend for step 5 : 0.42450475692749023 step6:blur_detection Mon Oct 13 14:32:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1760358629_2264696_1389194900_fcc07c5bd26fd31400cf90d292c653b9.jpg resize: (1080, 1920) 1389194900 -3.5774664142940047 treat image : temp/1760358629_2264696_1389194880_87e0096176c6d1ffb9b3e5c7a6f61f18.jpg resize: (1080, 1920) 1389194880 5.327018600163741 treat image : temp/1760358629_2264696_1389194865_091f0b8419dd767d485c8362ae3a1f64.jpg resize: (1080, 1920) 1389194865 -3.3840068129349077 treat image : temp/1760358629_2264696_1389194863_a868c434f5089805d4678fa6ccbd850e.jpg resize: (1080, 1920) 1389194863 2.2242413343052214 treat image : temp/1760358629_2264696_1389194860_366ab7f081578bbc9af2ecf1b1d80a63.jpg resize: (1080, 1920) 1389194860 -2.4473570946709673 treat image : temp/1760358629_2264696_1389194857_c0a09f5d5b62ae2de5729c2d1b6b85b6.jpg resize: (1080, 1920) 1389194857 1.0902036745436956 treat image : temp/1760358629_2264696_1389194854_4f9ebd80c81f48c7f654e14fb7582583.jpg resize: (1080, 1920) 1389194854 -3.1770525530909186 treat image : temp/1760358629_2264696_1389194849_2ae36bcba212bc8e73f8e61eff82b5d5.jpg resize: (1080, 1920) 1389194849 -3.5181667851453255 treat image : temp/1760358629_2264696_1389194833_1f6e45c63fde8e58f95b8cc2ad441934.jpg resize: (1080, 1920) 1389194833 0.8376746706141559 treat image : temp/1760358629_2264696_1389194831_b7d8fdafe1bc20d0838844e9cbb0d33a.jpg resize: (1080, 1920) 1389194831 0.44016100601654284 treat image : temp/1760358629_2264696_1389194830_13e37b706bc7dd668c08d501cc1aad49.jpg resize: (1080, 1920) 1389194830 1.2042407064350609 treat image : temp/1760358629_2264696_1389194828_2a562c1b09984b82d3f4d1b07005c28e.jpg resize: (1080, 1920) 1389194828 0.7727699714829984 treat image : temp/1760358629_2264696_1389194825_9b972663dbf0cf7f12358d04e3bd9e6b.jpg resize: (1080, 1920) 1389194825 0.176913222221958 treat image : temp/1760358629_2264696_1389194820_4e2f19e6a2602e758aae7ff8d74f8b68.jpg resize: (1080, 1920) 1389194820 0.6965372838945499 treat image : temp/1760358629_2264696_1389194801_082bd67346d312fd7c6e0b9ad7e98e3c.jpg resize: (1080, 1920) 1389194801 2.461182982106167 treat image : temp/1760358629_2264696_1389194784_25cdae8c79b8ecb78672862ee4b9b91b.jpg resize: (1080, 1920) 1389194784 1.32633606380825 treat image : temp/1760358629_2264696_1389194776_8250bff7c267d873697ac2339dad72fa.jpg resize: (1080, 1920) 1389194776 1.2923875365875686 treat image : temp/1760358629_2264696_1389194773_ffd2c9671420e97614c32653aa44c0d5.jpg resize: (1080, 1920) 1389194773 0.280914981162001 treat image : temp/1760358629_2264696_1389194765_0d676a031e88fccf7fb4f49134bc63ef.jpg resize: (1080, 1920) 1389194765 0.9689764217839043 treat image : temp/1760358629_2264696_1389194755_ac21daf8a080d7cc71340e2d286beffe.jpg resize: (1080, 1920) 1389194755 2.0636972827868316 treat image : temp/1760358629_2264696_1389194680_9415415b3cafe7736f1d87127cb5b572.jpg resize: (1080, 1920) 1389194680 1.1985694016575439 treat image : temp/1760358629_2264696_1389194677_747be736ac7d7da57ac1b28e635e1a07.jpg resize: (1080, 1920) 1389194677 0.2613736207315501 treat image : temp/1760358629_2264696_1389194673_4302985ba11cb9979dc66203335f0fb1.jpg resize: (1080, 1920) 1389194673 0.9948198855868587 treat image : temp/1760358629_2264696_1389194900_fcc07c5bd26fd31400cf90d292c653b9_rle_crop_3996267762_0.png resize: (220, 270) 1389220971 -3.2589026303869715 treat image : temp/1760358629_2264696_1389194900_fcc07c5bd26fd31400cf90d292c653b9_rle_crop_3996267764_0.png resize: (92, 69) 1389220973 -3.6755978596432626 treat image : temp/1760358629_2264696_1389194900_fcc07c5bd26fd31400cf90d292c653b9_rle_crop_3996267763_0.png resize: (62, 133) 1389220974 -4.262285547502083 treat image : temp/1760358629_2264696_1389194880_87e0096176c6d1ffb9b3e5c7a6f61f18_rle_crop_3996267769_0.png resize: (65, 175) 1389220975 0.4127984338656769 treat image : temp/1760358629_2264696_1389194865_091f0b8419dd767d485c8362ae3a1f64_rle_crop_3996267770_0.png resize: (286, 263) 1389220976 -3.1377637551691957 treat image : temp/1760358629_2264696_1389194865_091f0b8419dd767d485c8362ae3a1f64_rle_crop_3996267771_0.png resize: (164, 296) 1389220977 -3.3736557967716423 treat image : temp/1760358629_2264696_1389194865_091f0b8419dd767d485c8362ae3a1f64_rle_crop_3996267773_0.png resize: (39, 74) 1389220978 0.40877656204334883 treat image : temp/1760358629_2264696_1389194863_a868c434f5089805d4678fa6ccbd850e_rle_crop_3996267778_0.png resize: (64, 402) 1389220979 -1.5537339376654438 treat image : temp/1760358629_2264696_1389194863_a868c434f5089805d4678fa6ccbd850e_rle_crop_3996267775_0.png resize: (97, 79) 1389220980 -1.7214850784268507 treat image : temp/1760358629_2264696_1389194860_366ab7f081578bbc9af2ecf1b1d80a63_rle_crop_3996267779_0.png resize: (123, 165) 1389220981 -1.7544661611655268 treat image : temp/1760358629_2264696_1389194857_c0a09f5d5b62ae2de5729c2d1b6b85b6_rle_crop_3996267782_0.png resize: (191, 231) 1389220982 -1.3394722832656005 treat image : temp/1760358629_2264696_1389194857_c0a09f5d5b62ae2de5729c2d1b6b85b6_rle_crop_3996267784_0.png resize: (101, 75) 1389220983 -0.8308896902039811 treat image : temp/1760358629_2264696_1389194857_c0a09f5d5b62ae2de5729c2d1b6b85b6_rle_crop_3996267783_0.png resize: (149, 133) 1389220984 -1.6849839906486566 treat image : temp/1760358629_2264696_1389194849_2ae36bcba212bc8e73f8e61eff82b5d5_rle_crop_3996267793_0.png resize: (125, 125) 1389220985 -4.312539578113919 treat image : temp/1760358629_2264696_1389194831_b7d8fdafe1bc20d0838844e9cbb0d33a_rle_crop_3996267794_0.png resize: (142, 250) 1389220986 -0.49300654694425605 treat image : temp/1760358629_2264696_1389194830_13e37b706bc7dd668c08d501cc1aad49_rle_crop_3996267796_0.png resize: (88, 154) 1389220987 -0.8745773607969405 treat image : temp/1760358629_2264696_1389194828_2a562c1b09984b82d3f4d1b07005c28e_rle_crop_3996267800_0.png resize: (74, 113) 1389220988 -0.7815711169338724 treat image : temp/1760358629_2264696_1389194828_2a562c1b09984b82d3f4d1b07005c28e_rle_crop_3996267799_0.png resize: (112, 170) 1389220989 -1.5471406580342892 treat image : temp/1760358629_2264696_1389194825_9b972663dbf0cf7f12358d04e3bd9e6b_rle_crop_3996267806_0.png resize: (126, 145) 1389220990 -2.0153604761157737 treat image : temp/1760358629_2264696_1389194825_9b972663dbf0cf7f12358d04e3bd9e6b_rle_crop_3996267801_0.png resize: (79, 121) 1389220991 1.876164905347168 treat image : temp/1760358629_2264696_1389194825_9b972663dbf0cf7f12358d04e3bd9e6b_rle_crop_3996267802_0.png resize: (80, 60) 1389220992 0.7786934016250321 treat image : temp/1760358629_2264696_1389194825_9b972663dbf0cf7f12358d04e3bd9e6b_rle_crop_3996267804_0.png resize: (78, 56) 1389220993 1.3050390947681778 treat image : temp/1760358629_2264696_1389194801_082bd67346d312fd7c6e0b9ad7e98e3c_rle_crop_3996267807_0.png resize: (181, 110) 1389220994 -0.9163106341299868 treat image : temp/1760358629_2264696_1389194784_25cdae8c79b8ecb78672862ee4b9b91b_rle_crop_3996267811_0.png resize: (84, 89) 1389220995 -0.6605037945052763 treat image : temp/1760358629_2264696_1389194773_ffd2c9671420e97614c32653aa44c0d5_rle_crop_3996267814_0.png resize: (129, 68) 1389220996 -1.4089788686990699 treat image : temp/1760358629_2264696_1389194773_ffd2c9671420e97614c32653aa44c0d5_rle_crop_3996267818_0.png resize: (120, 163) 1389220997 1.5310883218617168 treat image : temp/1760358629_2264696_1389194773_ffd2c9671420e97614c32653aa44c0d5_rle_crop_3996267816_0.png resize: (116, 57) 1389220998 -0.898775669575355 treat image : temp/1760358629_2264696_1389194755_ac21daf8a080d7cc71340e2d286beffe_rle_crop_3996267824_0.png resize: (139, 197) 1389220999 0.6155974308998218 treat image : temp/1760358629_2264696_1389194680_9415415b3cafe7736f1d87127cb5b572_rle_crop_3996267828_0.png resize: (119, 105) 1389221000 0.48708502592607644 treat image : temp/1760358629_2264696_1389194680_9415415b3cafe7736f1d87127cb5b572_rle_crop_3996267827_0.png resize: (66, 94) 1389221001 -0.274235084843007 treat image : temp/1760358629_2264696_1389194680_9415415b3cafe7736f1d87127cb5b572_rle_crop_3996267826_0.png resize: (82, 96) 1389221002 -1.1355557166023647 treat image : temp/1760358629_2264696_1389194680_9415415b3cafe7736f1d87127cb5b572_rle_crop_3996267825_0.png resize: (130, 137) 1389221003 -1.9837281354088832 treat image : temp/1760358629_2264696_1389194677_747be736ac7d7da57ac1b28e635e1a07_rle_crop_3996267834_0.png resize: (93, 128) 1389221004 -0.5386817761570026 treat image : temp/1760358629_2264696_1389194677_747be736ac7d7da57ac1b28e635e1a07_rle_crop_3996267829_0.png resize: (123, 140) 1389221005 -1.9206625792322551 treat image : temp/1760358629_2264696_1389194673_4302985ba11cb9979dc66203335f0fb1_rle_crop_3996267839_0.png resize: (132, 143) 1389221006 -2.0735636784901965 treat image : temp/1760358629_2264696_1389194900_fcc07c5bd26fd31400cf90d292c653b9_rle_crop_3996267766_0.png resize: (237, 157) 1389221008 -2.280280933496762 treat image : temp/1760358629_2264696_1389194776_8250bff7c267d873697ac2339dad72fa_rle_crop_3996267812_0.png resize: (91, 126) 1389221009 0.023020419685322414 treat image : temp/1760358629_2264696_1389194773_ffd2c9671420e97614c32653aa44c0d5_rle_crop_3996267819_0.png resize: (97, 91) 1389221010 2.9097441294561186 treat image : temp/1760358629_2264696_1389194677_747be736ac7d7da57ac1b28e635e1a07_rle_crop_3996267831_0.png resize: (87, 82) 1389221011 -1.215870592777228 treat image : temp/1760358629_2264696_1389194677_747be736ac7d7da57ac1b28e635e1a07_rle_crop_3996267832_0.png resize: (528, 337) 1389221012 0.24152138441617393 treat image : temp/1760358629_2264696_1389194673_4302985ba11cb9979dc66203335f0fb1_rle_crop_3996267837_0.png resize: (134, 95) 1389221014 -1.0178766713118286 treat image : temp/1760358629_2264696_1389194900_fcc07c5bd26fd31400cf90d292c653b9_rle_crop_3996267765_0.png resize: (516, 329) 1389221030 0.11728872629654576 treat image : temp/1760358629_2264696_1389194880_87e0096176c6d1ffb9b3e5c7a6f61f18_rle_crop_3996267767_0.png resize: (128, 253) 1389221031 0.5651914348350783 treat image : temp/1760358629_2264696_1389194880_87e0096176c6d1ffb9b3e5c7a6f61f18_rle_crop_3996267768_0.png resize: (524, 348) 1389221032 0.3054729651313161 treat image : temp/1760358629_2264696_1389194863_a868c434f5089805d4678fa6ccbd850e_rle_crop_3996267777_0.png resize: (106, 149) 1389221033 -0.2606237017329909 treat image : temp/1760358629_2264696_1389194863_a868c434f5089805d4678fa6ccbd850e_rle_crop_3996267774_0.png resize: (155, 222) 1389221034 0.2521320460950774 treat image : temp/1760358629_2264696_1389194863_a868c434f5089805d4678fa6ccbd850e_rle_crop_3996267776_0.png resize: (209, 152) 1389221035 -0.9012824447199619 treat image : temp/1760358629_2264696_1389194860_366ab7f081578bbc9af2ecf1b1d80a63_rle_crop_3996267780_0.png resize: (525, 340) 1389221036 0.29300277562566696 treat image : temp/1760358629_2264696_1389194857_c0a09f5d5b62ae2de5729c2d1b6b85b6_rle_crop_3996267781_0.png resize: (47, 84) 1389221037 0.13529619040711463 treat image : temp/1760358629_2264696_1389194854_4f9ebd80c81f48c7f654e14fb7582583_rle_crop_3996267787_0.png resize: (134, 148) 1389221039 -3.752759503376169 treat image : temp/1760358629_2264696_1389194854_4f9ebd80c81f48c7f654e14fb7582583_rle_crop_3996267790_0.png resize: (133, 258) 1389221040 -3.7021519656183286 treat image : temp/1760358629_2264696_1389194854_4f9ebd80c81f48c7f654e14fb7582583_rle_crop_3996267789_0.png resize: (120, 193) 1389221041 0.6327318940907697 treat image : temp/1760358629_2264696_1389194854_4f9ebd80c81f48c7f654e14fb7582583_rle_crop_3996267786_0.png resize: (134, 371) 1389221042 -3.361757873622368 treat image : temp/1760358629_2264696_1389194854_4f9ebd80c81f48c7f654e14fb7582583_rle_crop_3996267785_0.png resize: (178, 236) 1389221043 -1.4013924611334458 treat image : temp/1760358629_2264696_1389194854_4f9ebd80c81f48c7f654e14fb7582583_rle_crop_3996267788_0.png resize: (119, 197) 1389221045 -1.5278457737092124 treat image : temp/1760358629_2264696_1389194849_2ae36bcba212bc8e73f8e61eff82b5d5_rle_crop_3996267791_0.png resize: (143, 153) 1389221046 -3.89132167890569 treat image : temp/1760358629_2264696_1389194849_2ae36bcba212bc8e73f8e61eff82b5d5_rle_crop_3996267792_0.png resize: (164, 244) 1389221047 -2.148615451043555 treat image : temp/1760358629_2264696_1389194831_b7d8fdafe1bc20d0838844e9cbb0d33a_rle_crop_3996267795_0.png resize: (183, 189) 1389221048 -0.7001141014862066 treat image : temp/1760358629_2264696_1389194830_13e37b706bc7dd668c08d501cc1aad49_rle_crop_3996267797_0.png resize: (227, 138) 1389221049 -2.3937933439593038 treat image : temp/1760358629_2264696_1389194830_13e37b706bc7dd668c08d501cc1aad49_rle_crop_3996267798_0.png resize: (239, 219) 1389221050 -0.6925402039548082 treat image : temp/1760358629_2264696_1389194825_9b972663dbf0cf7f12358d04e3bd9e6b_rle_crop_3996267805_0.png resize: (251, 155) 1389221051 -2.139876865867591 treat image : temp/1760358629_2264696_1389194825_9b972663dbf0cf7f12358d04e3bd9e6b_rle_crop_3996267803_0.png resize: (532, 329) 1389221052 0.10982759701468327 treat image : temp/1760358629_2264696_1389194784_25cdae8c79b8ecb78672862ee4b9b91b_rle_crop_3996267808_0.png resize: (357, 475) 1389221053 -0.5908992637688076 treat image : temp/1760358629_2264696_1389194784_25cdae8c79b8ecb78672862ee4b9b91b_rle_crop_3996267809_0.png resize: (564, 331) 1389221054 -0.176304014322268 treat image : temp/1760358629_2264696_1389194776_8250bff7c267d873697ac2339dad72fa_rle_crop_3996267813_0.png resize: (167, 107) 1389221055 0.5575543464687722 treat image : temp/1760358629_2264696_1389194773_ffd2c9671420e97614c32653aa44c0d5_rle_crop_3996267815_0.png resize: (186, 141) 1389221056 -0.17535498275871417 treat image : temp/1760358629_2264696_1389194773_ffd2c9671420e97614c32653aa44c0d5_rle_crop_3996267817_0.png resize: (91, 203) 1389221057 -2.392723706138112 treat image : temp/1760358629_2264696_1389194765_0d676a031e88fccf7fb4f49134bc63ef_rle_crop_3996267821_0.png resize: (276, 148) 1389221058 -1.2997720574446487 treat image : temp/1760358629_2264696_1389194765_0d676a031e88fccf7fb4f49134bc63ef_rle_crop_3996267820_0.png resize: (111, 168) 1389221059 -0.861924139316654 treat image : temp/1760358629_2264696_1389194755_ac21daf8a080d7cc71340e2d286beffe_rle_crop_3996267823_0.png resize: (59, 82) 1389221060 0.49535730411578655 treat image : temp/1760358629_2264696_1389194677_747be736ac7d7da57ac1b28e635e1a07_rle_crop_3996267830_0.png resize: (65, 134) 1389221061 0.9785922882419722 treat image : temp/1760358629_2264696_1389194677_747be736ac7d7da57ac1b28e635e1a07_rle_crop_3996267833_0.png resize: (266, 345) 1389221062 -0.09645217233271959 treat image : temp/1760358629_2264696_1389194673_4302985ba11cb9979dc66203335f0fb1_rle_crop_3996267835_0.png resize: (128, 159) 1389221063 2.1307397955037053 treat image : temp/1760358629_2264696_1389194673_4302985ba11cb9979dc66203335f0fb1_rle_crop_3996267838_0.png resize: (104, 97) 1389221064 -0.6872633012304072 treat image : temp/1760358629_2264696_1389194673_4302985ba11cb9979dc66203335f0fb1_rle_crop_3996267836_0.png resize: (175, 167) 1389221065 0.056024302771923475 treat image : temp/1760358629_2264696_1389194865_091f0b8419dd767d485c8362ae3a1f64_rle_crop_3996267772_0.png resize: (79, 130) 1389221067 -4.1805939361425155 treat image : temp/1760358629_2264696_1389194755_ac21daf8a080d7cc71340e2d286beffe_rle_crop_3996267822_0.png resize: (111, 59) 1389221068 0.6474451400021605 treat image : temp/1760358629_2264696_1389194784_25cdae8c79b8ecb78672862ee4b9b91b_rle_crop_3996267810_0.png resize: (238, 136) 1389221069 -1.5933989554907777 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 101 time used for this insertion : 0.10266423225402832 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 101 time used for this insertion : 0.07298064231872559 save missing photos in datou_result : time spend for datou_step_exec : 18.787874698638916 time spend to save output : 0.1924905776977539 total time spend for step 6 : 18.98036527633667 step7:brightness Mon Oct 13 14:32:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1760358629_2264696_1389194900_fcc07c5bd26fd31400cf90d292c653b9.jpg treat image : temp/1760358629_2264696_1389194880_87e0096176c6d1ffb9b3e5c7a6f61f18.jpg treat image : temp/1760358629_2264696_1389194865_091f0b8419dd767d485c8362ae3a1f64.jpg treat image : temp/1760358629_2264696_1389194863_a868c434f5089805d4678fa6ccbd850e.jpg treat image : temp/1760358629_2264696_1389194860_366ab7f081578bbc9af2ecf1b1d80a63.jpg treat image : temp/1760358629_2264696_1389194857_c0a09f5d5b62ae2de5729c2d1b6b85b6.jpg treat image : temp/1760358629_2264696_1389194854_4f9ebd80c81f48c7f654e14fb7582583.jpg treat image : temp/1760358629_2264696_1389194849_2ae36bcba212bc8e73f8e61eff82b5d5.jpg treat image : temp/1760358629_2264696_1389194833_1f6e45c63fde8e58f95b8cc2ad441934.jpg treat image : temp/1760358629_2264696_1389194831_b7d8fdafe1bc20d0838844e9cbb0d33a.jpg treat image : temp/1760358629_2264696_1389194830_13e37b706bc7dd668c08d501cc1aad49.jpg treat image : temp/1760358629_2264696_1389194828_2a562c1b09984b82d3f4d1b07005c28e.jpg treat image : temp/1760358629_2264696_1389194825_9b972663dbf0cf7f12358d04e3bd9e6b.jpg treat image : temp/1760358629_2264696_1389194820_4e2f19e6a2602e758aae7ff8d74f8b68.jpg treat image : temp/1760358629_2264696_1389194801_082bd67346d312fd7c6e0b9ad7e98e3c.jpg treat image : temp/1760358629_2264696_1389194784_25cdae8c79b8ecb78672862ee4b9b91b.jpg treat image : temp/1760358629_2264696_1389194776_8250bff7c267d873697ac2339dad72fa.jpg treat image : temp/1760358629_2264696_1389194773_ffd2c9671420e97614c32653aa44c0d5.jpg treat image : temp/1760358629_2264696_1389194765_0d676a031e88fccf7fb4f49134bc63ef.jpg treat image : temp/1760358629_2264696_1389194755_ac21daf8a080d7cc71340e2d286beffe.jpg treat image : temp/1760358629_2264696_1389194680_9415415b3cafe7736f1d87127cb5b572.jpg treat image : temp/1760358629_2264696_1389194677_747be736ac7d7da57ac1b28e635e1a07.jpg treat image : temp/1760358629_2264696_1389194673_4302985ba11cb9979dc66203335f0fb1.jpg treat image : temp/1760358629_2264696_1389194900_fcc07c5bd26fd31400cf90d292c653b9_rle_crop_3996267762_0.png treat image : temp/1760358629_2264696_1389194900_fcc07c5bd26fd31400cf90d292c653b9_rle_crop_3996267764_0.png treat image : temp/1760358629_2264696_1389194900_fcc07c5bd26fd31400cf90d292c653b9_rle_crop_3996267763_0.png treat image : temp/1760358629_2264696_1389194880_87e0096176c6d1ffb9b3e5c7a6f61f18_rle_crop_3996267769_0.png treat image : temp/1760358629_2264696_1389194865_091f0b8419dd767d485c8362ae3a1f64_rle_crop_3996267770_0.png treat image : temp/1760358629_2264696_1389194865_091f0b8419dd767d485c8362ae3a1f64_rle_crop_3996267771_0.png treat image : temp/1760358629_2264696_1389194865_091f0b8419dd767d485c8362ae3a1f64_rle_crop_3996267773_0.png treat image : temp/1760358629_2264696_1389194863_a868c434f5089805d4678fa6ccbd850e_rle_crop_3996267778_0.png treat image : temp/1760358629_2264696_1389194863_a868c434f5089805d4678fa6ccbd850e_rle_crop_3996267775_0.png treat image : temp/1760358629_2264696_1389194860_366ab7f081578bbc9af2ecf1b1d80a63_rle_crop_3996267779_0.png treat image : temp/1760358629_2264696_1389194857_c0a09f5d5b62ae2de5729c2d1b6b85b6_rle_crop_3996267782_0.png treat image : temp/1760358629_2264696_1389194857_c0a09f5d5b62ae2de5729c2d1b6b85b6_rle_crop_3996267784_0.png treat image : temp/1760358629_2264696_1389194857_c0a09f5d5b62ae2de5729c2d1b6b85b6_rle_crop_3996267783_0.png treat image : temp/1760358629_2264696_1389194849_2ae36bcba212bc8e73f8e61eff82b5d5_rle_crop_3996267793_0.png treat image : temp/1760358629_2264696_1389194831_b7d8fdafe1bc20d0838844e9cbb0d33a_rle_crop_3996267794_0.png treat image : temp/1760358629_2264696_1389194830_13e37b706bc7dd668c08d501cc1aad49_rle_crop_3996267796_0.png treat image : temp/1760358629_2264696_1389194828_2a562c1b09984b82d3f4d1b07005c28e_rle_crop_3996267800_0.png treat image : temp/1760358629_2264696_1389194828_2a562c1b09984b82d3f4d1b07005c28e_rle_crop_3996267799_0.png treat image : temp/1760358629_2264696_1389194825_9b972663dbf0cf7f12358d04e3bd9e6b_rle_crop_3996267806_0.png treat image : temp/1760358629_2264696_1389194825_9b972663dbf0cf7f12358d04e3bd9e6b_rle_crop_3996267801_0.png treat image : temp/1760358629_2264696_1389194825_9b972663dbf0cf7f12358d04e3bd9e6b_rle_crop_3996267802_0.png treat image : temp/1760358629_2264696_1389194825_9b972663dbf0cf7f12358d04e3bd9e6b_rle_crop_3996267804_0.png treat image : temp/1760358629_2264696_1389194801_082bd67346d312fd7c6e0b9ad7e98e3c_rle_crop_3996267807_0.png treat image : temp/1760358629_2264696_1389194784_25cdae8c79b8ecb78672862ee4b9b91b_rle_crop_3996267811_0.png treat image : temp/1760358629_2264696_1389194773_ffd2c9671420e97614c32653aa44c0d5_rle_crop_3996267814_0.png treat image : temp/1760358629_2264696_1389194773_ffd2c9671420e97614c32653aa44c0d5_rle_crop_3996267818_0.png treat image : temp/1760358629_2264696_1389194773_ffd2c9671420e97614c32653aa44c0d5_rle_crop_3996267816_0.png treat image : temp/1760358629_2264696_1389194755_ac21daf8a080d7cc71340e2d286beffe_rle_crop_3996267824_0.png treat image : temp/1760358629_2264696_1389194680_9415415b3cafe7736f1d87127cb5b572_rle_crop_3996267828_0.png treat image : temp/1760358629_2264696_1389194680_9415415b3cafe7736f1d87127cb5b572_rle_crop_3996267827_0.png treat image : temp/1760358629_2264696_1389194680_9415415b3cafe7736f1d87127cb5b572_rle_crop_3996267826_0.png treat image : temp/1760358629_2264696_1389194680_9415415b3cafe7736f1d87127cb5b572_rle_crop_3996267825_0.png treat image : temp/1760358629_2264696_1389194677_747be736ac7d7da57ac1b28e635e1a07_rle_crop_3996267834_0.png treat image : temp/1760358629_2264696_1389194677_747be736ac7d7da57ac1b28e635e1a07_rle_crop_3996267829_0.png treat image : temp/1760358629_2264696_1389194673_4302985ba11cb9979dc66203335f0fb1_rle_crop_3996267839_0.png treat image : temp/1760358629_2264696_1389194900_fcc07c5bd26fd31400cf90d292c653b9_rle_crop_3996267766_0.png treat image : temp/1760358629_2264696_1389194776_8250bff7c267d873697ac2339dad72fa_rle_crop_3996267812_0.png treat image : temp/1760358629_2264696_1389194773_ffd2c9671420e97614c32653aa44c0d5_rle_crop_3996267819_0.png treat image : temp/1760358629_2264696_1389194677_747be736ac7d7da57ac1b28e635e1a07_rle_crop_3996267831_0.png treat image : temp/1760358629_2264696_1389194677_747be736ac7d7da57ac1b28e635e1a07_rle_crop_3996267832_0.png treat image : temp/1760358629_2264696_1389194673_4302985ba11cb9979dc66203335f0fb1_rle_crop_3996267837_0.png treat image : temp/1760358629_2264696_1389194900_fcc07c5bd26fd31400cf90d292c653b9_rle_crop_3996267765_0.png treat image : temp/1760358629_2264696_1389194880_87e0096176c6d1ffb9b3e5c7a6f61f18_rle_crop_3996267767_0.png treat image : temp/1760358629_2264696_1389194880_87e0096176c6d1ffb9b3e5c7a6f61f18_rle_crop_3996267768_0.png treat image : temp/1760358629_2264696_1389194863_a868c434f5089805d4678fa6ccbd850e_rle_crop_3996267777_0.png treat image : temp/1760358629_2264696_1389194863_a868c434f5089805d4678fa6ccbd850e_rle_crop_3996267774_0.png treat image : temp/1760358629_2264696_1389194863_a868c434f5089805d4678fa6ccbd850e_rle_crop_3996267776_0.png treat image : temp/1760358629_2264696_1389194860_366ab7f081578bbc9af2ecf1b1d80a63_rle_crop_3996267780_0.png treat image : temp/1760358629_2264696_1389194857_c0a09f5d5b62ae2de5729c2d1b6b85b6_rle_crop_3996267781_0.png treat image : temp/1760358629_2264696_1389194854_4f9ebd80c81f48c7f654e14fb7582583_rle_crop_3996267787_0.png treat image : temp/1760358629_2264696_1389194854_4f9ebd80c81f48c7f654e14fb7582583_rle_crop_3996267790_0.png treat image : temp/1760358629_2264696_1389194854_4f9ebd80c81f48c7f654e14fb7582583_rle_crop_3996267789_0.png treat image : temp/1760358629_2264696_1389194854_4f9ebd80c81f48c7f654e14fb7582583_rle_crop_3996267786_0.png treat image : temp/1760358629_2264696_1389194854_4f9ebd80c81f48c7f654e14fb7582583_rle_crop_3996267785_0.png treat image : temp/1760358629_2264696_1389194854_4f9ebd80c81f48c7f654e14fb7582583_rle_crop_3996267788_0.png treat image : temp/1760358629_2264696_1389194849_2ae36bcba212bc8e73f8e61eff82b5d5_rle_crop_3996267791_0.png treat image : temp/1760358629_2264696_1389194849_2ae36bcba212bc8e73f8e61eff82b5d5_rle_crop_3996267792_0.png treat image : temp/1760358629_2264696_1389194831_b7d8fdafe1bc20d0838844e9cbb0d33a_rle_crop_3996267795_0.png treat image : temp/1760358629_2264696_1389194830_13e37b706bc7dd668c08d501cc1aad49_rle_crop_3996267797_0.png treat image : temp/1760358629_2264696_1389194830_13e37b706bc7dd668c08d501cc1aad49_rle_crop_3996267798_0.png treat image : temp/1760358629_2264696_1389194825_9b972663dbf0cf7f12358d04e3bd9e6b_rle_crop_3996267805_0.png treat image : temp/1760358629_2264696_1389194825_9b972663dbf0cf7f12358d04e3bd9e6b_rle_crop_3996267803_0.png treat image : temp/1760358629_2264696_1389194784_25cdae8c79b8ecb78672862ee4b9b91b_rle_crop_3996267808_0.png treat image : temp/1760358629_2264696_1389194784_25cdae8c79b8ecb78672862ee4b9b91b_rle_crop_3996267809_0.png treat image : temp/1760358629_2264696_1389194776_8250bff7c267d873697ac2339dad72fa_rle_crop_3996267813_0.png treat image : temp/1760358629_2264696_1389194773_ffd2c9671420e97614c32653aa44c0d5_rle_crop_3996267815_0.png treat image : temp/1760358629_2264696_1389194773_ffd2c9671420e97614c32653aa44c0d5_rle_crop_3996267817_0.png treat image : temp/1760358629_2264696_1389194765_0d676a031e88fccf7fb4f49134bc63ef_rle_crop_3996267821_0.png treat image : temp/1760358629_2264696_1389194765_0d676a031e88fccf7fb4f49134bc63ef_rle_crop_3996267820_0.png treat image : temp/1760358629_2264696_1389194755_ac21daf8a080d7cc71340e2d286beffe_rle_crop_3996267823_0.png treat image : temp/1760358629_2264696_1389194677_747be736ac7d7da57ac1b28e635e1a07_rle_crop_3996267830_0.png treat image : temp/1760358629_2264696_1389194677_747be736ac7d7da57ac1b28e635e1a07_rle_crop_3996267833_0.png treat image : temp/1760358629_2264696_1389194673_4302985ba11cb9979dc66203335f0fb1_rle_crop_3996267835_0.png treat image : temp/1760358629_2264696_1389194673_4302985ba11cb9979dc66203335f0fb1_rle_crop_3996267838_0.png treat image : temp/1760358629_2264696_1389194673_4302985ba11cb9979dc66203335f0fb1_rle_crop_3996267836_0.png treat image : temp/1760358629_2264696_1389194865_091f0b8419dd767d485c8362ae3a1f64_rle_crop_3996267772_0.png treat image : temp/1760358629_2264696_1389194755_ac21daf8a080d7cc71340e2d286beffe_rle_crop_3996267822_0.png treat image : temp/1760358629_2264696_1389194784_25cdae8c79b8ecb78672862ee4b9b91b_rle_crop_3996267810_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 101 time used for this insertion : 0.11911749839782715 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 101 time used for this insertion : 0.07301855087280273 save missing photos in datou_result : time spend for datou_step_exec : 5.643577814102173 time spend to save output : 0.21043705940246582 total time spend for step 7 : 5.854014873504639 step8:velours_tree Mon Oct 13 14:32:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09853720664978027 time spend to save output : 4.172325134277344e-05 total time spend for step 8 : 0.09857892990112305 step9:send_mail_cod Mon Oct 13 14:32:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P27756449_13-10-2025_14_32_25.pdf 27757480 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette277574801760358745 27757481 change filename to text .change filename to text .change filename to text .change filename to text .imagette277574811760358747 27757482 change filename to text .imagette277574821760358747 27757483 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette277574831760358747 27757484 change filename to text .change filename to text .change filename to text .imagette277574841760358748 27757485 imagette277574851760358748 27757486 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette277574861760358748 27757487 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette277574871760358750 27757489 imagette277574891760358752 27757490 imagette277574901760358752 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=27756449 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/27757480,27757481,27757482,27757483,27757484,27757485,27757486,27757487,27757488,27757489,27757490?tags=papier,pehd,pet_fonce,autre,metal,background,carton,pet_clair,environnement,flou,mal_croppe args[1389194900] : ((1389194900, -3.5774664142940047, 492609224), (1389194900, 0.2957806491883046, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com args[1389194880] : ((1389194880, 5.327018600163741, 492688767), (1389194880, 0.19100101276891412, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com args[1389194865] : ((1389194865, -3.3840068129349077, 492609224), (1389194865, 0.46986217761515825, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com args[1389194863] : ((1389194863, 2.2242413343052214, 492688767), (1389194863, 0.6500857619390644, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com args[1389194860] : ((1389194860, -2.4473570946709673, 492609224), (1389194860, 0.4243677915006405, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com args[1389194857] : ((1389194857, 1.0902036745436956, 492688767), (1389194857, 0.7502659636176136, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com args[1389194854] : ((1389194854, -3.1770525530909186, 492609224), (1389194854, 0.624890935143259, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com args[1389194849] : ((1389194849, -3.5181667851453255, 492609224), (1389194849, 0.21634238889675778, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com args[1389194833] : ((1389194833, 0.8376746706141559, 492688767), (1389194833, 0.7924777263683811, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com args[1389194831] : ((1389194831, 0.44016100601654284, 492688767), (1389194831, 0.7150428313188255, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com args[1389194830] : ((1389194830, 1.2042407064350609, 492688767), (1389194830, 0.9801920231515461, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com args[1389194828] : ((1389194828, 0.7727699714829984, 492688767), (1389194828, 0.8852454195235736, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com args[1389194825] : ((1389194825, 0.176913222221958, 492688767), (1389194825, 0.4417129337693806, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com args[1389194820] : ((1389194820, 0.6965372838945499, 492688767), (1389194820, 0.7106600114059509, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com args[1389194801] : ((1389194801, 2.461182982106167, 492688767), (1389194801, 0.7081953451007543, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com args[1389194784] : ((1389194784, 1.32633606380825, 492688767), (1389194784, 0.6948846172953098, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com args[1389194776] : ((1389194776, 1.2923875365875686, 492688767), (1389194776, 0.6388179732499588, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com args[1389194773] : ((1389194773, 0.280914981162001, 492688767), (1389194773, 0.6577714391937982, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com args[1389194765] : ((1389194765, 0.9689764217839043, 492688767), (1389194765, 0.42643597721247145, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com args[1389194755] : ((1389194755, 2.0636972827868316, 492688767), (1389194755, 0.5883412863240307, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com args[1389194680] : ((1389194680, 1.1985694016575439, 492688767), (1389194680, 0.3770506480234452, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com args[1389194677] : ((1389194677, 0.2613736207315501, 492688767), (1389194677, 0.45724243487196387, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com args[1389194673] : ((1389194673, 0.9948198855868587, 492688767), (1389194673, 0.5633024153015463, 2107752395), '0.041711156427591586') We are sending mail with results at report@fotonower.com refus_total : 0.041711156427591586 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=27756449 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27756449_13-10-2025_14_32_25.pdf results_Auto_P27756449_13-10-2025_14_32_25.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27756449_13-10-2025_14_32_25.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','27756449','results_Auto_P27756449_13-10-2025_14_32_25.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27756449_13-10-2025_14_32_25.pdf','pdf','','0.4','0.041711156427591586') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/27756449

https://www.fotonower.com/image?json=false&list_photos_id=1389194900
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389194880
La photo est trop floue, merci de reprendre une photo.(avec le score = 5.327018600163741)
https://www.fotonower.com/image?json=false&list_photos_id=1389194865
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389194863
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.2242413343052214)
https://www.fotonower.com/image?json=false&list_photos_id=1389194860
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389194857
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.0902036745436956)
https://www.fotonower.com/image?json=false&list_photos_id=1389194854
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389194849
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389194833
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389194831
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389194830
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.2042407064350609)
https://www.fotonower.com/image?json=false&list_photos_id=1389194828
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389194825
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389194820
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389194801
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.461182982106167)
https://www.fotonower.com/image?json=false&list_photos_id=1389194784
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.32633606380825)
https://www.fotonower.com/image?json=false&list_photos_id=1389194776
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.2923875365875686)
https://www.fotonower.com/image?json=false&list_photos_id=1389194773
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389194765
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389194755
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.0636972827868316)
https://www.fotonower.com/image?json=false&list_photos_id=1389194680
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.1985694016575439)
https://www.fotonower.com/image?json=false&list_photos_id=1389194677
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389194673
La photo est trop floue, merci de reprendre une photo.(avec le score = 0.9948198855868587)

Dans ces conditions,le taux de refus est: 4.17%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/27757480?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/27757481?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/27757482?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/27757483?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/27757484?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/27757486?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/27757487?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27756449_13-10-2025_14_32_25.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/27757480,27757481,27757482,27757483,27757484,27757485,27757486,27757487,27757488,27757489,27757490?tags=papier,pehd,pet_fonce,autre,metal,background,carton,pet_clair,environnement,flou,mal_croppe.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 13 Oct 2025 12:32:35 GMT Content-Length: 0 Connection: close X-Message-Id: r8ZvqdxfSxm3ScO-GP933A Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1389194900, 1389194880, 1389194865, 1389194863, 1389194860, 1389194857, 1389194854, 1389194849, 1389194833, 1389194831, 1389194830, 1389194828, 1389194825, 1389194820, 1389194801, 1389194784, 1389194776, 1389194773, 1389194765, 1389194755, 1389194680, 1389194677, 1389194673] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194900', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194880', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194865', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194863', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194860', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194857', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194854', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194849', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194833', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194831', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194830', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194828', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194825', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194820', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194801', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194784', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194776', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194773', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194765', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194755', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194680', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194677', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194673', None, None, None, None, None, '3933090') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 23 time used for this insertion : 0.04118776321411133 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.504223108291626 time spend to save output : 0.04142928123474121 total time spend for step 9 : 9.545652389526367 step10:split_time_score Mon Oct 13 14:32:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 63),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 13102025 27756449 Nombre de photos uploadées : 63 / 23040 (0%) 13102025 27756449 Nombre de photos taguées (types de déchets): 0 / 63 (0%) 13102025 27756449 Nombre de photos taguées (volume) : 0 / 63 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.4836273193359375e-06 ??????????????????????????????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.002732515335083008 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.6526923179626465 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.0486033950617284 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27749759_13-10-2025_10_31_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27749759 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27749759 AND mptpi.`type`=3594 To do Qualite : 0.05129379734848485 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27749761_13-10-2025_10_21_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27749761 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27749761 AND mptpi.`type`=3594 To do Qualite : 0.044068443769290117 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27756449_13-10-2025_14_32_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27756449 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27756449 AND mptpi.`type`=3594 To do Qualite : 0.0960733989197531 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27756454_13-10-2025_13_51_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27756454 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27756454 AND mptpi.`type`=3594 To do Qualite : 0.08950602445394115 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27756455_13-10-2025_14_01_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27756455 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27756455 AND mptpi.`type`=3594 To do Qualite : 0.17526720839763377 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27756456_13-10-2025_13_41_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27756456 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27756456 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'13102025': {'nb_upload': 63, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1389194900, 1389194880, 1389194865, 1389194863, 1389194860, 1389194857, 1389194854, 1389194849, 1389194833, 1389194831, 1389194830, 1389194828, 1389194825, 1389194820, 1389194801, 1389194784, 1389194776, 1389194773, 1389194765, 1389194755, 1389194680, 1389194677, 1389194673] Looping around the photos to save general results len do output : 1 /27756449Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194900', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194880', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194865', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194863', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194860', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194857', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194854', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194849', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194833', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194831', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194830', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194828', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194825', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194820', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194801', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194784', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194776', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194773', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194765', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194755', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194680', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194677', None, None, None, None, None, '3933090') ('3318', None, None, None, None, None, None, None, '3933090') ('3318', None, '1389194673', None, None, None, None, None, '3933090') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.04999232292175293 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.478835105895996 time spend to save output : 0.05034923553466797 total time spend for step 10 : 2.529184341430664 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 23 set_done_treatment 63.20user 19.18system 2:12.89elapsed 61%CPU (0avgtext+0avgdata 3184920maxresident)k 1656inputs+29712outputs (8major+1747285minor)pagefaults 0swaps