python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 534591 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3795453'] with mtr_portfolio_ids : ['27358906'] and first list_photo_ids : [] new path : /proc/534591/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 25 ; length of list_pids : 25 ; length of list_args : 25 time to download the photos : 4.067023277282715 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Sep 30 18:40:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4604 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-30 18:40:35.727845: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-30 18:40:35.760578: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-30 18:40:35.762521: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f4a50000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-30 18:40:35.762561: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-30 18:40:35.766785: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-30 18:40:35.930890: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xd13de50 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-30 18:40:35.930935: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-30 18:40:35.931866: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-30 18:40:35.932740: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-30 18:40:35.944847: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-30 18:40:35.951873: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-30 18:40:35.953262: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-30 18:40:35.964175: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-30 18:40:35.967380: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-30 18:40:35.995942: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-30 18:40:35.997981: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-30 18:40:35.998072: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-30 18:40:35.999143: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-30 18:40:35.999169: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-30 18:40:35.999184: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-30 18:40:36.001050: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4152 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-30 18:40:36.428385: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-30 18:40:36.428463: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-30 18:40:36.428484: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-30 18:40:36.428502: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-30 18:40:36.428519: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-30 18:40:36.428537: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-30 18:40:36.428554: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-30 18:40:36.428571: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-30 18:40:36.429765: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-30 18:40:36.430896: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-30 18:40:36.430931: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-30 18:40:36.430949: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-30 18:40:36.430966: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-30 18:40:36.430982: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-30 18:40:36.430999: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-30 18:40:36.431016: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-30 18:40:36.431032: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-30 18:40:36.432212: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-30 18:40:36.432242: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-30 18:40:36.432252: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-30 18:40:36.432262: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-30 18:40:36.433528: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4152 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-30 18:40:44.225061: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-30 18:40:44.440766: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-30 18:40:46.234687: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:46.235377: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.20G (3436609536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.086335: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-09-30 18:40:47.156045: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.156148: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-30 18:40:47.157410: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.157441: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-30 18:40:47.164433: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.164456: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-30 18:40:47.165072: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.165087: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-30 18:40:47.222430: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.222483: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-30 18:40:47.223172: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.223189: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-30 18:40:47.223861: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.223875: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-30 18:40:47.224543: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.224560: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-30 18:40:47.232495: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.232519: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 417.62MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-30 18:40:47.233188: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.233204: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 417.62MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-30 18:40:47.255621: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.256367: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.257065: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.257744: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.261848: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.262498: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.263174: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.263846: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.265417: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.265446: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-09-30 18:40:47.275067: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.275756: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.284846: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.285582: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.286281: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.286966: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.287670: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-30 18:40:47.288364: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.56G (3818455040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 25 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 Detection mask done ! Trying to reset tf kernel 535258 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3411 tf kernel not reseted sub process len(results) : 25 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 25 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4604 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00025844573974609375 nb_pixel_total : 10575 time to create 1 rle with old method : 0.01207733154296875 length of segment : 140 time for calcul the mask position with numpy : 0.00019860267639160156 nb_pixel_total : 11697 time to create 1 rle with old method : 0.013491630554199219 length of segment : 130 time for calcul the mask position with numpy : 0.0001163482666015625 nb_pixel_total : 5675 time to create 1 rle with old method : 0.0067136287689208984 length of segment : 145 time for calcul the mask position with numpy : 0.00011348724365234375 nb_pixel_total : 6054 time to create 1 rle with old method : 0.007331132888793945 length of segment : 76 time for calcul the mask position with numpy : 0.0002799034118652344 nb_pixel_total : 17499 time to create 1 rle with old method : 0.020839929580688477 length of segment : 112 time for calcul the mask position with numpy : 0.0005359649658203125 nb_pixel_total : 31575 time to create 1 rle with old method : 0.03566932678222656 length of segment : 161 time for calcul the mask position with numpy : 0.000186920166015625 nb_pixel_total : 12359 time to create 1 rle with old method : 0.014745473861694336 length of segment : 106 time for calcul the mask position with numpy : 0.0003447532653808594 nb_pixel_total : 19427 time to create 1 rle with old method : 0.023402690887451172 length of segment : 157 time for calcul the mask position with numpy : 0.00012636184692382812 nb_pixel_total : 5147 time to create 1 rle with old method : 0.006046772003173828 length of segment : 99 time for calcul the mask position with numpy : 0.0003495216369628906 nb_pixel_total : 21466 time to create 1 rle with old method : 0.025411605834960938 length of segment : 202 time for calcul the mask position with numpy : 0.0001785755157470703 nb_pixel_total : 9717 time to create 1 rle with old method : 0.011148452758789062 length of segment : 123 time for calcul the mask position with numpy : 0.00020623207092285156 nb_pixel_total : 14747 time to create 1 rle with old method : 0.017383813858032227 length of segment : 119 time for calcul the mask position with numpy : 0.00025916099548339844 nb_pixel_total : 19183 time to create 1 rle with old method : 0.02412581443786621 length of segment : 108 time for calcul the mask position with numpy : 0.0002803802490234375 nb_pixel_total : 14792 time to create 1 rle with old method : 0.017720699310302734 length of segment : 144 time for calcul the mask position with numpy : 0.0001614093780517578 nb_pixel_total : 9125 time to create 1 rle with old method : 0.011022090911865234 length of segment : 174 time for calcul the mask position with numpy : 0.0004868507385253906 nb_pixel_total : 35527 time to create 1 rle with old method : 0.04054713249206543 length of segment : 175 time for calcul the mask position with numpy : 0.0003445148468017578 nb_pixel_total : 21551 time to create 1 rle with old method : 0.042536258697509766 length of segment : 90 time for calcul the mask position with numpy : 0.0004253387451171875 nb_pixel_total : 16105 time to create 1 rle with old method : 0.030011892318725586 length of segment : 147 time for calcul the mask position with numpy : 0.0003647804260253906 nb_pixel_total : 13552 time to create 1 rle with old method : 0.017253875732421875 length of segment : 246 time for calcul the mask position with numpy : 0.0002739429473876953 nb_pixel_total : 14763 time to create 1 rle with old method : 0.016753435134887695 length of segment : 261 time for calcul the mask position with numpy : 0.0001659393310546875 nb_pixel_total : 9408 time to create 1 rle with old method : 0.011676549911499023 length of segment : 109 time for calcul the mask position with numpy : 0.0001227855682373047 nb_pixel_total : 5876 time to create 1 rle with old method : 0.006816387176513672 length of segment : 101 time for calcul the mask position with numpy : 0.0001437664031982422 nb_pixel_total : 8832 time to create 1 rle with old method : 0.01006770133972168 length of segment : 82 time for calcul the mask position with numpy : 0.00026035308837890625 nb_pixel_total : 13457 time to create 1 rle with old method : 0.01575493812561035 length of segment : 134 time for calcul the mask position with numpy : 0.000518798828125 nb_pixel_total : 30341 time to create 1 rle with old method : 0.034827232360839844 length of segment : 227 time for calcul the mask position with numpy : 0.00027632713317871094 nb_pixel_total : 14251 time to create 1 rle with old method : 0.01680731773376465 length of segment : 163 time for calcul the mask position with numpy : 0.0003590583801269531 nb_pixel_total : 18378 time to create 1 rle with old method : 0.02079153060913086 length of segment : 247 time for calcul the mask position with numpy : 0.0004811286926269531 nb_pixel_total : 30173 time to create 1 rle with old method : 0.0349276065826416 length of segment : 211 time for calcul the mask position with numpy : 0.00010085105895996094 nb_pixel_total : 4387 time to create 1 rle with old method : 0.0052831172943115234 length of segment : 52 time for calcul the mask position with numpy : 0.0002079010009765625 nb_pixel_total : 11149 time to create 1 rle with old method : 0.013109445571899414 length of segment : 152 time for calcul the mask position with numpy : 0.01607513427734375 nb_pixel_total : 777916 time to create 1 rle with new method : 0.05875253677368164 length of segment : 991 time for calcul the mask position with numpy : 0.0006256103515625 nb_pixel_total : 35179 time to create 1 rle with old method : 0.04146385192871094 length of segment : 364 time for calcul the mask position with numpy : 0.0003631114959716797 nb_pixel_total : 21841 time to create 1 rle with old method : 0.025893211364746094 length of segment : 186 time for calcul the mask position with numpy : 0.00018358230590820312 nb_pixel_total : 11233 time to create 1 rle with old method : 0.017299652099609375 length of segment : 131 time for calcul the mask position with numpy : 0.0004963874816894531 nb_pixel_total : 13270 time to create 1 rle with old method : 0.0160825252532959 length of segment : 193 time for calcul the mask position with numpy : 0.0001430511474609375 nb_pixel_total : 1971 time to create 1 rle with old method : 0.003485441207885742 length of segment : 42 time for calcul the mask position with numpy : 0.0060520172119140625 nb_pixel_total : 306325 time to create 1 rle with new method : 0.010637044906616211 length of segment : 987 time for calcul the mask position with numpy : 0.00015401840209960938 nb_pixel_total : 6660 time to create 1 rle with old method : 0.00803995132446289 length of segment : 81 time for calcul the mask position with numpy : 0.0004138946533203125 nb_pixel_total : 11946 time to create 1 rle with old method : 0.018172502517700195 length of segment : 120 time for calcul the mask position with numpy : 0.00130462646484375 nb_pixel_total : 50742 time to create 1 rle with old method : 0.07138919830322266 length of segment : 195 time for calcul the mask position with numpy : 0.00013208389282226562 nb_pixel_total : 5431 time to create 1 rle with old method : 0.0067408084869384766 length of segment : 105 time for calcul the mask position with numpy : 0.00032782554626464844 nb_pixel_total : 11084 time to create 1 rle with old method : 0.013358354568481445 length of segment : 78 time for calcul the mask position with numpy : 0.00010752677917480469 nb_pixel_total : 1975 time to create 1 rle with old method : 0.0025625228881835938 length of segment : 38 time for calcul the mask position with numpy : 0.00042057037353515625 nb_pixel_total : 14078 time to create 1 rle with old method : 0.01660895347595215 length of segment : 167 time for calcul the mask position with numpy : 0.0004029273986816406 nb_pixel_total : 15208 time to create 1 rle with old method : 0.018207788467407227 length of segment : 160 time for calcul the mask position with numpy : 0.00042057037353515625 nb_pixel_total : 12805 time to create 1 rle with old method : 0.015525102615356445 length of segment : 142 time for calcul the mask position with numpy : 0.00039577484130859375 nb_pixel_total : 11653 time to create 1 rle with old method : 0.014253616333007812 length of segment : 135 time for calcul the mask position with numpy : 0.00039768218994140625 nb_pixel_total : 18324 time to create 1 rle with old method : 0.02233576774597168 length of segment : 157 time for calcul the mask position with numpy : 0.0007026195526123047 nb_pixel_total : 26132 time to create 1 rle with old method : 0.031058073043823242 length of segment : 276 time for calcul the mask position with numpy : 0.00020694732666015625 nb_pixel_total : 3912 time to create 1 rle with old method : 0.004675149917602539 length of segment : 81 time for calcul the mask position with numpy : 0.0006422996520996094 nb_pixel_total : 14707 time to create 1 rle with old method : 0.017739057540893555 length of segment : 175 time for calcul the mask position with numpy : 0.002413511276245117 nb_pixel_total : 114260 time to create 1 rle with old method : 0.13170433044433594 length of segment : 525 time for calcul the mask position with numpy : 0.00021696090698242188 nb_pixel_total : 3428 time to create 1 rle with old method : 0.004113435745239258 length of segment : 82 time for calcul the mask position with numpy : 0.00034880638122558594 nb_pixel_total : 7756 time to create 1 rle with old method : 0.009585380554199219 length of segment : 96 time for calcul the mask position with numpy : 0.0003380775451660156 nb_pixel_total : 11556 time to create 1 rle with old method : 0.01372218132019043 length of segment : 115 time for calcul the mask position with numpy : 0.0005395412445068359 nb_pixel_total : 20826 time to create 1 rle with old method : 0.024812698364257812 length of segment : 142 time for calcul the mask position with numpy : 0.00025653839111328125 nb_pixel_total : 4808 time to create 1 rle with old method : 0.008094072341918945 length of segment : 98 time for calcul the mask position with numpy : 0.0005230903625488281 nb_pixel_total : 16599 time to create 1 rle with old method : 0.027476072311401367 length of segment : 162 time for calcul the mask position with numpy : 0.0001595020294189453 nb_pixel_total : 7503 time to create 1 rle with old method : 0.009196281433105469 length of segment : 63 time for calcul the mask position with numpy : 0.0003478527069091797 nb_pixel_total : 12636 time to create 1 rle with old method : 0.01464223861694336 length of segment : 194 time for calcul the mask position with numpy : 0.0010960102081298828 nb_pixel_total : 73617 time to create 1 rle with old method : 0.08461809158325195 length of segment : 386 time for calcul the mask position with numpy : 0.0005185604095458984 nb_pixel_total : 16888 time to create 1 rle with old method : 0.02022385597229004 length of segment : 159 time for calcul the mask position with numpy : 0.0003445148468017578 nb_pixel_total : 12260 time to create 1 rle with old method : 0.014840126037597656 length of segment : 119 time for calcul the mask position with numpy : 0.000278472900390625 nb_pixel_total : 10414 time to create 1 rle with old method : 0.012790918350219727 length of segment : 127 time for calcul the mask position with numpy : 0.0009455680847167969 nb_pixel_total : 30576 time to create 1 rle with old method : 0.03623676300048828 length of segment : 250 time for calcul the mask position with numpy : 0.000232696533203125 nb_pixel_total : 6659 time to create 1 rle with old method : 0.008101701736450195 length of segment : 123 time for calcul the mask position with numpy : 0.00026106834411621094 nb_pixel_total : 6605 time to create 1 rle with old method : 0.008546829223632812 length of segment : 104 time for calcul the mask position with numpy : 0.00020766258239746094 nb_pixel_total : 3466 time to create 1 rle with old method : 0.004709482192993164 length of segment : 74 time for calcul the mask position with numpy : 0.0008549690246582031 nb_pixel_total : 42909 time to create 1 rle with old method : 0.049971818923950195 length of segment : 201 time for calcul the mask position with numpy : 0.00022721290588378906 nb_pixel_total : 8556 time to create 1 rle with old method : 0.010026693344116211 length of segment : 107 time for calcul the mask position with numpy : 0.021979093551635742 nb_pixel_total : 986560 time to create 1 rle with new method : 0.187516450881958 length of segment : 1740 time for calcul the mask position with numpy : 0.00028324127197265625 nb_pixel_total : 4769 time to create 1 rle with old method : 0.005703926086425781 length of segment : 100 time for calcul the mask position with numpy : 0.00035500526428222656 nb_pixel_total : 7491 time to create 1 rle with old method : 0.009225845336914062 length of segment : 154 time for calcul the mask position with numpy : 0.0002002716064453125 nb_pixel_total : 5431 time to create 1 rle with old method : 0.006489992141723633 length of segment : 69 time for calcul the mask position with numpy : 0.0003063678741455078 nb_pixel_total : 11407 time to create 1 rle with old method : 0.013744354248046875 length of segment : 125 time for calcul the mask position with numpy : 0.0008473396301269531 nb_pixel_total : 39310 time to create 1 rle with old method : 0.04750394821166992 length of segment : 140 time for calcul the mask position with numpy : 0.0006060600280761719 nb_pixel_total : 15614 time to create 1 rle with old method : 0.018202781677246094 length of segment : 209 time for calcul the mask position with numpy : 0.00023484230041503906 nb_pixel_total : 6640 time to create 1 rle with old method : 0.008139848709106445 length of segment : 80 time for calcul the mask position with numpy : 0.0006709098815917969 nb_pixel_total : 23753 time to create 1 rle with old method : 0.027887344360351562 length of segment : 292 time for calcul the mask position with numpy : 0.0003116130828857422 nb_pixel_total : 7513 time to create 1 rle with old method : 0.009276628494262695 length of segment : 115 time for calcul the mask position with numpy : 0.0005617141723632812 nb_pixel_total : 16008 time to create 1 rle with old method : 0.01899552345275879 length of segment : 223 time for calcul the mask position with numpy : 0.00014162063598632812 nb_pixel_total : 2277 time to create 1 rle with old method : 0.0028197765350341797 length of segment : 60 time for calcul the mask position with numpy : 0.0003123283386230469 nb_pixel_total : 13719 time to create 1 rle with old method : 0.016346216201782227 length of segment : 159 time for calcul the mask position with numpy : 0.0005135536193847656 nb_pixel_total : 20136 time to create 1 rle with old method : 0.024014949798583984 length of segment : 149 time for calcul the mask position with numpy : 0.0001316070556640625 nb_pixel_total : 3751 time to create 1 rle with old method : 0.004594564437866211 length of segment : 52 time spent for convertir_results : 4.8816351890563965 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 85 chid ids of type : 3594 Number RLEs to save : 15991 save missing photos in datou_result : time spend for datou_step_exec : 34.97659420967102 time spend to save output : 1.7998929023742676 total time spend for step 1 : 36.77648711204529 step2:crop_condition Tue Sep 30 18:41:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 25 ! batch 1 Loaded 85 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 38 About to insert : list_path_to_insert length 38 new photo from crops ! About to upload 38 photos upload in portfolio : 3736932 init cache_photo without model_param we have 38 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759250472_534591 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968930_7ecf98c09faadead31f19f7c233f7496_rle_crop_3981223654_0.png', 0, 127, 119, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968930_7ecf98c09faadead31f19f7c233f7496_rle_crop_3981223656_0.png', 0, 62, 144, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968928_eaed4ce7eb69984329e76d701a1374de_rle_crop_3981223663_0.png', 0, 220, 149, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968928_eaed4ce7eb69984329e76d701a1374de_rle_crop_3981223660_0.png', 0, 165, 105, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968928_eaed4ce7eb69984329e76d701a1374de_rle_crop_3981223662_0.png', 0, 96, 99, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968926_8e6212ae08fd72ac6f7d90674479a460_rle_crop_3981223667_0.png', 0, 222, 111, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968924_696ae041798a87e858d00d7112707cdb_rle_crop_3981223668_0.png', 0, 90, 155, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968922_915c3b6982d1ab5b5252768488152e81_rle_crop_3981223669_0.png', 0, 301, 161, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968922_915c3b6982d1ab5b5252768488152e81_rle_crop_3981223672_0.png', 0, 134, 209, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968909_a46b5e2d91cc73f047abf898eb46a768_rle_crop_3981223677_0.png', 0, 155, 133, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968909_a46b5e2d91cc73f047abf898eb46a768_rle_crop_3981223675_0.png', 0, 81, 101, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968905_036f6b4c253668dabe163c776760410d_rle_crop_3981223680_0.png', 0, 101, 246, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968900_0a830404b9eef4ca9b66e87fa24a8ee6_rle_crop_3981223682_0.png', 0, 101, 52, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968895_8eab1620a2dedcdbcafb707127802116_rle_crop_3981223688_0.png', 0, 182, 155, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968895_8eab1620a2dedcdbcafb707127802116_rle_crop_3981223689_0.png', 0, 59, 42, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968890_6560ba0d3f8366a300cafd16881cc0d5_rle_crop_3981223691_0.png', 0, 134, 81, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968573_b2b8db434834b34755416af23424c09f_rle_crop_3981223694_0.png', 0, 81, 105, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28_rle_crop_3981223695_0.png', 0, 179, 77, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28_rle_crop_3981223699_0.png', 0, 148, 142, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28_rle_crop_3981223696_0.png', 0, 71, 38, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28_rle_crop_3981223700_0.png', 0, 122, 135, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968063_fa14265c79c077fec9d3da63e38814b1_rle_crop_3981223703_0.png', 0, 69, 80, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968060_1311f48338cfe962286e2b623311e5f4_rle_crop_3981223704_0.png', 0, 164, 174, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968040_ea1e6ddfd440c15b43ae6de4b6ba2081_rle_crop_3981223712_0.png', 0, 161, 63, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968040_ea1e6ddfd440c15b43ae6de4b6ba2081_rle_crop_3981223707_0.png', 0, 196, 96, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968040_ea1e6ddfd440c15b43ae6de4b6ba2081_rle_crop_3981223709_0.png', 0, 254, 132, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968040_ea1e6ddfd440c15b43ae6de4b6ba2081_rle_crop_3981223708_0.png', 0, 183, 99, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968040_ea1e6ddfd440c15b43ae6de4b6ba2081_rle_crop_3981223711_0.png', 0, 147, 152, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968037_d0eb36c150fdeb0372af4dfd71d09a47_rle_crop_3981223713_0.png', 0, 75, 194, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968036_0a907a7799ab2a1fa625fca969e30da4_rle_crop_3981223717_0.png', 0, 140, 119, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968034_6e00ec0b4766c66c9408324d9f0ce987_rle_crop_3981223721_0.png', 0, 75, 66, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968034_6e00ec0b4766c66c9408324d9f0ce987_rle_crop_3981223723_0.png', 0, 96, 107, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968032_81504a60e4b2b8002ae47288fa9533cb_rle_crop_3981223727_0.png', 0, 102, 69, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968032_81504a60e4b2b8002ae47288fa9533cb_rle_crop_3981223725_0.png', 0, 85, 100, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968002_7105095c380299b89ace6530dd1344f5_rle_crop_3981223733_0.png', 0, 138, 92, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968002_7105095c380299b89ace6530dd1344f5_rle_crop_3981223734_0.png', 0, 103, 223, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968002_7105095c380299b89ace6530dd1344f5_rle_crop_3981223735_0.png', 0, 61, 59, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250480), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968001_e659cfc83bf83984638129df3e95f46d_rle_crop_3981223738_0.png', 0, 100, 51, 0, 1759250480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 38 photos in the portfolio 3736932 time of upload the photos Elapsed time : 12.461814880371094 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759250486_534591 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250487), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968929_ad522aa70e15fe685dbab945fb344fdd_rle_crop_3981223658_0.png', 0, 231, 106, 0, 1759250487,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250487), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968928_eaed4ce7eb69984329e76d701a1374de_rle_crop_3981223661_0.png', 0, 320, 100, 0, 1759250487,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250487), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968926_8e6212ae08fd72ac6f7d90674479a460_rle_crop_3981223665_0.png', 0, 225, 98, 0, 1759250487,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250487), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968900_0a830404b9eef4ca9b66e87fa24a8ee6_rle_crop_3981223683_0.png', 0, 108, 152, 0, 1759250487,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250487), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968898_7939848cc9c325d6c70bf6dfa0bf792c_rle_crop_3981223686_0.png', 0, 208, 170, 0, 1759250487,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250487), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968890_6560ba0d3f8366a300cafd16881cc0d5_rle_crop_3981223692_0.png', 0, 173, 119, 0, 1759250487,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250487), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28_rle_crop_3981223697_0.png', 0, 135, 167, 0, 1759250487,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250487), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968032_81504a60e4b2b8002ae47288fa9533cb_rle_crop_3981223728_0.png', 0, 134, 125, 0, 1759250487,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250487), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968002_7105095c380299b89ace6530dd1344f5_rle_crop_3981223736_0.png', 0, 117, 159, 0, 1759250487,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.0699679851531982 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759250489_534591 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250489), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968036_0a907a7799ab2a1fa625fca969e30da4_rle_crop_3981223720_0.png', 0, 87, 104, 0, 1759250489,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7699375152587891 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 31 About to insert : list_path_to_insert length 31 new photo from crops ! About to upload 31 photos upload in portfolio : 3736932 init cache_photo without model_param we have 31 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759250501_534591 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968930_7ecf98c09faadead31f19f7c233f7496_rle_crop_3981223655_0.png', 0, 110, 130, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968929_ad522aa70e15fe685dbab945fb344fdd_rle_crop_3981223659_0.png', 0, 259, 159, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968928_eaed4ce7eb69984329e76d701a1374de_rle_crop_3981223664_0.png', 0, 122, 121, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968926_8e6212ae08fd72ac6f7d90674479a460_rle_crop_3981223666_0.png', 0, 235, 108, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968922_915c3b6982d1ab5b5252768488152e81_rle_crop_3981223671_0.png', 0, 159, 141, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968922_915c3b6982d1ab5b5252768488152e81_rle_crop_3981223670_0.png', 0, 290, 88, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968922_915c3b6982d1ab5b5252768488152e81_rle_crop_3981223674_0.png', 0, 107, 108, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968922_915c3b6982d1ab5b5252768488152e81_rle_crop_3981223673_0.png', 0, 119, 218, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968905_036f6b4c253668dabe163c776760410d_rle_crop_3981223681_0.png', 0, 239, 183, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968900_0a830404b9eef4ca9b66e87fa24a8ee6_rle_crop_3981223684_0.png', 0, 1163, 979, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968898_7939848cc9c325d6c70bf6dfa0bf792c_rle_crop_3981223687_0.png', 0, 134, 131, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968898_7939848cc9c325d6c70bf6dfa0bf792c_rle_crop_3981223685_0.png', 0, 155, 364, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968890_6560ba0d3f8366a300cafd16881cc0d5_rle_crop_3981223690_0.png', 0, 883, 509, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968573_b2b8db434834b34755416af23424c09f_rle_crop_3981223693_0.png', 0, 527, 171, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28_rle_crop_3981223701_0.png', 0, 146, 155, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28_rle_crop_3981223698_0.png', 0, 119, 160, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968063_fa14265c79c077fec9d3da63e38814b1_rle_crop_3981223702_0.png', 0, 134, 275, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968060_1311f48338cfe962286e2b623311e5f4_rle_crop_3981223705_0.png', 0, 333, 525, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968040_ea1e6ddfd440c15b43ae6de4b6ba2081_rle_crop_3981223710_0.png', 0, 63, 97, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968037_d0eb36c150fdeb0372af4dfd71d09a47_rle_crop_3981223714_0.png', 0, 278, 380, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968036_0a907a7799ab2a1fa625fca969e30da4_rle_crop_3981223715_0.png', 0, 165, 151, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968036_0a907a7799ab2a1fa625fca969e30da4_rle_crop_3981223716_0.png', 0, 129, 118, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968036_0a907a7799ab2a1fa625fca969e30da4_rle_crop_3981223718_0.png', 0, 177, 250, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968036_0a907a7799ab2a1fa625fca969e30da4_rle_crop_3981223719_0.png', 0, 70, 123, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968034_6e00ec0b4766c66c9408324d9f0ce987_rle_crop_3981223724_0.png', 0, 1528, 942, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968034_6e00ec0b4766c66c9408324d9f0ce987_rle_crop_3981223722_0.png', 0, 323, 173, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968032_81504a60e4b2b8002ae47288fa9533cb_rle_crop_3981223726_0.png', 0, 77, 154, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968031_d5207bd987b3a62f6d45fd8e6da6ef40_rle_crop_3981223729_0.png', 0, 401, 139, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968004_fe86da2b7601c14834e4449c64a77eed_rle_crop_3981223731_0.png', 0, 108, 80, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968002_7105095c380299b89ace6530dd1344f5_rle_crop_3981223732_0.png', 0, 173, 197, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250510), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968001_e659cfc83bf83984638129df3e95f46d_rle_crop_3981223737_0.png', 0, 224, 149, 0, 1759250510,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 31 photos in the portfolio 3736932 time of upload the photos Elapsed time : 12.716835737228394 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759250515_534591 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250515), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968930_7ecf98c09faadead31f19f7c233f7496_rle_crop_3981223657_0.png', 0, 103, 71, 0, 1759250515,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250515), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968060_1311f48338cfe962286e2b623311e5f4_rle_crop_3981223706_0.png', 0, 62, 81, 0, 1759250515,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9676289558410645 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759250516_534591 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250517), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968909_a46b5e2d91cc73f047abf898eb46a768_rle_crop_3981223679_0.png', 0, 125, 163, 0, 1759250517,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250517), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968909_a46b5e2d91cc73f047abf898eb46a768_rle_crop_3981223678_0.png', 0, 197, 227, 0, 1759250517,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250517), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968031_d5207bd987b3a62f6d45fd8e6da6ef40_rle_crop_3981223730_0.png', 0, 93, 209, 0, 1759250517,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.3572194576263428 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759250518_534591 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759250519), 0.0, 0.0, 14, '', 0, 0, '1759250428_534591_1386968909_a46b5e2d91cc73f047abf898eb46a768_rle_crop_3981223676_0.png', 0, 129, 82, 0, 1759250519,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9372255802154541 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1386968930, 1386968929, 1386968928, 1386968926, 1386968924, 1386968922, 1386968909, 1386968905, 1386968900, 1386968898, 1386968895, 1386968890, 1386968573, 1386968373, 1386968063, 1386968060, 1386968040, 1386968037, 1386968036, 1386968034, 1386968032, 1386968031, 1386968004, 1386968002, 1386968001] Looping around the photos to save general results len do output : 85 /1387001223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387001332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968930', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968929', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968928', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968926', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968924', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968922', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968909', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968905', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968900', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968898', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968895', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968890', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968573', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968373', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968063', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968060', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968040', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968037', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968036', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968034', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968032', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968031', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968004', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968002', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968001', None, None, None, None, None, '3795453') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 280 time used for this insertion : 0.047432661056518555 save_final save missing photos in datou_result : time spend for datou_step_exec : 50.128716707229614 time spend to save output : 0.05180501937866211 total time spend for step 2 : 50.180521726608276 step3:rle_unique_nms_with_priority Tue Sep 30 18:41:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 85 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.3958766460418701 time for calcul the mask position with numpy : 0.07620906829833984 nb_pixel_total : 2039599 time to create 1 rle with new method : 0.0985722541809082 time for calcul the mask position with numpy : 0.008887052536010742 nb_pixel_total : 6054 time to create 1 rle with old method : 0.008764028549194336 time for calcul the mask position with numpy : 0.00978541374206543 nb_pixel_total : 5675 time to create 1 rle with old method : 0.0072479248046875 time for calcul the mask position with numpy : 0.007975578308105469 nb_pixel_total : 11697 time to create 1 rle with old method : 0.01459193229675293 time for calcul the mask position with numpy : 0.007823944091796875 nb_pixel_total : 10575 time to create 1 rle with old method : 0.01254892349243164 create new chi : 0.2715280055999756 time to delete rle : 0.0506134033203125 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2062 TO DO : save crop sub photo not yet done ! save time : 0.377338171005249 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04168534278869629 time for calcul the mask position with numpy : 0.02869868278503418 nb_pixel_total : 2024526 time to create 1 rle with new method : 0.5349159240722656 time for calcul the mask position with numpy : 0.010755062103271484 nb_pixel_total : 31575 time to create 1 rle with old method : 0.035608530044555664 time for calcul the mask position with numpy : 0.00611114501953125 nb_pixel_total : 17499 time to create 1 rle with old method : 0.019516944885253906 create new chi : 0.6359217166900635 time to delete rle : 0.0002770423889160156 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1626 TO DO : save crop sub photo not yet done ! save time : 0.33383822441101074 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.39578795433044434 time for calcul the mask position with numpy : 0.060469865798950195 nb_pixel_total : 2005484 time to create 1 rle with new method : 0.2984151840209961 time for calcul the mask position with numpy : 0.006230831146240234 nb_pixel_total : 9717 time to create 1 rle with old method : 0.01123809814453125 time for calcul the mask position with numpy : 0.006140947341918945 nb_pixel_total : 21466 time to create 1 rle with old method : 0.02471780776977539 time for calcul the mask position with numpy : 0.006101369857788086 nb_pixel_total : 5147 time to create 1 rle with old method : 0.005949497222900391 time for calcul the mask position with numpy : 0.006210803985595703 nb_pixel_total : 19427 time to create 1 rle with old method : 0.0224912166595459 time for calcul the mask position with numpy : 0.006299734115600586 nb_pixel_total : 12359 time to create 1 rle with old method : 0.014292716979980469 create new chi : 0.47873926162719727 time to delete rle : 0.0004074573516845703 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 2454 TO DO : save crop sub photo not yet done ! save time : 0.3959207534790039 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.05077385902404785 time for calcul the mask position with numpy : 0.02179408073425293 nb_pixel_total : 2024878 time to create 1 rle with new method : 0.20771050453186035 time for calcul the mask position with numpy : 0.0058672428131103516 nb_pixel_total : 14792 time to create 1 rle with old method : 0.01697397232055664 time for calcul the mask position with numpy : 0.0059735774993896484 nb_pixel_total : 19183 time to create 1 rle with old method : 0.0216825008392334 time for calcul the mask position with numpy : 0.005977630615234375 nb_pixel_total : 14747 time to create 1 rle with old method : 0.01700448989868164 create new chi : 0.31034374237060547 time to delete rle : 0.00028777122497558594 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 1822 TO DO : save crop sub photo not yet done ! save time : 0.3157618045806885 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.034297943115234375 time for calcul the mask position with numpy : 0.01971912384033203 nb_pixel_total : 2064475 time to create 1 rle with new method : 0.028466224670410156 time for calcul the mask position with numpy : 0.006082773208618164 nb_pixel_total : 9125 time to create 1 rle with old method : 0.010343790054321289 create new chi : 0.06489372253417969 time to delete rle : 0.0002396106719970703 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 1428 TO DO : save crop sub photo not yet done ! save time : 0.34328508377075195 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.43370890617370605 time for calcul the mask position with numpy : 0.23899126052856445 nb_pixel_total : 1975783 time to create 1 rle with new method : 0.08409714698791504 time for calcul the mask position with numpy : 0.006140470504760742 nb_pixel_total : 9408 time to create 1 rle with old method : 0.01090693473815918 time for calcul the mask position with numpy : 0.006243228912353516 nb_pixel_total : 1674 time to create 1 rle with old method : 0.0020761489868164062 time for calcul the mask position with numpy : 0.006123065948486328 nb_pixel_total : 13552 time to create 1 rle with old method : 0.015331268310546875 time for calcul the mask position with numpy : 0.005973339080810547 nb_pixel_total : 16105 time to create 1 rle with old method : 0.021457910537719727 time for calcul the mask position with numpy : 0.0061724185943603516 nb_pixel_total : 21551 time to create 1 rle with old method : 0.02442455291748047 time for calcul the mask position with numpy : 0.00652766227722168 nb_pixel_total : 35527 time to create 1 rle with old method : 0.03983044624328613 create new chi : 0.4848613739013672 time to delete rle : 0.0004813671112060547 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 2899 TO DO : save crop sub photo not yet done ! save time : 0.4405093193054199 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.07259273529052734 time for calcul the mask position with numpy : 0.06497669219970703 nb_pixel_total : 2000843 time to create 1 rle with new method : 0.1733403205871582 time for calcul the mask position with numpy : 0.006276607513427734 nb_pixel_total : 14251 time to create 1 rle with old method : 0.019530773162841797 time for calcul the mask position with numpy : 0.006844997406005859 nb_pixel_total : 30341 time to create 1 rle with old method : 0.03648519515991211 time for calcul the mask position with numpy : 0.006179094314575195 nb_pixel_total : 13457 time to create 1 rle with old method : 0.015289545059204102 time for calcul the mask position with numpy : 0.006263256072998047 nb_pixel_total : 8832 time to create 1 rle with old method : 0.010086774826049805 time for calcul the mask position with numpy : 0.006578207015991211 nb_pixel_total : 5876 time to create 1 rle with old method : 0.006844997406005859 create new chi : 0.36992430686950684 time to delete rle : 0.0004553794860839844 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2494 TO DO : save crop sub photo not yet done ! save time : 0.4125347137451172 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04351687431335449 time for calcul the mask position with numpy : 0.021053075790405273 nb_pixel_total : 2025049 time to create 1 rle with new method : 0.1220238208770752 time for calcul the mask position with numpy : 0.013925552368164062 nb_pixel_total : 30173 time to create 1 rle with old method : 0.049167633056640625 time for calcul the mask position with numpy : 0.006814718246459961 nb_pixel_total : 18378 time to create 1 rle with old method : 0.020879745483398438 create new chi : 0.2344985008239746 time to delete rle : 0.0005590915679931641 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1996 TO DO : save crop sub photo not yet done ! save time : 0.3249166011810303 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.07487368583679199 time for calcul the mask position with numpy : 0.018992900848388672 nb_pixel_total : 1280148 time to create 1 rle with new method : 0.1787736415863037 time for calcul the mask position with numpy : 0.011083841323852539 nb_pixel_total : 777916 time to create 1 rle with new method : 0.08955669403076172 time for calcul the mask position with numpy : 0.006261110305786133 nb_pixel_total : 11149 time to create 1 rle with old method : 0.013296842575073242 time for calcul the mask position with numpy : 0.0060117244720458984 nb_pixel_total : 4387 time to create 1 rle with old method : 0.005000114440917969 create new chi : 0.33739328384399414 time to delete rle : 0.0005545616149902344 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3470 TO DO : save crop sub photo not yet done ! save time : 0.5221450328826904 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.06775188446044922 time for calcul the mask position with numpy : 0.09500741958618164 nb_pixel_total : 2005347 time to create 1 rle with new method : 0.09726667404174805 time for calcul the mask position with numpy : 0.011466026306152344 nb_pixel_total : 11233 time to create 1 rle with old method : 0.013053417205810547 time for calcul the mask position with numpy : 0.01027822494506836 nb_pixel_total : 21841 time to create 1 rle with old method : 0.025332927703857422 time for calcul the mask position with numpy : 0.010446310043334961 nb_pixel_total : 35179 time to create 1 rle with old method : 0.039949655532836914 create new chi : 0.31620073318481445 time to delete rle : 0.0004050731658935547 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2442 TO DO : save crop sub photo not yet done ! save time : 0.43715906143188477 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.09562182426452637 time for calcul the mask position with numpy : 0.01935410499572754 nb_pixel_total : 2058359 time to create 1 rle with new method : 0.3504056930541992 time for calcul the mask position with numpy : 0.010244607925415039 nb_pixel_total : 1971 time to create 1 rle with old method : 0.0022950172424316406 time for calcul the mask position with numpy : 0.005948066711425781 nb_pixel_total : 13270 time to create 1 rle with old method : 0.015595674514770508 create new chi : 0.4145383834838867 time to delete rle : 0.0003859996795654297 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1550 TO DO : save crop sub photo not yet done ! save time : 0.4016239643096924 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.07487154006958008 time for calcul the mask position with numpy : 0.2741971015930176 nb_pixel_total : 1755329 time to create 1 rle with new method : 0.09425854682922363 time for calcul the mask position with numpy : 0.006496906280517578 nb_pixel_total : 11946 time to create 1 rle with old method : 0.01393890380859375 time for calcul the mask position with numpy : 0.008936405181884766 nb_pixel_total : 306325 time to create 1 rle with new method : 0.28861451148986816 create new chi : 0.697629451751709 time to delete rle : 0.00033164024353027344 batch 1 Loaded 6 chid ids of type : 3594 +++++++Number RLEs to save : 3294 TO DO : save crop sub photo not yet done ! save time : 0.5123014450073242 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.0401453971862793 time for calcul the mask position with numpy : 0.019441604614257812 nb_pixel_total : 2017427 time to create 1 rle with new method : 0.08922696113586426 time for calcul the mask position with numpy : 0.006636619567871094 nb_pixel_total : 5431 time to create 1 rle with old method : 0.008970260620117188 time for calcul the mask position with numpy : 0.006730794906616211 nb_pixel_total : 50742 time to create 1 rle with old method : 0.05973362922668457 create new chi : 0.20389842987060547 time to delete rle : 0.0003554821014404297 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1680 TO DO : save crop sub photo not yet done ! save time : 0.3968493938446045 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 0.4146580696105957 time for calcul the mask position with numpy : 0.3419618606567383 nb_pixel_total : 1988473 time to create 1 rle with new method : 0.08637475967407227 time for calcul the mask position with numpy : 0.010295391082763672 nb_pixel_total : 18324 time to create 1 rle with old method : 0.02114129066467285 time for calcul the mask position with numpy : 0.009889602661132812 nb_pixel_total : 11653 time to create 1 rle with old method : 0.01335763931274414 time for calcul the mask position with numpy : 0.006403684616088867 nb_pixel_total : 12805 time to create 1 rle with old method : 0.014231443405151367 time for calcul the mask position with numpy : 0.005952358245849609 nb_pixel_total : 15208 time to create 1 rle with old method : 0.0174560546875 time for calcul the mask position with numpy : 0.006023883819580078 nb_pixel_total : 14078 time to create 1 rle with old method : 0.01599860191345215 time for calcul the mask position with numpy : 0.00646209716796875 nb_pixel_total : 1975 time to create 1 rle with old method : 0.0023453235626220703 time for calcul the mask position with numpy : 0.00626683235168457 nb_pixel_total : 11084 time to create 1 rle with old method : 0.012399673461914062 create new chi : 0.5872471332550049 time to delete rle : 0.0004992485046386719 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 2834 TO DO : save crop sub photo not yet done ! save time : 0.4438447952270508 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.0718684196472168 time for calcul the mask position with numpy : 0.019500255584716797 nb_pixel_total : 2043556 time to create 1 rle with new method : 0.028653621673583984 time for calcul the mask position with numpy : 0.006060123443603516 nb_pixel_total : 3912 time to create 1 rle with old method : 0.004605293273925781 time for calcul the mask position with numpy : 0.00606846809387207 nb_pixel_total : 26132 time to create 1 rle with old method : 0.030113935470581055 create new chi : 0.09529900550842285 time to delete rle : 0.0002944469451904297 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1794 TO DO : save crop sub photo not yet done ! save time : 0.39748644828796387 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.05605506896972656 time for calcul the mask position with numpy : 0.2754192352294922 nb_pixel_total : 1941205 time to create 1 rle with new method : 0.2398667335510254 time for calcul the mask position with numpy : 0.006308317184448242 nb_pixel_total : 3428 time to create 1 rle with old method : 0.004044294357299805 time for calcul the mask position with numpy : 0.006381034851074219 nb_pixel_total : 114260 time to create 1 rle with old method : 0.15232157707214355 time for calcul the mask position with numpy : 0.006064891815185547 nb_pixel_total : 14707 time to create 1 rle with old method : 0.01651144027709961 create new chi : 0.7176847457885742 time to delete rle : 0.000583648681640625 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2644 TO DO : save crop sub photo not yet done ! save time : 0.4972257614135742 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.549018383026123 time for calcul the mask position with numpy : 0.06364583969116211 nb_pixel_total : 2004552 time to create 1 rle with new method : 0.28015804290771484 time for calcul the mask position with numpy : 0.006133317947387695 nb_pixel_total : 7503 time to create 1 rle with old method : 0.008600473403930664 time for calcul the mask position with numpy : 0.006333112716674805 nb_pixel_total : 16599 time to create 1 rle with old method : 0.018694639205932617 time for calcul the mask position with numpy : 0.0063800811767578125 nb_pixel_total : 4808 time to create 1 rle with old method : 0.005634784698486328 time for calcul the mask position with numpy : 0.006754636764526367 nb_pixel_total : 20826 time to create 1 rle with old method : 0.024164915084838867 time for calcul the mask position with numpy : 0.006485939025878906 nb_pixel_total : 11556 time to create 1 rle with old method : 0.013517379760742188 time for calcul the mask position with numpy : 0.006479024887084961 nb_pixel_total : 7756 time to create 1 rle with old method : 0.00892019271850586 create new chi : 0.4729926586151123 time to delete rle : 0.00044226646423339844 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 2432 TO DO : save crop sub photo not yet done ! save time : 0.45015621185302734 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.08871912956237793 time for calcul the mask position with numpy : 0.06685924530029297 nb_pixel_total : 1987347 time to create 1 rle with new method : 0.15885162353515625 time for calcul the mask position with numpy : 0.0064733028411865234 nb_pixel_total : 73617 time to create 1 rle with old method : 0.08305692672729492 time for calcul the mask position with numpy : 0.006323814392089844 nb_pixel_total : 12636 time to create 1 rle with old method : 0.014676332473754883 create new chi : 0.3365962505340576 time to delete rle : 0.0003707408905029297 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2240 TO DO : save crop sub photo not yet done ! save time : 0.403456449508667 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.40164732933044434 time for calcul the mask position with numpy : 0.15297579765319824 nb_pixel_total : 1990198 time to create 1 rle with new method : 0.08194184303283691 time for calcul the mask position with numpy : 0.006193637847900391 nb_pixel_total : 6605 time to create 1 rle with old method : 0.007667064666748047 time for calcul the mask position with numpy : 0.006218433380126953 nb_pixel_total : 6659 time to create 1 rle with old method : 0.0075931549072265625 time for calcul the mask position with numpy : 0.011079788208007812 nb_pixel_total : 30576 time to create 1 rle with old method : 0.03439760208129883 time for calcul the mask position with numpy : 0.0061588287353515625 nb_pixel_total : 10414 time to create 1 rle with old method : 0.011298656463623047 time for calcul the mask position with numpy : 0.006058216094970703 nb_pixel_total : 12260 time to create 1 rle with old method : 0.013577699661254883 time for calcul the mask position with numpy : 0.0057446956634521484 nb_pixel_total : 16888 time to create 1 rle with old method : 0.019063949584960938 create new chi : 0.38080430030822754 time to delete rle : 0.00033402442932128906 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 2844 TO DO : save crop sub photo not yet done ! save time : 0.5480916500091553 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.10817337036132812 time for calcul the mask position with numpy : 0.012481689453125 nb_pixel_total : 1036679 time to create 1 rle with new method : 0.15379619598388672 time for calcul the mask position with numpy : 0.012604236602783203 nb_pixel_total : 981990 time to create 1 rle with new method : 0.028904199600219727 time for calcul the mask position with numpy : 0.006085395812988281 nb_pixel_total : 8556 time to create 1 rle with old method : 0.009539365768432617 time for calcul the mask position with numpy : 0.006150007247924805 nb_pixel_total : 42909 time to create 1 rle with old method : 0.046117305755615234 time for calcul the mask position with numpy : 0.005575895309448242 nb_pixel_total : 3466 time to create 1 rle with old method : 0.0036478042602539062 create new chi : 0.28554344177246094 time to delete rle : 0.0007970333099365234 batch 1 Loaded 9 chid ids of type : 3594 ++++++++++Number RLEs to save : 5197 TO DO : save crop sub photo not yet done ! save time : 0.67181396484375 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.2792062759399414 time for calcul the mask position with numpy : 0.10843777656555176 nb_pixel_total : 2044502 time to create 1 rle with new method : 0.08218860626220703 time for calcul the mask position with numpy : 0.006665229797363281 nb_pixel_total : 11407 time to create 1 rle with old method : 0.019217491149902344 time for calcul the mask position with numpy : 0.006650447845458984 nb_pixel_total : 5431 time to create 1 rle with old method : 0.009034156799316406 time for calcul the mask position with numpy : 0.006257295608520508 nb_pixel_total : 7491 time to create 1 rle with old method : 0.00857400894165039 time for calcul the mask position with numpy : 0.005873441696166992 nb_pixel_total : 4769 time to create 1 rle with old method : 0.0052204132080078125 create new chi : 0.2718393802642822 time to delete rle : 0.0003268718719482422 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 1976 TO DO : save crop sub photo not yet done ! save time : 0.4286384582519531 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.039049386978149414 time for calcul the mask position with numpy : 0.017800569534301758 nb_pixel_total : 2018676 time to create 1 rle with new method : 0.190293550491333 time for calcul the mask position with numpy : 0.006170749664306641 nb_pixel_total : 15614 time to create 1 rle with old method : 0.017490863800048828 time for calcul the mask position with numpy : 0.0062940120697021484 nb_pixel_total : 39310 time to create 1 rle with old method : 0.04536008834838867 create new chi : 0.2900543212890625 time to delete rle : 0.0002982616424560547 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1778 TO DO : save crop sub photo not yet done ! save time : 0.32468485832214355 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.10485434532165527 time for calcul the mask position with numpy : 0.09656143188476562 nb_pixel_total : 2066960 time to create 1 rle with new method : 0.07624340057373047 time for calcul the mask position with numpy : 0.00568389892578125 nb_pixel_total : 6640 time to create 1 rle with old method : 0.007325410842895508 create new chi : 0.19622302055358887 time to delete rle : 0.00021386146545410156 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1240 TO DO : save crop sub photo not yet done ! save time : 0.2720654010772705 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.5902204513549805 time for calcul the mask position with numpy : 0.16086602210998535 nb_pixel_total : 2010330 time to create 1 rle with new method : 0.07726240158081055 time for calcul the mask position with numpy : 0.00600123405456543 nb_pixel_total : 13719 time to create 1 rle with old method : 0.015413761138916016 time for calcul the mask position with numpy : 0.00573420524597168 nb_pixel_total : 2277 time to create 1 rle with old method : 0.0025169849395751953 time for calcul the mask position with numpy : 0.00600886344909668 nb_pixel_total : 16008 time to create 1 rle with old method : 0.017770051956176758 time for calcul the mask position with numpy : 0.005847454071044922 nb_pixel_total : 7513 time to create 1 rle with old method : 0.008393287658691406 time for calcul the mask position with numpy : 0.006086587905883789 nb_pixel_total : 23753 time to create 1 rle with old method : 0.02886795997619629 create new chi : 0.35111403465270996 time to delete rle : 0.00037670135498046875 batch 1 Loaded 11 chid ids of type : 3594 ++++++++Number RLEs to save : 2778 TO DO : save crop sub photo not yet done ! save time : 0.4473838806152344 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.06467008590698242 time for calcul the mask position with numpy : 0.01878523826599121 nb_pixel_total : 2049713 time to create 1 rle with new method : 0.17490291595458984 time for calcul the mask position with numpy : 0.006455898284912109 nb_pixel_total : 3751 time to create 1 rle with old method : 0.004376888275146484 time for calcul the mask position with numpy : 0.0061528682708740234 nb_pixel_total : 20136 time to create 1 rle with old method : 0.023771047592163086 create new chi : 0.2413032054901123 time to delete rle : 0.00029087066650390625 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1482 TO DO : save crop sub photo not yet done ! save time : 0.27625179290771484 map_output_result : {1386968930: (0.0, 'Should be the crop_list due to order', 0), 1386968929: (0.0, 'Should be the crop_list due to order', 0), 1386968928: (0.0, 'Should be the crop_list due to order', 0), 1386968926: (0.0, 'Should be the crop_list due to order', 0), 1386968924: (0.0, 'Should be the crop_list due to order', 0), 1386968922: (0.0, 'Should be the crop_list due to order', 0), 1386968909: (0.0, 'Should be the crop_list due to order', 0), 1386968905: (0.0, 'Should be the crop_list due to order', 0), 1386968900: (0.0, 'Should be the crop_list due to order', 0), 1386968898: (0.0, 'Should be the crop_list due to order', 0), 1386968895: (0.0, 'Should be the crop_list due to order', 0), 1386968890: (0.0, 'Should be the crop_list due to order', 0), 1386968573: (0.0, 'Should be the crop_list due to order', 0), 1386968373: (0.0, 'Should be the crop_list due to order', 0), 1386968063: (0.0, 'Should be the crop_list due to order', 0), 1386968060: (0.0, 'Should be the crop_list due to order', 0), 1386968040: (0.0, 'Should be the crop_list due to order', 0), 1386968037: (0.0, 'Should be the crop_list due to order', 0), 1386968036: (0.0, 'Should be the crop_list due to order', 0), 1386968034: (0.0, 'Should be the crop_list due to order', 0), 1386968032: (0.0, 'Should be the crop_list due to order', 0), 1386968031: (0.0, 'Should be the crop_list due to order', 0), 1386968004: (0.0, 'Should be the crop_list due to order', 0), 1386968002: (0.0, 'Should be the crop_list due to order', 0), 1386968001: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1386968930, 1386968929, 1386968928, 1386968926, 1386968924, 1386968922, 1386968909, 1386968905, 1386968900, 1386968898, 1386968895, 1386968890, 1386968573, 1386968373, 1386968063, 1386968060, 1386968040, 1386968037, 1386968036, 1386968034, 1386968032, 1386968031, 1386968004, 1386968002, 1386968001] Looping around the photos to save general results len do output : 25 /1386968930.Didn't retrieve data . /1386968929.Didn't retrieve data . /1386968928.Didn't retrieve data . /1386968926.Didn't retrieve data . /1386968924.Didn't retrieve data . /1386968922.Didn't retrieve data . /1386968909.Didn't retrieve data . /1386968905.Didn't retrieve data . /1386968900.Didn't retrieve data . /1386968898.Didn't retrieve data . /1386968895.Didn't retrieve data . /1386968890.Didn't retrieve data . /1386968573.Didn't retrieve data . /1386968373.Didn't retrieve data . /1386968063.Didn't retrieve data . /1386968060.Didn't retrieve data . /1386968040.Didn't retrieve data . /1386968037.Didn't retrieve data . /1386968036.Didn't retrieve data . /1386968034.Didn't retrieve data . /1386968032.Didn't retrieve data . /1386968031.Didn't retrieve data . /1386968004.Didn't retrieve data . /1386968002.Didn't retrieve data . /1386968001.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968930', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968929', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968928', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968926', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968924', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968922', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968909', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968905', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968900', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968898', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968895', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968890', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968573', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968373', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968063', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968060', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968040', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968037', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968036', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968034', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968032', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968031', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968004', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968002', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968001', None, None, None, None, None, '3795453') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 75 time used for this insertion : 0.03722262382507324 save_final save missing photos in datou_result : time spend for datou_step_exec : 24.989083290100098 time spend to save output : 0.0383453369140625 total time spend for step 3 : 25.02742862701416 step4:ventilate_hashtags_in_portfolio Tue Sep 30 18:42:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 27358906 get user id for portfolio 27358906 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27358906 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','flou','papier','background','pet_clair','metal','pet_fonce','pehd','mal_croppe','carton','autre')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27358906 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','flou','papier','background','pet_clair','metal','pet_fonce','pehd','mal_croppe','carton','autre')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27358906 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','flou','papier','background','pet_clair','metal','pet_fonce','pehd','mal_croppe','carton','autre')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/27361528,27361529,27361530,27361531,27361532,27361533,27361534,27361535,27361536,27361537,27361538?tags=environnement,flou,papier,background,pet_clair,metal,pet_fonce,pehd,mal_croppe,carton,autre Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1386968930, 1386968929, 1386968928, 1386968926, 1386968924, 1386968922, 1386968909, 1386968905, 1386968900, 1386968898, 1386968895, 1386968890, 1386968573, 1386968373, 1386968063, 1386968060, 1386968040, 1386968037, 1386968036, 1386968034, 1386968032, 1386968031, 1386968004, 1386968002, 1386968001] Looping around the photos to save general results len do output : 1 /27358906. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968930', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968929', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968928', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968926', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968924', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968922', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968909', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968905', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968900', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968898', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968895', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968890', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968573', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968373', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968063', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968060', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968040', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968037', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968036', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968034', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968032', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968031', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968004', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968002', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968001', None, None, None, None, None, '3795453') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 26 time used for this insertion : 0.03882169723510742 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.7339766025543213 time spend to save output : 0.03923463821411133 total time spend for step 4 : 2.7732112407684326 step5:final Tue Sep 30 18:42:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1386968930: ('0.06521145833333333',), 1386968929: ('0.06521145833333333',), 1386968928: ('0.06521145833333333',), 1386968926: ('0.06521145833333333',), 1386968924: ('0.06521145833333333',), 1386968922: ('0.06521145833333333',), 1386968909: ('0.06521145833333333',), 1386968905: ('0.06521145833333333',), 1386968900: ('0.06521145833333333',), 1386968898: ('0.06521145833333333',), 1386968895: ('0.06521145833333333',), 1386968890: ('0.06521145833333333',), 1386968573: ('0.06521145833333333',), 1386968373: ('0.06521145833333333',), 1386968063: ('0.06521145833333333',), 1386968060: ('0.06521145833333333',), 1386968040: ('0.06521145833333333',), 1386968037: ('0.06521145833333333',), 1386968036: ('0.06521145833333333',), 1386968034: ('0.06521145833333333',), 1386968032: ('0.06521145833333333',), 1386968031: ('0.06521145833333333',), 1386968004: ('0.06521145833333333',), 1386968002: ('0.06521145833333333',), 1386968001: ('0.06521145833333333',)} new output for save of step final : {1386968930: ('0.06521145833333333',), 1386968929: ('0.06521145833333333',), 1386968928: ('0.06521145833333333',), 1386968926: ('0.06521145833333333',), 1386968924: ('0.06521145833333333',), 1386968922: ('0.06521145833333333',), 1386968909: ('0.06521145833333333',), 1386968905: ('0.06521145833333333',), 1386968900: ('0.06521145833333333',), 1386968898: ('0.06521145833333333',), 1386968895: ('0.06521145833333333',), 1386968890: ('0.06521145833333333',), 1386968573: ('0.06521145833333333',), 1386968373: ('0.06521145833333333',), 1386968063: ('0.06521145833333333',), 1386968060: ('0.06521145833333333',), 1386968040: ('0.06521145833333333',), 1386968037: ('0.06521145833333333',), 1386968036: ('0.06521145833333333',), 1386968034: ('0.06521145833333333',), 1386968032: ('0.06521145833333333',), 1386968031: ('0.06521145833333333',), 1386968004: ('0.06521145833333333',), 1386968002: ('0.06521145833333333',), 1386968001: ('0.06521145833333333',)} [1386968930, 1386968929, 1386968928, 1386968926, 1386968924, 1386968922, 1386968909, 1386968905, 1386968900, 1386968898, 1386968895, 1386968890, 1386968573, 1386968373, 1386968063, 1386968060, 1386968040, 1386968037, 1386968036, 1386968034, 1386968032, 1386968031, 1386968004, 1386968002, 1386968001] Looping around the photos to save general results len do output : 25 /1386968930.Didn't retrieve data . /1386968929.Didn't retrieve data . /1386968928.Didn't retrieve data . /1386968926.Didn't retrieve data . /1386968924.Didn't retrieve data . /1386968922.Didn't retrieve data . /1386968909.Didn't retrieve data . /1386968905.Didn't retrieve data . /1386968900.Didn't retrieve data . /1386968898.Didn't retrieve data . /1386968895.Didn't retrieve data . /1386968890.Didn't retrieve data . /1386968573.Didn't retrieve data . /1386968373.Didn't retrieve data . /1386968063.Didn't retrieve data . /1386968060.Didn't retrieve data . /1386968040.Didn't retrieve data . /1386968037.Didn't retrieve data . /1386968036.Didn't retrieve data . /1386968034.Didn't retrieve data . /1386968032.Didn't retrieve data . /1386968031.Didn't retrieve data . /1386968004.Didn't retrieve data . /1386968002.Didn't retrieve data . /1386968001.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968930', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968929', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968928', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968926', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968924', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968922', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968909', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968905', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968900', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968898', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968895', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968890', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968573', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968373', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968063', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968060', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968040', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968037', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968036', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968034', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968032', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968031', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968004', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968002', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968001', None, None, None, None, None, '3795453') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 75 time used for this insertion : 0.038251638412475586 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.37868261337280273 time spend to save output : 0.03943157196044922 total time spend for step 5 : 0.41811418533325195 step6:blur_detection Tue Sep 30 18:42:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1759250428_534591_1386968930_7ecf98c09faadead31f19f7c233f7496.jpg resize: (1080, 1920) 1386968930 1.256012788684324 treat image : temp/1759250428_534591_1386968929_ad522aa70e15fe685dbab945fb344fdd.jpg resize: (1080, 1920) 1386968929 0.820740610172632 treat image : temp/1759250428_534591_1386968928_eaed4ce7eb69984329e76d701a1374de.jpg resize: (1080, 1920) 1386968928 -3.0869484244783463 treat image : temp/1759250428_534591_1386968926_8e6212ae08fd72ac6f7d90674479a460.jpg resize: (1080, 1920) 1386968926 1.300893248257477 treat image : temp/1759250428_534591_1386968924_696ae041798a87e858d00d7112707cdb.jpg resize: (1080, 1920) 1386968924 2.2705756266458645 treat image : temp/1759250428_534591_1386968922_915c3b6982d1ab5b5252768488152e81.jpg resize: (1080, 1920) 1386968922 1.348127934580932 treat image : temp/1759250428_534591_1386968909_a46b5e2d91cc73f047abf898eb46a768.jpg resize: (1080, 1920) 1386968909 -0.6333090390843593 treat image : temp/1759250428_534591_1386968905_036f6b4c253668dabe163c776760410d.jpg resize: (1080, 1920) 1386968905 0.8556807553033983 treat image : temp/1759250428_534591_1386968900_0a830404b9eef4ca9b66e87fa24a8ee6.jpg resize: (1080, 1920) 1386968900 1.101468854338166 treat image : temp/1759250428_534591_1386968898_7939848cc9c325d6c70bf6dfa0bf792c.jpg resize: (1080, 1920) 1386968898 3.5837856827251158 treat image : temp/1759250428_534591_1386968895_8eab1620a2dedcdbcafb707127802116.jpg resize: (1080, 1920) 1386968895 0.9752770747144023 treat image : temp/1759250428_534591_1386968890_6560ba0d3f8366a300cafd16881cc0d5.jpg resize: (1080, 1920) 1386968890 2.4236137096142536 treat image : temp/1759250428_534591_1386968573_b2b8db434834b34755416af23424c09f.jpg resize: (1080, 1920) 1386968573 0.6899891151231663 treat image : temp/1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28.jpg resize: (1080, 1920) 1386968373 1.0709230168111181 treat image : temp/1759250428_534591_1386968063_fa14265c79c077fec9d3da63e38814b1.jpg resize: (1080, 1920) 1386968063 0.3751089300068769 treat image : temp/1759250428_534591_1386968060_1311f48338cfe962286e2b623311e5f4.jpg resize: (1080, 1920) 1386968060 -3.0982881706460614 treat image : temp/1759250428_534591_1386968040_ea1e6ddfd440c15b43ae6de4b6ba2081.jpg resize: (1080, 1920) 1386968040 1.548435455598565 treat image : temp/1759250428_534591_1386968037_d0eb36c150fdeb0372af4dfd71d09a47.jpg resize: (1080, 1920) 1386968037 2.513497589454329 treat image : temp/1759250428_534591_1386968036_0a907a7799ab2a1fa625fca969e30da4.jpg resize: (1080, 1920) 1386968036 1.8645054941421186 treat image : temp/1759250428_534591_1386968034_6e00ec0b4766c66c9408324d9f0ce987.jpg resize: (1080, 1920) 1386968034 0.2413798581369697 treat image : temp/1759250428_534591_1386968032_81504a60e4b2b8002ae47288fa9533cb.jpg resize: (1080, 1920) 1386968032 0.9598091138451978 treat image : temp/1759250428_534591_1386968031_d5207bd987b3a62f6d45fd8e6da6ef40.jpg resize: (1080, 1920) 1386968031 0.916174945884948 treat image : temp/1759250428_534591_1386968004_fe86da2b7601c14834e4449c64a77eed.jpg resize: (1080, 1920) 1386968004 2.1203577279534898 treat image : temp/1759250428_534591_1386968002_7105095c380299b89ace6530dd1344f5.jpg resize: (1080, 1920) 1386968002 1.4632853061232765 treat image : temp/1759250428_534591_1386968001_e659cfc83bf83984638129df3e95f46d.jpg resize: (1080, 1920) 1386968001 1.7815688206957463 treat image : temp/1759250428_534591_1386968930_7ecf98c09faadead31f19f7c233f7496_rle_crop_3981223654_0.png resize: (119, 127) 1387001223 -1.1316091902090537 treat image : temp/1759250428_534591_1386968930_7ecf98c09faadead31f19f7c233f7496_rle_crop_3981223656_0.png resize: (144, 62) 1387001224 -2.1252652867071893 treat image : temp/1759250428_534591_1386968928_eaed4ce7eb69984329e76d701a1374de_rle_crop_3981223663_0.png resize: (149, 220) 1387001225 -3.185728815803 treat image : temp/1759250428_534591_1386968928_eaed4ce7eb69984329e76d701a1374de_rle_crop_3981223660_0.png resize: (105, 165) 1387001226 -2.9181152323529562 treat image : temp/1759250428_534591_1386968928_eaed4ce7eb69984329e76d701a1374de_rle_crop_3981223662_0.png resize: (99, 96) 1387001227 -3.247459340105274 treat image : temp/1759250428_534591_1386968926_8e6212ae08fd72ac6f7d90674479a460_rle_crop_3981223667_0.png resize: (111, 222) 1387001228 -0.5283067349964744 treat image : temp/1759250428_534591_1386968924_696ae041798a87e858d00d7112707cdb_rle_crop_3981223668_0.png resize: (155, 90) 1387001229 -2.013173843675544 treat image : temp/1759250428_534591_1386968922_915c3b6982d1ab5b5252768488152e81_rle_crop_3981223669_0.png resize: (161, 301) 1387001230 -0.9984183519087979 treat image : temp/1759250428_534591_1386968922_915c3b6982d1ab5b5252768488152e81_rle_crop_3981223672_0.png resize: (209, 134) 1387001231 -1.982146970932722 treat image : temp/1759250428_534591_1386968909_a46b5e2d91cc73f047abf898eb46a768_rle_crop_3981223677_0.png resize: (133, 155) 1387001232 -0.4222318526695266 treat image : temp/1759250428_534591_1386968909_a46b5e2d91cc73f047abf898eb46a768_rle_crop_3981223675_0.png resize: (101, 81) 1387001233 -0.9028353988171268 treat image : temp/1759250428_534591_1386968905_036f6b4c253668dabe163c776760410d_rle_crop_3981223680_0.png resize: (246, 101) 1387001234 -1.4845578338939842 treat image : temp/1759250428_534591_1386968900_0a830404b9eef4ca9b66e87fa24a8ee6_rle_crop_3981223682_0.png resize: (52, 101) 1387001235 5.2850356605513955 treat image : temp/1759250428_534591_1386968895_8eab1620a2dedcdbcafb707127802116_rle_crop_3981223688_0.png resize: (155, 182) 1387001236 -1.1691926836200617 treat image : temp/1759250428_534591_1386968895_8eab1620a2dedcdbcafb707127802116_rle_crop_3981223689_0.png resize: (42, 59) 1387001237 20.0 treat image : temp/1759250428_534591_1386968890_6560ba0d3f8366a300cafd16881cc0d5_rle_crop_3981223691_0.png resize: (81, 134) 1387001238 -0.8261818840258028 treat image : temp/1759250428_534591_1386968573_b2b8db434834b34755416af23424c09f_rle_crop_3981223694_0.png resize: (105, 81) 1387001239 0.45343321316430574 treat image : temp/1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28_rle_crop_3981223695_0.png resize: (77, 179) 1387001240 1.5116249340878791 treat image : temp/1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28_rle_crop_3981223699_0.png resize: (142, 148) 1387001241 -1.0504777725670496 treat image : temp/1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28_rle_crop_3981223696_0.png resize: (38, 71) 1387001243 0.11768568350071211 treat image : temp/1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28_rle_crop_3981223700_0.png resize: (135, 122) 1387001244 -1.0789841508833913 treat image : temp/1759250428_534591_1386968063_fa14265c79c077fec9d3da63e38814b1_rle_crop_3981223703_0.png resize: (80, 69) 1387001246 1.9833908537778004 treat image : temp/1759250428_534591_1386968060_1311f48338cfe962286e2b623311e5f4_rle_crop_3981223704_0.png resize: (174, 164) 1387001247 -1.871395749955768 treat image : temp/1759250428_534591_1386968040_ea1e6ddfd440c15b43ae6de4b6ba2081_rle_crop_3981223712_0.png resize: (63, 161) 1387001248 -0.4142102162057749 treat image : temp/1759250428_534591_1386968040_ea1e6ddfd440c15b43ae6de4b6ba2081_rle_crop_3981223707_0.png resize: (96, 196) 1387001249 1.423329090361331 treat image : temp/1759250428_534591_1386968040_ea1e6ddfd440c15b43ae6de4b6ba2081_rle_crop_3981223709_0.png resize: (132, 254) 1387001250 -0.9272029604563325 treat image : temp/1759250428_534591_1386968040_ea1e6ddfd440c15b43ae6de4b6ba2081_rle_crop_3981223708_0.png resize: (99, 183) 1387001251 -0.7807788926014967 treat image : temp/1759250428_534591_1386968040_ea1e6ddfd440c15b43ae6de4b6ba2081_rle_crop_3981223711_0.png resize: (152, 147) 1387001252 -0.37378342038801293 treat image : temp/1759250428_534591_1386968037_d0eb36c150fdeb0372af4dfd71d09a47_rle_crop_3981223713_0.png resize: (194, 75) 1387001253 1.1672231037995076 treat image : temp/1759250428_534591_1386968036_0a907a7799ab2a1fa625fca969e30da4_rle_crop_3981223717_0.png resize: (119, 140) 1387001254 -0.11128367021946409 treat image : temp/1759250428_534591_1386968034_6e00ec0b4766c66c9408324d9f0ce987_rle_crop_3981223721_0.png resize: (66, 75) 1387001255 -1.4786043716338158 treat image : temp/1759250428_534591_1386968034_6e00ec0b4766c66c9408324d9f0ce987_rle_crop_3981223723_0.png resize: (107, 96) 1387001256 0.13187205442386407 treat image : temp/1759250428_534591_1386968032_81504a60e4b2b8002ae47288fa9533cb_rle_crop_3981223727_0.png resize: (69, 102) 1387001257 -1.4567070076737427 treat image : temp/1759250428_534591_1386968032_81504a60e4b2b8002ae47288fa9533cb_rle_crop_3981223725_0.png resize: (100, 85) 1387001258 -0.12693370052787273 treat image : temp/1759250428_534591_1386968002_7105095c380299b89ace6530dd1344f5_rle_crop_3981223733_0.png resize: (92, 138) 1387001259 1.370656302054551 treat image : temp/1759250428_534591_1386968002_7105095c380299b89ace6530dd1344f5_rle_crop_3981223734_0.png resize: (223, 103) 1387001260 -1.3708147582319388 treat image : temp/1759250428_534591_1386968002_7105095c380299b89ace6530dd1344f5_rle_crop_3981223735_0.png resize: (59, 61) 1387001261 0.11447752352489066 treat image : temp/1759250428_534591_1386968001_e659cfc83bf83984638129df3e95f46d_rle_crop_3981223738_0.png resize: (51, 100) 1387001262 0.42432361657547546 treat image : temp/1759250428_534591_1386968929_ad522aa70e15fe685dbab945fb344fdd_rle_crop_3981223658_0.png resize: (106, 231) 1387001264 -1.7727424685769912 treat image : temp/1759250428_534591_1386968928_eaed4ce7eb69984329e76d701a1374de_rle_crop_3981223661_0.png resize: (100, 320) 1387001265 -2.3485978709786752 treat image : temp/1759250428_534591_1386968926_8e6212ae08fd72ac6f7d90674479a460_rle_crop_3981223665_0.png resize: (98, 225) 1387001266 -2.517799189450332 treat image : temp/1759250428_534591_1386968900_0a830404b9eef4ca9b66e87fa24a8ee6_rle_crop_3981223683_0.png resize: (152, 108) 1387001267 -1.256996247296675 treat image : temp/1759250428_534591_1386968898_7939848cc9c325d6c70bf6dfa0bf792c_rle_crop_3981223686_0.png resize: (170, 208) 1387001268 -1.6752400572644652 treat image : temp/1759250428_534591_1386968890_6560ba0d3f8366a300cafd16881cc0d5_rle_crop_3981223692_0.png resize: (119, 173) 1387001269 -2.341899299634972 treat image : temp/1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28_rle_crop_3981223697_0.png resize: (167, 135) 1387001270 -0.8365509756718882 treat image : temp/1759250428_534591_1386968032_81504a60e4b2b8002ae47288fa9533cb_rle_crop_3981223728_0.png resize: (125, 134) 1387001276 -1.1130537892931176 treat image : temp/1759250428_534591_1386968002_7105095c380299b89ace6530dd1344f5_rle_crop_3981223736_0.png resize: (159, 117) 1387001277 -1.391422983189044 treat image : temp/1759250428_534591_1386968036_0a907a7799ab2a1fa625fca969e30da4_rle_crop_3981223720_0.png resize: (104, 87) 1387001279 -0.6847657708425532 treat image : temp/1759250428_534591_1386968930_7ecf98c09faadead31f19f7c233f7496_rle_crop_3981223655_0.png resize: (130, 110) 1387001291 -0.7127021688767985 treat image : temp/1759250428_534591_1386968929_ad522aa70e15fe685dbab945fb344fdd_rle_crop_3981223659_0.png resize: (159, 259) 1387001292 0.13252702031429664 treat image : temp/1759250428_534591_1386968928_eaed4ce7eb69984329e76d701a1374de_rle_crop_3981223664_0.png resize: (121, 122) 1387001293 -1.774093588081323 treat image : temp/1759250428_534591_1386968926_8e6212ae08fd72ac6f7d90674479a460_rle_crop_3981223666_0.png resize: (108, 235) 1387001294 0.0971099558730938 treat image : temp/1759250428_534591_1386968922_915c3b6982d1ab5b5252768488152e81_rle_crop_3981223671_0.png resize: (141, 159) 1387001295 -0.35450515801032245 treat image : temp/1759250428_534591_1386968922_915c3b6982d1ab5b5252768488152e81_rle_crop_3981223670_0.png resize: (88, 290) 1387001296 1.1573685114574717 treat image : temp/1759250428_534591_1386968922_915c3b6982d1ab5b5252768488152e81_rle_crop_3981223674_0.png resize: (108, 107) 1387001297 0.6687781215052895 treat image : temp/1759250428_534591_1386968922_915c3b6982d1ab5b5252768488152e81_rle_crop_3981223673_0.png resize: (218, 119) 1387001298 -1.9599141525559824 treat image : temp/1759250428_534591_1386968905_036f6b4c253668dabe163c776760410d_rle_crop_3981223681_0.png resize: (183, 239) 1387001299 -0.5727727919584127 treat image : temp/1759250428_534591_1386968900_0a830404b9eef4ca9b66e87fa24a8ee6_rle_crop_3981223684_0.png resize: (979, 1163) 1387001300 0.13037161250818508 treat image : temp/1759250428_534591_1386968898_7939848cc9c325d6c70bf6dfa0bf792c_rle_crop_3981223687_0.png resize: (131, 134) 1387001301 -0.7802386542775566 treat image : temp/1759250428_534591_1386968898_7939848cc9c325d6c70bf6dfa0bf792c_rle_crop_3981223685_0.png resize: (364, 155) 1387001302 -1.1971525232876155 treat image : temp/1759250428_534591_1386968890_6560ba0d3f8366a300cafd16881cc0d5_rle_crop_3981223690_0.png resize: (509, 883) 1387001303 -1.736898248655666 treat image : temp/1759250428_534591_1386968573_b2b8db434834b34755416af23424c09f_rle_crop_3981223693_0.png resize: (171, 527) 1387001304 0.15062582056048673 treat image : temp/1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28_rle_crop_3981223701_0.png resize: (155, 146) 1387001305 0.1375796997395225 treat image : temp/1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28_rle_crop_3981223698_0.png resize: (160, 119) 1387001306 -0.008421308274516976 treat image : temp/1759250428_534591_1386968063_fa14265c79c077fec9d3da63e38814b1_rle_crop_3981223702_0.png resize: (275, 134) 1387001307 -0.42483616331100876 treat image : temp/1759250428_534591_1386968060_1311f48338cfe962286e2b623311e5f4_rle_crop_3981223705_0.png resize: (525, 333) 1387001308 0.12860527741630112 treat image : temp/1759250428_534591_1386968040_ea1e6ddfd440c15b43ae6de4b6ba2081_rle_crop_3981223710_0.png resize: (97, 63) 1387001309 -0.9041702440223107 treat image : temp/1759250428_534591_1386968037_d0eb36c150fdeb0372af4dfd71d09a47_rle_crop_3981223714_0.png resize: (380, 278) 1387001310 -0.24036388245086143 treat image : temp/1759250428_534591_1386968036_0a907a7799ab2a1fa625fca969e30da4_rle_crop_3981223715_0.png resize: (151, 165) 1387001311 -2.700879823251654 treat image : temp/1759250428_534591_1386968036_0a907a7799ab2a1fa625fca969e30da4_rle_crop_3981223716_0.png resize: (118, 129) 1387001312 0.4155028976074732 treat image : temp/1759250428_534591_1386968036_0a907a7799ab2a1fa625fca969e30da4_rle_crop_3981223718_0.png resize: (250, 177) 1387001314 -1.061751009947013 treat image : temp/1759250428_534591_1386968036_0a907a7799ab2a1fa625fca969e30da4_rle_crop_3981223719_0.png resize: (123, 70) 1387001315 -1.1563122374356651 treat image : temp/1759250428_534591_1386968034_6e00ec0b4766c66c9408324d9f0ce987_rle_crop_3981223724_0.png resize: (942, 1528) 1387001316 -2.0187209378604156 treat image : temp/1759250428_534591_1386968034_6e00ec0b4766c66c9408324d9f0ce987_rle_crop_3981223722_0.png resize: (173, 323) 1387001317 -1.0059326704778364 treat image : temp/1759250428_534591_1386968032_81504a60e4b2b8002ae47288fa9533cb_rle_crop_3981223726_0.png resize: (154, 77) 1387001318 -2.612903205868452 treat image : temp/1759250428_534591_1386968031_d5207bd987b3a62f6d45fd8e6da6ef40_rle_crop_3981223729_0.png resize: (139, 401) 1387001320 -0.4635045468807734 treat image : temp/1759250428_534591_1386968004_fe86da2b7601c14834e4449c64a77eed_rle_crop_3981223731_0.png resize: (80, 108) 1387001321 -0.7200317701020511 treat image : temp/1759250428_534591_1386968002_7105095c380299b89ace6530dd1344f5_rle_crop_3981223732_0.png resize: (197, 173) 1387001322 -0.5053350146769953 treat image : temp/1759250428_534591_1386968001_e659cfc83bf83984638129df3e95f46d_rle_crop_3981223737_0.png resize: (149, 224) 1387001324 -0.2389232517664317 treat image : temp/1759250428_534591_1386968930_7ecf98c09faadead31f19f7c233f7496_rle_crop_3981223657_0.png resize: (71, 103) 1387001325 1.9462661815036244 treat image : temp/1759250428_534591_1386968060_1311f48338cfe962286e2b623311e5f4_rle_crop_3981223706_0.png resize: (81, 62) 1387001326 -0.43717275330363703 treat image : temp/1759250428_534591_1386968909_a46b5e2d91cc73f047abf898eb46a768_rle_crop_3981223679_0.png resize: (163, 125) 1387001327 -1.0059622675495163 treat image : temp/1759250428_534591_1386968909_a46b5e2d91cc73f047abf898eb46a768_rle_crop_3981223678_0.png resize: (227, 197) 1387001328 -1.535611420612579 treat image : temp/1759250428_534591_1386968031_d5207bd987b3a62f6d45fd8e6da6ef40_rle_crop_3981223730_0.png resize: (209, 93) 1387001329 1.6447325743603058 treat image : temp/1759250428_534591_1386968909_a46b5e2d91cc73f047abf898eb46a768_rle_crop_3981223676_0.png resize: (82, 129) 1387001332 0.5414016268306654 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 110 time used for this insertion : 0.037877798080444336 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 110 time used for this insertion : 0.07448935508728027 save missing photos in datou_result : time spend for datou_step_exec : 20.757760524749756 time spend to save output : 0.12996196746826172 total time spend for step 6 : 20.887722492218018 step7:brightness Tue Sep 30 18:42:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1759250428_534591_1386968930_7ecf98c09faadead31f19f7c233f7496.jpg treat image : temp/1759250428_534591_1386968929_ad522aa70e15fe685dbab945fb344fdd.jpg treat image : temp/1759250428_534591_1386968928_eaed4ce7eb69984329e76d701a1374de.jpg treat image : temp/1759250428_534591_1386968926_8e6212ae08fd72ac6f7d90674479a460.jpg treat image : temp/1759250428_534591_1386968924_696ae041798a87e858d00d7112707cdb.jpg treat image : temp/1759250428_534591_1386968922_915c3b6982d1ab5b5252768488152e81.jpg treat image : temp/1759250428_534591_1386968909_a46b5e2d91cc73f047abf898eb46a768.jpg treat image : temp/1759250428_534591_1386968905_036f6b4c253668dabe163c776760410d.jpg treat image : temp/1759250428_534591_1386968900_0a830404b9eef4ca9b66e87fa24a8ee6.jpg treat image : temp/1759250428_534591_1386968898_7939848cc9c325d6c70bf6dfa0bf792c.jpg treat image : temp/1759250428_534591_1386968895_8eab1620a2dedcdbcafb707127802116.jpg treat image : temp/1759250428_534591_1386968890_6560ba0d3f8366a300cafd16881cc0d5.jpg treat image : temp/1759250428_534591_1386968573_b2b8db434834b34755416af23424c09f.jpg treat image : temp/1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28.jpg treat image : temp/1759250428_534591_1386968063_fa14265c79c077fec9d3da63e38814b1.jpg treat image : temp/1759250428_534591_1386968060_1311f48338cfe962286e2b623311e5f4.jpg treat image : temp/1759250428_534591_1386968040_ea1e6ddfd440c15b43ae6de4b6ba2081.jpg treat image : temp/1759250428_534591_1386968037_d0eb36c150fdeb0372af4dfd71d09a47.jpg treat image : temp/1759250428_534591_1386968036_0a907a7799ab2a1fa625fca969e30da4.jpg treat image : temp/1759250428_534591_1386968034_6e00ec0b4766c66c9408324d9f0ce987.jpg treat image : temp/1759250428_534591_1386968032_81504a60e4b2b8002ae47288fa9533cb.jpg treat image : temp/1759250428_534591_1386968031_d5207bd987b3a62f6d45fd8e6da6ef40.jpg treat image : temp/1759250428_534591_1386968004_fe86da2b7601c14834e4449c64a77eed.jpg treat image : temp/1759250428_534591_1386968002_7105095c380299b89ace6530dd1344f5.jpg treat image : temp/1759250428_534591_1386968001_e659cfc83bf83984638129df3e95f46d.jpg treat image : temp/1759250428_534591_1386968930_7ecf98c09faadead31f19f7c233f7496_rle_crop_3981223654_0.png treat image : temp/1759250428_534591_1386968930_7ecf98c09faadead31f19f7c233f7496_rle_crop_3981223656_0.png treat image : temp/1759250428_534591_1386968928_eaed4ce7eb69984329e76d701a1374de_rle_crop_3981223663_0.png treat image : temp/1759250428_534591_1386968928_eaed4ce7eb69984329e76d701a1374de_rle_crop_3981223660_0.png treat image : temp/1759250428_534591_1386968928_eaed4ce7eb69984329e76d701a1374de_rle_crop_3981223662_0.png treat image : temp/1759250428_534591_1386968926_8e6212ae08fd72ac6f7d90674479a460_rle_crop_3981223667_0.png treat image : temp/1759250428_534591_1386968924_696ae041798a87e858d00d7112707cdb_rle_crop_3981223668_0.png treat image : temp/1759250428_534591_1386968922_915c3b6982d1ab5b5252768488152e81_rle_crop_3981223669_0.png treat image : temp/1759250428_534591_1386968922_915c3b6982d1ab5b5252768488152e81_rle_crop_3981223672_0.png treat image : temp/1759250428_534591_1386968909_a46b5e2d91cc73f047abf898eb46a768_rle_crop_3981223677_0.png treat image : temp/1759250428_534591_1386968909_a46b5e2d91cc73f047abf898eb46a768_rle_crop_3981223675_0.png treat image : temp/1759250428_534591_1386968905_036f6b4c253668dabe163c776760410d_rle_crop_3981223680_0.png treat image : temp/1759250428_534591_1386968900_0a830404b9eef4ca9b66e87fa24a8ee6_rle_crop_3981223682_0.png treat image : temp/1759250428_534591_1386968895_8eab1620a2dedcdbcafb707127802116_rle_crop_3981223688_0.png treat image : temp/1759250428_534591_1386968895_8eab1620a2dedcdbcafb707127802116_rle_crop_3981223689_0.png treat image : temp/1759250428_534591_1386968890_6560ba0d3f8366a300cafd16881cc0d5_rle_crop_3981223691_0.png treat image : temp/1759250428_534591_1386968573_b2b8db434834b34755416af23424c09f_rle_crop_3981223694_0.png treat image : temp/1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28_rle_crop_3981223695_0.png treat image : temp/1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28_rle_crop_3981223699_0.png treat image : temp/1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28_rle_crop_3981223696_0.png treat image : temp/1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28_rle_crop_3981223700_0.png treat image : temp/1759250428_534591_1386968063_fa14265c79c077fec9d3da63e38814b1_rle_crop_3981223703_0.png treat image : temp/1759250428_534591_1386968060_1311f48338cfe962286e2b623311e5f4_rle_crop_3981223704_0.png treat image : temp/1759250428_534591_1386968040_ea1e6ddfd440c15b43ae6de4b6ba2081_rle_crop_3981223712_0.png treat image : temp/1759250428_534591_1386968040_ea1e6ddfd440c15b43ae6de4b6ba2081_rle_crop_3981223707_0.png treat image : temp/1759250428_534591_1386968040_ea1e6ddfd440c15b43ae6de4b6ba2081_rle_crop_3981223709_0.png treat image : temp/1759250428_534591_1386968040_ea1e6ddfd440c15b43ae6de4b6ba2081_rle_crop_3981223708_0.png treat image : temp/1759250428_534591_1386968040_ea1e6ddfd440c15b43ae6de4b6ba2081_rle_crop_3981223711_0.png treat image : temp/1759250428_534591_1386968037_d0eb36c150fdeb0372af4dfd71d09a47_rle_crop_3981223713_0.png treat image : temp/1759250428_534591_1386968036_0a907a7799ab2a1fa625fca969e30da4_rle_crop_3981223717_0.png treat image : temp/1759250428_534591_1386968034_6e00ec0b4766c66c9408324d9f0ce987_rle_crop_3981223721_0.png treat image : temp/1759250428_534591_1386968034_6e00ec0b4766c66c9408324d9f0ce987_rle_crop_3981223723_0.png treat image : temp/1759250428_534591_1386968032_81504a60e4b2b8002ae47288fa9533cb_rle_crop_3981223727_0.png treat image : temp/1759250428_534591_1386968032_81504a60e4b2b8002ae47288fa9533cb_rle_crop_3981223725_0.png treat image : temp/1759250428_534591_1386968002_7105095c380299b89ace6530dd1344f5_rle_crop_3981223733_0.png treat image : temp/1759250428_534591_1386968002_7105095c380299b89ace6530dd1344f5_rle_crop_3981223734_0.png treat image : temp/1759250428_534591_1386968002_7105095c380299b89ace6530dd1344f5_rle_crop_3981223735_0.png treat image : temp/1759250428_534591_1386968001_e659cfc83bf83984638129df3e95f46d_rle_crop_3981223738_0.png treat image : temp/1759250428_534591_1386968929_ad522aa70e15fe685dbab945fb344fdd_rle_crop_3981223658_0.png treat image : temp/1759250428_534591_1386968928_eaed4ce7eb69984329e76d701a1374de_rle_crop_3981223661_0.png treat image : temp/1759250428_534591_1386968926_8e6212ae08fd72ac6f7d90674479a460_rle_crop_3981223665_0.png treat image : temp/1759250428_534591_1386968900_0a830404b9eef4ca9b66e87fa24a8ee6_rle_crop_3981223683_0.png treat image : temp/1759250428_534591_1386968898_7939848cc9c325d6c70bf6dfa0bf792c_rle_crop_3981223686_0.png treat image : temp/1759250428_534591_1386968890_6560ba0d3f8366a300cafd16881cc0d5_rle_crop_3981223692_0.png treat image : temp/1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28_rle_crop_3981223697_0.png treat image : temp/1759250428_534591_1386968032_81504a60e4b2b8002ae47288fa9533cb_rle_crop_3981223728_0.png treat image : temp/1759250428_534591_1386968002_7105095c380299b89ace6530dd1344f5_rle_crop_3981223736_0.png treat image : temp/1759250428_534591_1386968036_0a907a7799ab2a1fa625fca969e30da4_rle_crop_3981223720_0.png treat image : temp/1759250428_534591_1386968930_7ecf98c09faadead31f19f7c233f7496_rle_crop_3981223655_0.png treat image : temp/1759250428_534591_1386968929_ad522aa70e15fe685dbab945fb344fdd_rle_crop_3981223659_0.png treat image : temp/1759250428_534591_1386968928_eaed4ce7eb69984329e76d701a1374de_rle_crop_3981223664_0.png treat image : temp/1759250428_534591_1386968926_8e6212ae08fd72ac6f7d90674479a460_rle_crop_3981223666_0.png treat image : temp/1759250428_534591_1386968922_915c3b6982d1ab5b5252768488152e81_rle_crop_3981223671_0.png treat image : temp/1759250428_534591_1386968922_915c3b6982d1ab5b5252768488152e81_rle_crop_3981223670_0.png treat image : temp/1759250428_534591_1386968922_915c3b6982d1ab5b5252768488152e81_rle_crop_3981223674_0.png treat image : temp/1759250428_534591_1386968922_915c3b6982d1ab5b5252768488152e81_rle_crop_3981223673_0.png treat image : temp/1759250428_534591_1386968905_036f6b4c253668dabe163c776760410d_rle_crop_3981223681_0.png treat image : temp/1759250428_534591_1386968900_0a830404b9eef4ca9b66e87fa24a8ee6_rle_crop_3981223684_0.png treat image : temp/1759250428_534591_1386968898_7939848cc9c325d6c70bf6dfa0bf792c_rle_crop_3981223687_0.png treat image : temp/1759250428_534591_1386968898_7939848cc9c325d6c70bf6dfa0bf792c_rle_crop_3981223685_0.png treat image : temp/1759250428_534591_1386968890_6560ba0d3f8366a300cafd16881cc0d5_rle_crop_3981223690_0.png treat image : temp/1759250428_534591_1386968573_b2b8db434834b34755416af23424c09f_rle_crop_3981223693_0.png treat image : temp/1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28_rle_crop_3981223701_0.png treat image : temp/1759250428_534591_1386968373_ebbb07f6a991d3803fe3872a3d944a28_rle_crop_3981223698_0.png treat image : temp/1759250428_534591_1386968063_fa14265c79c077fec9d3da63e38814b1_rle_crop_3981223702_0.png treat image : temp/1759250428_534591_1386968060_1311f48338cfe962286e2b623311e5f4_rle_crop_3981223705_0.png treat image : temp/1759250428_534591_1386968040_ea1e6ddfd440c15b43ae6de4b6ba2081_rle_crop_3981223710_0.png treat image : temp/1759250428_534591_1386968037_d0eb36c150fdeb0372af4dfd71d09a47_rle_crop_3981223714_0.png treat image : temp/1759250428_534591_1386968036_0a907a7799ab2a1fa625fca969e30da4_rle_crop_3981223715_0.png treat image : temp/1759250428_534591_1386968036_0a907a7799ab2a1fa625fca969e30da4_rle_crop_3981223716_0.png treat image : temp/1759250428_534591_1386968036_0a907a7799ab2a1fa625fca969e30da4_rle_crop_3981223718_0.png treat image : temp/1759250428_534591_1386968036_0a907a7799ab2a1fa625fca969e30da4_rle_crop_3981223719_0.png treat image : temp/1759250428_534591_1386968034_6e00ec0b4766c66c9408324d9f0ce987_rle_crop_3981223724_0.png treat image : temp/1759250428_534591_1386968034_6e00ec0b4766c66c9408324d9f0ce987_rle_crop_3981223722_0.png treat image : temp/1759250428_534591_1386968032_81504a60e4b2b8002ae47288fa9533cb_rle_crop_3981223726_0.png treat image : temp/1759250428_534591_1386968031_d5207bd987b3a62f6d45fd8e6da6ef40_rle_crop_3981223729_0.png treat image : temp/1759250428_534591_1386968004_fe86da2b7601c14834e4449c64a77eed_rle_crop_3981223731_0.png treat image : temp/1759250428_534591_1386968002_7105095c380299b89ace6530dd1344f5_rle_crop_3981223732_0.png treat image : temp/1759250428_534591_1386968001_e659cfc83bf83984638129df3e95f46d_rle_crop_3981223737_0.png treat image : temp/1759250428_534591_1386968930_7ecf98c09faadead31f19f7c233f7496_rle_crop_3981223657_0.png treat image : temp/1759250428_534591_1386968060_1311f48338cfe962286e2b623311e5f4_rle_crop_3981223706_0.png treat image : temp/1759250428_534591_1386968909_a46b5e2d91cc73f047abf898eb46a768_rle_crop_3981223679_0.png treat image : temp/1759250428_534591_1386968909_a46b5e2d91cc73f047abf898eb46a768_rle_crop_3981223678_0.png treat image : temp/1759250428_534591_1386968031_d5207bd987b3a62f6d45fd8e6da6ef40_rle_crop_3981223730_0.png treat image : temp/1759250428_534591_1386968909_a46b5e2d91cc73f047abf898eb46a768_rle_crop_3981223676_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 110 time used for this insertion : 0.03868508338928223 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 110 time used for this insertion : 0.07551002502441406 save missing photos in datou_result : time spend for datou_step_exec : 6.202516078948975 time spend to save output : 0.13194775581359863 total time spend for step 7 : 6.334463834762573 step8:velours_tree Tue Sep 30 18:42:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.10056900978088379 time spend to save output : 3.7670135498046875e-05 total time spend for step 8 : 0.10060667991638184 step9:send_mail_cod Tue Sep 30 18:42:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P27358906_30-09-2025_18_42_55.pdf 27361529 imagette273615291759250575 27361530 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette273615301759250575 27361531 imagette273615311759250576 27361532 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette273615321759250576 27361533 change filename to text .imagette273615331759250578 27361534 change filename to text .imagette273615341759250578 27361535 change filename to text .change filename to text .change filename to text .imagette273615351759250578 27361536 imagette273615361759250579 27361537 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette273615371759250579 27361538 change filename to text .change filename to text .imagette273615381759250579 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=27358906 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/27361528,27361529,27361530,27361531,27361532,27361533,27361534,27361535,27361536,27361537,27361538?tags=environnement,flou,papier,background,pet_clair,metal,pet_fonce,pehd,mal_croppe,carton,autre args[1386968930] : ((1386968930, 1.256012788684324, 492688767), (1386968930, 0.5795269527768208, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968929] : ((1386968929, 0.820740610172632, 492688767), (1386968929, 0.2950506947386713, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968928] : ((1386968928, -3.0869484244783463, 492609224), (1386968928, 0.5037850328657172, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968926] : ((1386968926, 1.300893248257477, 492688767), (1386968926, 0.44759563730353136, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968924] : ((1386968924, 2.2705756266458645, 492688767), (1386968924, 0.42491200519118105, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968922] : ((1386968922, 1.348127934580932, 492688767), (1386968922, 0.5932940411815382, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968909] : ((1386968909, -0.6333090390843593, 492688767), (1386968909, 0.18337105345267443, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968905] : ((1386968905, 0.8556807553033983, 492688767), (1386968905, 0.6304688331474764, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968900] : ((1386968900, 1.101468854338166, 492688767), (1386968900, 0.7130186549293035, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968898] : ((1386968898, 3.5837856827251158, 492688767), (1386968898, 0.6638873591848651, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968895] : ((1386968895, 0.9752770747144023, 492688767), (1386968895, 0.6316766045951162, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968890] : ((1386968890, 2.4236137096142536, 492688767), (1386968890, 0.5581924633929006, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968573] : ((1386968573, 0.6899891151231663, 492688767), (1386968573, 0.7905684840927881, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968373] : ((1386968373, 1.0709230168111181, 492688767), (1386968373, 0.5758442213663189, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968063] : ((1386968063, 0.3751089300068769, 492688767), (1386968063, 0.6522310021030213, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968060] : ((1386968060, -3.0982881706460614, 492609224), (1386968060, 0.3600970057702225, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968040] : ((1386968040, 1.548435455598565, 492688767), (1386968040, 0.49944384500508426, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968037] : ((1386968037, 2.513497589454329, 492688767), (1386968037, 0.7844885164226676, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968036] : ((1386968036, 1.8645054941421186, 492688767), (1386968036, 0.6432785507732639, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968034] : ((1386968034, 0.2413798581369697, 492688767), (1386968034, 0.07571616171634939, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968032] : ((1386968032, 0.9598091138451978, 492688767), (1386968032, 0.4122254569799406, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968031] : ((1386968031, 0.916174945884948, 492688767), (1386968031, 0.29695163730302765, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968004] : ((1386968004, 2.1203577279534898, 492688767), (1386968004, 0.7597108432634933, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968002] : ((1386968002, 1.4632853061232765, 492688767), (1386968002, 0.4142096332366907, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com args[1386968001] : ((1386968001, 1.7815688206957463, 492688767), (1386968001, 0.3322072541689412, 2107752395), '0.06521145833333333') We are sending mail with results at report@fotonower.com refus_total : 0.06521145833333333 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=27358906 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27358906_30-09-2025_18_42_55.pdf results_Auto_P27358906_30-09-2025_18_42_55.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27358906_30-09-2025_18_42_55.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','27358906','results_Auto_P27358906_30-09-2025_18_42_55.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27358906_30-09-2025_18_42_55.pdf','pdf','','0.44','0.06521145833333333') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/27358906

https://www.fotonower.com/image?json=false&list_photos_id=1386968930
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.256012788684324)
https://www.fotonower.com/image?json=false&list_photos_id=1386968929
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386968928
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386968926
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.300893248257477)
https://www.fotonower.com/image?json=false&list_photos_id=1386968924
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.2705756266458645)
https://www.fotonower.com/image?json=false&list_photos_id=1386968922
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.348127934580932)
https://www.fotonower.com/image?json=false&list_photos_id=1386968909
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386968905
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386968900
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.101468854338166)
https://www.fotonower.com/image?json=false&list_photos_id=1386968898
La photo est trop floue, merci de reprendre une photo.(avec le score = 3.5837856827251158)
https://www.fotonower.com/image?json=false&list_photos_id=1386968895
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386968890
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.4236137096142536)
https://www.fotonower.com/image?json=false&list_photos_id=1386968573
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386968373
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.0709230168111181)
https://www.fotonower.com/image?json=false&list_photos_id=1386968063
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386968060
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386968040
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.548435455598565)
https://www.fotonower.com/image?json=false&list_photos_id=1386968037
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.513497589454329)
https://www.fotonower.com/image?json=false&list_photos_id=1386968036
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.8645054941421186)
https://www.fotonower.com/image?json=false&list_photos_id=1386968034
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386968032
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386968031
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1386968004
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.1203577279534898)
https://www.fotonower.com/image?json=false&list_photos_id=1386968002
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.4632853061232765)
https://www.fotonower.com/image?json=false&list_photos_id=1386968001
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.7815688206957463)

Dans ces conditions,le taux de refus est: 6.52%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/27361530?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/27361532?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/27361533?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/27361534?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/27361535?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/27361537?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/27361538?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27358906_30-09-2025_18_42_55.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/27361528,27361529,27361530,27361531,27361532,27361533,27361534,27361535,27361536,27361537,27361538?tags=environnement,flou,papier,background,pet_clair,metal,pet_fonce,pehd,mal_croppe,carton,autre.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 30 Sep 2025 16:43:02 GMT Content-Length: 0 Connection: close X-Message-Id: PuRPZKRVRpSJHFF12NXWGQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1386968930, 1386968929, 1386968928, 1386968926, 1386968924, 1386968922, 1386968909, 1386968905, 1386968900, 1386968898, 1386968895, 1386968890, 1386968573, 1386968373, 1386968063, 1386968060, 1386968040, 1386968037, 1386968036, 1386968034, 1386968032, 1386968031, 1386968004, 1386968002, 1386968001] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968930', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968929', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968928', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968926', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968924', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968922', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968909', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968905', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968900', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968898', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968895', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968890', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968573', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968373', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968063', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968060', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968040', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968037', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968036', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968034', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968032', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968031', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968004', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968002', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968001', None, None, None, None, None, '3795453') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 25 time used for this insertion : 0.043229103088378906 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.840466022491455 time spend to save output : 0.043595075607299805 total time spend for step 9 : 7.884061098098755 step10:split_time_score Tue Sep 30 18:43:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 25),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 30092025 27358906 Nombre de photos uploadées : 25 / 23040 (0%) 30092025 27358906 Nombre de photos taguées (types de déchets): 0 / 25 (0%) 30092025 27358906 Nombre de photos taguées (volume) : 0 / 25 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0013203620910644531 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.6448335647583008 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.25469097222222226 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27344240_30-09-2025_17_08_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27344240 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27344240 AND mptpi.`type`=3594 To do Qualite : 0.1986372843013468 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27344242_30-09-2025_17_08_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27344242 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27344242 AND mptpi.`type`=3594 To do Qualite : 0.040582133058984914 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27344246_30-09-2025_17_08_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27344246 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27344246 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27344248 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27344254 order by id desc limit 1 Qualite : 0.02596068029835391 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27355641_30-09-2025_17_22_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27355641 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27355641 AND mptpi.`type`=3594 To do Qualite : 0.025566601447677834 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27355643_30-09-2025_17_12_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27355643 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27355643 AND mptpi.`type`=3594 To do Qualite : 0.06521145833333333 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27358906_30-09-2025_18_42_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27358906 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27358906 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27358912 order by id desc limit 1 Qualite : 0.10616083676268859 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27358916_30-09-2025_18_21_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27358916 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27358916 AND mptpi.`type`=3594 To do Qualite : 0.03925462962962963 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27358918_30-09-2025_18_12_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27358918 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27358918 AND mptpi.`type`=3594 To do Qualite : 0.11357573127104378 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27358921_30-09-2025_18_02_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27358921 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27358921 AND mptpi.`type`=3594 To do Qualite : 0.1420479145233196 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27358922_30-09-2025_17_41_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27358922 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27358922 AND mptpi.`type`=3594 To do Qualite : 0.07097040037722906 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27358924_30-09-2025_17_51_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27358924 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27358924 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'30092025': {'nb_upload': 25, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1386968930, 1386968929, 1386968928, 1386968926, 1386968924, 1386968922, 1386968909, 1386968905, 1386968900, 1386968898, 1386968895, 1386968890, 1386968573, 1386968373, 1386968063, 1386968060, 1386968040, 1386968037, 1386968036, 1386968034, 1386968032, 1386968031, 1386968004, 1386968002, 1386968001] Looping around the photos to save general results len do output : 1 /27358906Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968930', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968929', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968928', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968926', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968924', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968922', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968909', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968905', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968900', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968898', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968895', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968890', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968573', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968373', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968063', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968060', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968040', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968037', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968036', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968034', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968032', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968031', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968004', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968002', None, None, None, None, None, '3795453') ('3318', None, None, None, None, None, None, None, '3795453') ('3318', '27358906', '1386968001', None, None, None, None, None, '3795453') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 26 time used for this insertion : 0.04079103469848633 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.4459333419799805 time spend to save output : 0.0411686897277832 total time spend for step 10 : 5.487102031707764 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 25 set_done_treatment 73.09user 33.23system 2:43.34elapsed 65%CPU (0avgtext+0avgdata 3230612maxresident)k 775904inputs+35416outputs (4635major+2867321minor)pagefaults 0swaps