python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1019607 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3954326'] with mtr_portfolio_ids : ['27874709'] and first list_photo_ids : [] new path : /proc/1019607/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 12 ; length of list_pids : 12 ; length of list_args : 12 time to download the photos : 1.6849815845489502 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Oct 17 13:20:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-10-17 13:20:34.374598: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-10-17 13:20:34.402525: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-10-17 13:20:34.404785: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7faa80000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-10-17 13:20:34.404847: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-10-17 13:20:34.408940: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-10-17 13:20:34.730180: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x38d4e4a0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-10-17 13:20:34.730257: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-10-17 13:20:34.731888: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-17 13:20:34.732382: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-17 13:20:34.735887: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-17 13:20:34.739098: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-17 13:20:34.739605: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-17 13:20:34.742209: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-17 13:20:34.743503: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-17 13:20:34.748310: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-17 13:20:34.749841: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-17 13:20:34.749933: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-17 13:20:34.750704: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-17 13:20:34.750720: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-17 13:20:34.750729: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-17 13:20:34.752047: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-10-17 13:20:35.146325: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-17 13:20:35.146409: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-17 13:20:35.146432: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-17 13:20:35.146452: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-17 13:20:35.146471: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-17 13:20:35.146490: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-17 13:20:35.146509: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-17 13:20:35.146529: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-17 13:20:35.148418: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-17 13:20:35.149803: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-17 13:20:35.149844: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-17 13:20:35.149863: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-17 13:20:35.149879: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-17 13:20:35.149896: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-17 13:20:35.149912: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-17 13:20:35.149929: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-17 13:20:35.149946: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-17 13:20:35.151519: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-17 13:20:35.151549: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-17 13:20:35.151558: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-17 13:20:35.151565: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-17 13:20:35.152886: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-10-17 13:20:41.877793: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-17 13:20:42.097399: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 Detection mask done ! Trying to reset tf kernel 1020236 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4907 tf kernel not reseted sub process len(results) : 12 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 12 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10188 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00023174285888671875 nb_pixel_total : 11157 time to create 1 rle with old method : 0.012601852416992188 length of segment : 85 time for calcul the mask position with numpy : 0.00015401840209960938 nb_pixel_total : 7424 time to create 1 rle with old method : 0.008608579635620117 length of segment : 99 time for calcul the mask position with numpy : 0.000209808349609375 nb_pixel_total : 13829 time to create 1 rle with old method : 0.01573014259338379 length of segment : 146 time for calcul the mask position with numpy : 0.0003628730773925781 nb_pixel_total : 18940 time to create 1 rle with old method : 0.02144145965576172 length of segment : 209 time for calcul the mask position with numpy : 0.00022912025451660156 nb_pixel_total : 11933 time to create 1 rle with old method : 0.013820648193359375 length of segment : 120 time for calcul the mask position with numpy : 0.0018513202667236328 nb_pixel_total : 103692 time to create 1 rle with old method : 0.1198570728302002 length of segment : 623 time for calcul the mask position with numpy : 9.751319885253906e-05 nb_pixel_total : 3784 time to create 1 rle with old method : 0.004381418228149414 length of segment : 57 time for calcul the mask position with numpy : 0.00020122528076171875 nb_pixel_total : 11648 time to create 1 rle with old method : 0.013664484024047852 length of segment : 160 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 2584 time to create 1 rle with old method : 0.0032536983489990234 length of segment : 59 time for calcul the mask position with numpy : 0.0014195442199707031 nb_pixel_total : 89865 time to create 1 rle with old method : 0.1293342113494873 length of segment : 504 time for calcul the mask position with numpy : 0.000156402587890625 nb_pixel_total : 8672 time to create 1 rle with old method : 0.00981283187866211 length of segment : 89 time for calcul the mask position with numpy : 0.0002391338348388672 nb_pixel_total : 15485 time to create 1 rle with old method : 0.017440080642700195 length of segment : 139 time for calcul the mask position with numpy : 0.0001583099365234375 nb_pixel_total : 6458 time to create 1 rle with old method : 0.007843732833862305 length of segment : 148 time for calcul the mask position with numpy : 0.0013070106506347656 nb_pixel_total : 97737 time to create 1 rle with old method : 0.10782027244567871 length of segment : 533 time for calcul the mask position with numpy : 0.017788410186767578 nb_pixel_total : 1358352 time to create 1 rle with new method : 0.03441643714904785 length of segment : 1784 time for calcul the mask position with numpy : 0.0002551078796386719 nb_pixel_total : 6580 time to create 1 rle with old method : 0.007639169692993164 length of segment : 88 time for calcul the mask position with numpy : 0.0023403167724609375 nb_pixel_total : 101928 time to create 1 rle with old method : 0.11893510818481445 length of segment : 532 time for calcul the mask position with numpy : 0.0003230571746826172 nb_pixel_total : 9542 time to create 1 rle with old method : 0.01151132583618164 length of segment : 131 time for calcul the mask position with numpy : 0.0002961158752441406 nb_pixel_total : 10885 time to create 1 rle with old method : 0.01339578628540039 length of segment : 92 time for calcul the mask position with numpy : 0.0022554397583007812 nb_pixel_total : 105585 time to create 1 rle with old method : 0.12234234809875488 length of segment : 512 time for calcul the mask position with numpy : 0.0003807544708251953 nb_pixel_total : 9098 time to create 1 rle with old method : 0.011015892028808594 length of segment : 119 time for calcul the mask position with numpy : 0.0001926422119140625 nb_pixel_total : 5341 time to create 1 rle with old method : 0.006668567657470703 length of segment : 84 time for calcul the mask position with numpy : 0.0022993087768554688 nb_pixel_total : 113730 time to create 1 rle with old method : 0.13136720657348633 length of segment : 521 time for calcul the mask position with numpy : 0.0004968643188476562 nb_pixel_total : 15325 time to create 1 rle with old method : 0.018423080444335938 length of segment : 178 time for calcul the mask position with numpy : 0.00031948089599609375 nb_pixel_total : 8744 time to create 1 rle with old method : 0.010676860809326172 length of segment : 114 time for calcul the mask position with numpy : 0.0001361370086669922 nb_pixel_total : 2867 time to create 1 rle with old method : 0.0036382675170898438 length of segment : 51 time for calcul the mask position with numpy : 0.0009791851043701172 nb_pixel_total : 21828 time to create 1 rle with old method : 0.026291608810424805 length of segment : 316 time for calcul the mask position with numpy : 0.0021696090698242188 nb_pixel_total : 105667 time to create 1 rle with old method : 0.12473750114440918 length of segment : 531 time for calcul the mask position with numpy : 0.0001919269561767578 nb_pixel_total : 6735 time to create 1 rle with old method : 0.008155584335327148 length of segment : 146 time for calcul the mask position with numpy : 0.00021958351135253906 nb_pixel_total : 4498 time to create 1 rle with old method : 0.005496501922607422 length of segment : 100 time for calcul the mask position with numpy : 0.003004312515258789 nb_pixel_total : 102217 time to create 1 rle with old method : 0.12053394317626953 length of segment : 528 time for calcul the mask position with numpy : 0.001657247543334961 nb_pixel_total : 60624 time to create 1 rle with old method : 0.07090902328491211 length of segment : 465 time for calcul the mask position with numpy : 0.0002765655517578125 nb_pixel_total : 7010 time to create 1 rle with old method : 0.008486032485961914 length of segment : 124 time for calcul the mask position with numpy : 0.0002663135528564453 nb_pixel_total : 7480 time to create 1 rle with old method : 0.009217023849487305 length of segment : 113 time for calcul the mask position with numpy : 0.0008399486541748047 nb_pixel_total : 39061 time to create 1 rle with old method : 0.04488515853881836 length of segment : 234 time for calcul the mask position with numpy : 0.0006430149078369141 nb_pixel_total : 32349 time to create 1 rle with old method : 0.03819131851196289 length of segment : 236 time for calcul the mask position with numpy : 0.00021576881408691406 nb_pixel_total : 2754 time to create 1 rle with old method : 0.003410816192626953 length of segment : 100 time for calcul the mask position with numpy : 0.00028252601623535156 nb_pixel_total : 8868 time to create 1 rle with old method : 0.011018514633178711 length of segment : 107 time for calcul the mask position with numpy : 0.0002338886260986328 nb_pixel_total : 7610 time to create 1 rle with old method : 0.009400129318237305 length of segment : 91 time for calcul the mask position with numpy : 0.0003447532653808594 nb_pixel_total : 12672 time to create 1 rle with old method : 0.015017271041870117 length of segment : 122 time for calcul the mask position with numpy : 0.00018405914306640625 nb_pixel_total : 6881 time to create 1 rle with old method : 0.007973194122314453 length of segment : 102 time for calcul the mask position with numpy : 0.00031447410583496094 nb_pixel_total : 9258 time to create 1 rle with old method : 0.011396169662475586 length of segment : 124 time for calcul the mask position with numpy : 0.0004887580871582031 nb_pixel_total : 14479 time to create 1 rle with old method : 0.017838478088378906 length of segment : 117 time for calcul the mask position with numpy : 0.0002529621124267578 nb_pixel_total : 5712 time to create 1 rle with old method : 0.00702214241027832 length of segment : 87 time spent for convertir_results : 3.463280200958252 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 103 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 4702 save missing photos in datou_result : time spend for datou_step_exec : 22.473042726516724 time spend to save output : 1.0608325004577637 total time spend for step 1 : 23.533875226974487 step2:crop_condition Fri Oct 17 13:20:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 12 ! batch 1 Loaded 103 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 30 About to insert : list_path_to_insert length 30 new photo from crops ! About to upload 30 photos upload in portfolio : 3736932 init cache_photo without model_param we have 30 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760700057_1019607 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab_rle_crop_4000184378_0.png', 0, 156, 127, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab_rle_crop_4000201279_0.png', 0, 156, 127, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab_rle_crop_4000184377_0.png', 0, 132, 99, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab_rle_crop_4000201280_0.png', 0, 132, 99, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4_rle_crop_4000184382_0.png', 0, 108, 160, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4_rle_crop_4000201764_0.png', 0, 108, 160, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4_rle_crop_4000184383_0.png', 0, 56, 59, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4_rle_crop_4000201763_0.png', 0, 56, 59, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000184387_0.png', 0, 95, 148, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000201789_0.png', 0, 95, 148, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764608_89a9a3798b1b6776201ca54d6cd9be30_rle_crop_4000202069_0.png', 0, 125, 88, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764608_89a9a3798b1b6776201ca54d6cd9be30_rle_crop_4000184389_0.png', 0, 125, 88, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000184395_0.png', 0, 85, 84, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000202297_0.png', 0, 85, 84, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764572_46d696193f83e45b8c9c100bf20ba50e_rle_crop_4000184403_0.png', 0, 60, 99, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764572_46d696193f83e45b8c9c100bf20ba50e_rle_crop_4000207497_0.png', 0, 60, 99, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764570_0429b0fa025d1011a0dc2aac0a257d4e_rle_crop_4000207654_0.png', 0, 96, 113, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764570_0429b0fa025d1011a0dc2aac0a257d4e_rle_crop_4000184407_0.png', 0, 96, 113, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764570_0429b0fa025d1011a0dc2aac0a257d4e_rle_crop_4000207655_0.png', 0, 78, 123, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764570_0429b0fa025d1011a0dc2aac0a257d4e_rle_crop_4000184406_0.png', 0, 78, 123, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764566_bb988b36f2d8d72412fbc2cb4b54723b_rle_crop_4000184409_0.png', 0, 194, 234, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764566_bb988b36f2d8d72412fbc2cb4b54723b_rle_crop_4000207769_0.png', 0, 194, 234, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000184413_0.png', 0, 160, 122, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000208083_0.png', 0, 160, 122, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000184414_0.png', 0, 104, 89, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000208082_0.png', 0, 104, 89, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000184411_0.png', 0, 115, 107, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000208085_0.png', 0, 115, 107, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000184415_0.png', 0, 119, 121, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700065), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000208081_0.png', 0, 119, 121, 0, 1760700065,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 30 photos in the portfolio 3736932 time of upload the photos Elapsed time : 11.790567874908447 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760700069_1019607 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700070), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764608_89a9a3798b1b6776201ca54d6cd9be30_rle_crop_4000184391_0.png', 0, 111, 130, 0, 1760700070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700070), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764608_89a9a3798b1b6776201ca54d6cd9be30_rle_crop_4000202067_0.png', 0, 111, 130, 0, 1760700070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700070), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000205130_0.png', 0, 72, 145, 0, 1760700070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700070), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000184402_0.png', 0, 72, 145, 0, 1760700070,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.471329689025879 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 53 About to insert : list_path_to_insert length 53 new photo from crops ! About to upload 53 photos upload in portfolio : 3736932 init cache_photo without model_param we have 53 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760700087_1019607 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab_rle_crop_4000397889_0.png', 0, 128, 193, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab_rle_crop_4000201281_0.png', 0, 162, 85, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab_rle_crop_4000184376_0.png', 0, 162, 85, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f_rle_crop_4000184380_0.png', 0, 149, 120, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f_rle_crop_4000201538_0.png', 0, 149, 120, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f_rle_crop_4000184379_0.png', 0, 411, 522, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f_rle_crop_4000397890_0.png', 0, 394, 521, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f_rle_crop_4000201539_0.png', 0, 411, 522, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f_rle_crop_4000184381_0.png', 0, 85, 57, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f_rle_crop_4000201537_0.png', 0, 85, 57, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4_rle_crop_4000397891_0.png', 0, 312, 500, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4_rle_crop_4000184384_0.png', 0, 316, 503, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4_rle_crop_4000201762_0.png', 0, 316, 503, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000397893_0.png', 0, 1602, 1001, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000184386_0.png', 0, 162, 138, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000201790_0.png', 0, 162, 138, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000184385_0.png', 0, 119, 89, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000201791_0.png', 0, 119, 89, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000184388_0.png', 0, 318, 522, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000397892_0.png', 0, 322, 524, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000201788_0.png', 0, 318, 522, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764608_89a9a3798b1b6776201ca54d6cd9be30_rle_crop_4000184390_0.png', 0, 328, 531, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764608_89a9a3798b1b6776201ca54d6cd9be30_rle_crop_4000202068_0.png', 0, 328, 531, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000184392_0.png', 0, 140, 92, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000202300_0.png', 0, 140, 92, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000184394_0.png', 0, 105, 118, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000202298_0.png', 0, 105, 118, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000184393_0.png', 0, 348, 503, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000202299_0.png', 0, 348, 503, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764605_acf7b25c93e59df560b4efd9b9e590e0_rle_crop_4000184397_0.png', 0, 110, 178, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764605_acf7b25c93e59df560b4efd9b9e590e0_rle_crop_4000202785_0.png', 0, 110, 178, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764605_acf7b25c93e59df560b4efd9b9e590e0_rle_crop_4000184396_0.png', 0, 351, 539, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764605_acf7b25c93e59df560b4efd9b9e590e0_rle_crop_4000202786_0.png', 0, 351, 539, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764605_acf7b25c93e59df560b4efd9b9e590e0_rle_crop_4000397894_0.png', 0, 339, 520, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000184398_0.png', 0, 111, 113, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000205134_0.png', 0, 111, 113, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000184399_0.png', 0, 72, 49, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000205133_0.png', 0, 72, 49, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000184401_0.png', 0, 329, 505, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000205131_0.png', 0, 329, 505, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764572_46d696193f83e45b8c9c100bf20ba50e_rle_crop_4000397895_0.png', 0, 318, 520, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764572_46d696193f83e45b8c9c100bf20ba50e_rle_crop_4000184404_0.png', 0, 315, 513, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764572_46d696193f83e45b8c9c100bf20ba50e_rle_crop_4000207496_0.png', 0, 315, 513, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764570_0429b0fa025d1011a0dc2aac0a257d4e_rle_crop_4000184405_0.png', 0, 237, 463, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764570_0429b0fa025d1011a0dc2aac0a257d4e_rle_crop_4000207656_0.png', 0, 237, 463, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764566_bb988b36f2d8d72412fbc2cb4b54723b_rle_crop_4000184408_0.png', 0, 204, 234, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764566_bb988b36f2d8d72412fbc2cb4b54723b_rle_crop_4000207770_0.png', 0, 204, 234, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000208080_0.png', 0, 159, 112, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000184416_0.png', 0, 159, 112, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000184417_0.png', 0, 79, 85, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000208079_0.png', 0, 79, 85, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000184412_0.png', 0, 120, 91, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700100), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000208084_0.png', 0, 120, 91, 0, 1760700100,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 53 photos in the portfolio 3736932 time of upload the photos Elapsed time : 18.81904673576355 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760700107_1019607 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700107), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000184400_0.png', 0, 100, 314, 0, 1760700107,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700107), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000205132_0.png', 0, 100, 314, 0, 1760700107,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700107), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764566_bb988b36f2d8d72412fbc2cb4b54723b_rle_crop_4000184410_0.png', 0, 46, 112, 0, 1760700107,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760700107), 0.0, 0.0, 14, '', 0, 0, '1760700030_1019607_1389764566_bb988b36f2d8d72412fbc2cb4b54723b_rle_crop_4000207768_0.png', 0, 46, 112, 0, 1760700107,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.5244812965393066 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1389764636, 1389764634, 1389764610, 1389764609, 1389764608, 1389764606, 1389764605, 1389764603, 1389764572, 1389764570, 1389764566, 1389764561] Looping around the photos to save general results len do output : 91 /1389805578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389805770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764636', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764634', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764610', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764609', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764608', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764606', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764605', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764603', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764572', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764570', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764566', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764561', None, None, None, None, None, '3954326') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 285 time used for this insertion : 0.043409109115600586 save_final save missing photos in datou_result : time spend for datou_step_exec : 53.07191824913025 time spend to save output : 0.046512603759765625 total time spend for step 2 : 53.118430852890015 step3:rle_unique_nms_with_priority Fri Oct 17 13:21:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 103 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.14111828804016113 time for calcul the mask position with numpy : 0.005995512008666992 nb_pixel_total : 13825 time to create 1 rle with old method : 0.017301321029663086 time for calcul the mask position with numpy : 0.00644683837890625 nb_pixel_total : 7425 time to create 1 rle with old method : 0.008699417114257812 time for calcul the mask position with numpy : 0.008608341217041016 nb_pixel_total : 11157 time to create 1 rle with old method : 0.016739845275878906 time for calcul the mask position with numpy : 0.3624155521392822 nb_pixel_total : 2041193 time to create 1 rle with new method : 0.23073983192443848 create new chi : 0.6732950210571289 time to delete rle : 0.10175776481628418 batch 1 Loaded 8 chid ids of type : 3594 ++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.12957239151000977 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.11830854415893555 time for calcul the mask position with numpy : 0.005850791931152344 nb_pixel_total : 3784 time to create 1 rle with old method : 0.004430294036865234 time for calcul the mask position with numpy : 0.0065839290618896484 nb_pixel_total : 11947 time to create 1 rle with old method : 0.013902902603149414 time for calcul the mask position with numpy : 0.006909370422363281 nb_pixel_total : 109597 time to create 1 rle with old method : 0.1552436351776123 time for calcul the mask position with numpy : 0.08256411552429199 nb_pixel_total : 1948272 time to create 1 rle with new method : 0.04225492477416992 create new chi : 0.3241100311279297 time to delete rle : 0.0005071163177490234 batch 1 Loaded 8 chid ids of type : 3594 +++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.15600132942199707 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.12190055847167969 time for calcul the mask position with numpy : 0.007188558578491211 nb_pixel_total : 90995 time to create 1 rle with old method : 0.10698914527893066 time for calcul the mask position with numpy : 0.0061490535736083984 nb_pixel_total : 2583 time to create 1 rle with old method : 0.003052949905395508 time for calcul the mask position with numpy : 0.006069660186767578 nb_pixel_total : 11645 time to create 1 rle with old method : 0.013292312622070312 time for calcul the mask position with numpy : 0.023302555084228516 nb_pixel_total : 1968377 time to create 1 rle with new method : 0.16161203384399414 create new chi : 0.33759522438049316 time to delete rle : 0.0004687309265136719 batch 1 Loaded 8 chid ids of type : 3594 ++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.15213346481323242 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.5298047065734863 time for calcul the mask position with numpy : 0.0063855648040771484 nb_pixel_total : 77 time to create 1 rle with old method : 0.00030493736267089844 time for calcul the mask position with numpy : 0.010229349136352539 nb_pixel_total : 96009 time to create 1 rle with old method : 0.11604642868041992 time for calcul the mask position with numpy : 0.00600433349609375 nb_pixel_total : 6443 time to create 1 rle with old method : 0.008027315139770508 time for calcul the mask position with numpy : 0.010495901107788086 nb_pixel_total : 15435 time to create 1 rle with old method : 0.018390655517578125 time for calcul the mask position with numpy : 0.009431600570678711 nb_pixel_total : 8669 time to create 1 rle with old method : 0.010070085525512695 time for calcul the mask position with numpy : 0.04080700874328613 nb_pixel_total : 1946967 time to create 1 rle with new method : 0.08921504020690918 create new chi : 0.34046220779418945 time to delete rle : 0.0008630752563476562 batch 1 Loaded 12 chid ids of type : 3594 ++++++++++Number RLEs to save : 68 TO DO : save crop sub photo not yet done ! save time : 0.253986120223999 nb_obj : 4 nb_hashtags : 4 time to prepare the origin masks : 0.08046865463256836 time for calcul the mask position with numpy : 0.005794048309326172 nb_pixel_total : 9542 time to create 1 rle with old method : 0.010691642761230469 time for calcul the mask position with numpy : 0.0064966678619384766 nb_pixel_total : 101933 time to create 1 rle with old method : 0.11493539810180664 time for calcul the mask position with numpy : 0.0057947635650634766 nb_pixel_total : 6575 time to create 1 rle with old method : 0.007489204406738281 time for calcul the mask position with numpy : 0.033779144287109375 nb_pixel_total : 1955550 time to create 1 rle with new method : 0.15544700622558594 create new chi : 0.3541147708892822 time to delete rle : 0.0004696846008300781 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.1341238021850586 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.11762213706970215 time for calcul the mask position with numpy : 0.006127834320068359 nb_pixel_total : 5340 time to create 1 rle with old method : 0.006076812744140625 time for calcul the mask position with numpy : 0.00590062141418457 nb_pixel_total : 9095 time to create 1 rle with old method : 0.01046895980834961 time for calcul the mask position with numpy : 0.006333351135253906 nb_pixel_total : 105583 time to create 1 rle with old method : 0.12182378768920898 time for calcul the mask position with numpy : 0.00632786750793457 nb_pixel_total : 10884 time to create 1 rle with old method : 0.013414621353149414 time for calcul the mask position with numpy : 0.01914691925048828 nb_pixel_total : 1942698 time to create 1 rle with new method : 0.15683627128601074 create new chi : 0.3696725368499756 time to delete rle : 0.0004825592041015625 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.14937305450439453 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.08506250381469727 time for calcul the mask position with numpy : 0.006876230239868164 nb_pixel_total : 15245 time to create 1 rle with old method : 0.018846511840820312 time for calcul the mask position with numpy : 0.006648063659667969 nb_pixel_total : 4400 time to create 1 rle with old method : 0.005413532257080078 time for calcul the mask position with numpy : 0.006851673126220703 nb_pixel_total : 112987 time to create 1 rle with old method : 0.12946176528930664 time for calcul the mask position with numpy : 0.01956796646118164 nb_pixel_total : 1940968 time to create 1 rle with new method : 0.17604994773864746 create new chi : 0.37697577476501465 time to delete rle : 0.0004513263702392578 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 521 TO DO : save crop sub photo not yet done ! save time : 0.2883639335632324 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 0.25848937034606934 time for calcul the mask position with numpy : 0.005807399749755859 nb_pixel_total : 6735 time to create 1 rle with old method : 0.007726430892944336 time for calcul the mask position with numpy : 0.006505012512207031 nb_pixel_total : 105663 time to create 1 rle with old method : 0.12144732475280762 time for calcul the mask position with numpy : 0.007460832595825195 nb_pixel_total : 21842 time to create 1 rle with old method : 0.02527165412902832 time for calcul the mask position with numpy : 0.0070667266845703125 nb_pixel_total : 2865 time to create 1 rle with old method : 0.0037512779235839844 time for calcul the mask position with numpy : 0.006567716598510742 nb_pixel_total : 8744 time to create 1 rle with old method : 0.010332822799682617 time for calcul the mask position with numpy : 0.040912628173828125 nb_pixel_total : 1927751 time to create 1 rle with new method : 0.2717127799987793 create new chi : 0.5317325592041016 time to delete rle : 0.0006744861602783203 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.1791999340057373 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.10557699203491211 time for calcul the mask position with numpy : 0.005937814712524414 nb_pixel_total : 1295 time to create 1 rle with old method : 0.0018122196197509766 time for calcul the mask position with numpy : 0.0067141056060791016 nb_pixel_total : 100576 time to create 1 rle with old method : 0.11320900917053223 time for calcul the mask position with numpy : 0.006284475326538086 nb_pixel_total : 4492 time to create 1 rle with old method : 0.005120515823364258 time for calcul the mask position with numpy : 0.01931929588317871 nb_pixel_total : 1967237 time to create 1 rle with new method : 0.10021233558654785 create new chi : 0.27266645431518555 time to delete rle : 0.0006685256958007812 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 347 TO DO : save crop sub photo not yet done ! save time : 0.23636436462402344 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.08194422721862793 time for calcul the mask position with numpy : 0.007131814956665039 nb_pixel_total : 7480 time to create 1 rle with old method : 0.008516311645507812 time for calcul the mask position with numpy : 0.00593876838684082 nb_pixel_total : 7010 time to create 1 rle with old method : 0.00823664665222168 time for calcul the mask position with numpy : 0.0062732696533203125 nb_pixel_total : 60623 time to create 1 rle with old method : 0.06933927536010742 time for calcul the mask position with numpy : 0.022183656692504883 nb_pixel_total : 1998487 time to create 1 rle with new method : 0.04252195358276367 create new chi : 0.18188190460205078 time to delete rle : 0.0015420913696289062 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.13420748710632324 nb_obj : 4 nb_hashtags : 4 time to prepare the origin masks : 0.11923885345458984 time for calcul the mask position with numpy : 0.00661468505859375 nb_pixel_total : 2754 time to create 1 rle with old method : 0.0033147335052490234 time for calcul the mask position with numpy : 0.006275653839111328 nb_pixel_total : 32348 time to create 1 rle with old method : 0.037862300872802734 time for calcul the mask position with numpy : 0.006273984909057617 nb_pixel_total : 39063 time to create 1 rle with old method : 0.045624732971191406 time for calcul the mask position with numpy : 0.06828117370605469 nb_pixel_total : 1999435 time to create 1 rle with new method : 0.08015918731689453 create new chi : 0.2695624828338623 time to delete rle : 0.0004734992980957031 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.13135957717895508 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 0.36672472953796387 time for calcul the mask position with numpy : 0.0073778629302978516 nb_pixel_total : 5712 time to create 1 rle with old method : 0.006813526153564453 time for calcul the mask position with numpy : 0.006604433059692383 nb_pixel_total : 14480 time to create 1 rle with old method : 0.017045021057128906 time for calcul the mask position with numpy : 0.0063018798828125 nb_pixel_total : 9257 time to create 1 rle with old method : 0.010755538940429688 time for calcul the mask position with numpy : 0.005904197692871094 nb_pixel_total : 6881 time to create 1 rle with old method : 0.007691860198974609 time for calcul the mask position with numpy : 0.006219625473022461 nb_pixel_total : 12672 time to create 1 rle with old method : 0.014485836029052734 time for calcul the mask position with numpy : 0.006186962127685547 nb_pixel_total : 7611 time to create 1 rle with old method : 0.009452581405639648 time for calcul the mask position with numpy : 0.0059926509857177734 nb_pixel_total : 8868 time to create 1 rle with old method : 0.009919404983520508 time for calcul the mask position with numpy : 0.0410158634185791 nb_pixel_total : 2008119 time to create 1 rle with new method : 0.19358444213867188 create new chi : 0.3710367679595947 time to delete rle : 0.0004918575286865234 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.14947843551635742 map_output_result : {1389764636: (0.0, 'Should be the crop_list due to order', 0), 1389764634: (0.0, 'Should be the crop_list due to order', 0), 1389764610: (0.0, 'Should be the crop_list due to order', 0), 1389764609: (0.0, 'Should be the crop_list due to order', 0), 1389764608: (0.0, 'Should be the crop_list due to order', 0), 1389764606: (0.0, 'Should be the crop_list due to order', 0), 1389764605: (0.0, 'Should be the crop_list due to order', 0), 1389764603: (0.0, 'Should be the crop_list due to order', 0), 1389764572: (0.0, 'Should be the crop_list due to order', 0), 1389764570: (0.0, 'Should be the crop_list due to order', 0), 1389764566: (0.0, 'Should be the crop_list due to order', 0), 1389764561: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1389764636, 1389764634, 1389764610, 1389764609, 1389764608, 1389764606, 1389764605, 1389764603, 1389764572, 1389764570, 1389764566, 1389764561] Looping around the photos to save general results len do output : 12 /1389764636.Didn't retrieve data . /1389764634.Didn't retrieve data . /1389764610.Didn't retrieve data . /1389764609.Didn't retrieve data . /1389764608.Didn't retrieve data . /1389764606.Didn't retrieve data . /1389764605.Didn't retrieve data . /1389764603.Didn't retrieve data . /1389764572.Didn't retrieve data . /1389764570.Didn't retrieve data . /1389764566.Didn't retrieve data . /1389764561.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764636', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764634', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764610', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764609', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764608', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764606', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764605', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764603', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764572', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764570', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764566', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764561', None, None, None, None, None, '3954326') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.039992570877075195 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.453618288040161 time spend to save output : 0.04046797752380371 total time spend for step 3 : 9.494086265563965 step4:ventilate_hashtags_in_portfolio Fri Oct 17 13:21:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 27874709 get user id for portfolio 27874709 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27874709 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','mal_croppe','flou','pehd','carton','autre','environnement','pet_fonce','metal','papier','background')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27874709 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','mal_croppe','flou','pehd','carton','autre','environnement','pet_fonce','metal','papier','background')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/27875956,27875960,27875965,27875969,27875975,27875981,27875985,27875989,27875991,27875994,27875997?tags=pehd,metal,flou,pet_fonce,environnement,pet_clair,background,mal_croppe,carton,autre,papier Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1389764636, 1389764634, 1389764610, 1389764609, 1389764608, 1389764606, 1389764605, 1389764603, 1389764572, 1389764570, 1389764566, 1389764561] Looping around the photos to save general results len do output : 1 /27874709. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764636', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764634', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764610', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764609', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764608', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764606', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764605', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764603', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764572', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764570', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764566', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764561', None, None, None, None, None, '3954326') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.05176854133605957 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.679643630981445 time spend to save output : 0.052206993103027344 total time spend for step 4 : 4.731850624084473 step5:final Fri Oct 17 13:22:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1389764636: ('0.049758310828189316',), 1389764634: ('0.049758310828189316',), 1389764610: ('0.049758310828189316',), 1389764609: ('0.049758310828189316',), 1389764608: ('0.049758310828189316',), 1389764606: ('0.049758310828189316',), 1389764605: ('0.049758310828189316',), 1389764603: ('0.049758310828189316',), 1389764572: ('0.049758310828189316',), 1389764570: ('0.049758310828189316',), 1389764566: ('0.049758310828189316',), 1389764561: ('0.049758310828189316',)} new output for save of step final : {1389764636: ('0.049758310828189316',), 1389764634: ('0.049758310828189316',), 1389764610: ('0.049758310828189316',), 1389764609: ('0.049758310828189316',), 1389764608: ('0.049758310828189316',), 1389764606: ('0.049758310828189316',), 1389764605: ('0.049758310828189316',), 1389764603: ('0.049758310828189316',), 1389764572: ('0.049758310828189316',), 1389764570: ('0.049758310828189316',), 1389764566: ('0.049758310828189316',), 1389764561: ('0.049758310828189316',)} [1389764636, 1389764634, 1389764610, 1389764609, 1389764608, 1389764606, 1389764605, 1389764603, 1389764572, 1389764570, 1389764566, 1389764561] Looping around the photos to save general results len do output : 12 /1389764636.Didn't retrieve data . /1389764634.Didn't retrieve data . /1389764610.Didn't retrieve data . /1389764609.Didn't retrieve data . /1389764608.Didn't retrieve data . /1389764606.Didn't retrieve data . /1389764605.Didn't retrieve data . /1389764603.Didn't retrieve data . /1389764572.Didn't retrieve data . /1389764570.Didn't retrieve data . /1389764566.Didn't retrieve data . /1389764561.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764636', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764634', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764610', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764609', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764608', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764606', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764605', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764603', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764572', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764570', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764566', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764561', None, None, None, None, None, '3954326') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.03705120086669922 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.3726520538330078 time spend to save output : 0.03762507438659668 total time spend for step 5 : 0.4102771282196045 step6:blur_detection Fri Oct 17 13:22:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab.jpg resize: (1080, 1920) 1389764636 0.8096752346259904 treat image : temp/1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f.jpg resize: (1080, 1920) 1389764634 0.8406778615670669 treat image : temp/1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4.jpg resize: (1080, 1920) 1389764610 2.2996567563875256 treat image : temp/1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d.jpg resize: (1080, 1920) 1389764609 6.736801450470669 treat image : temp/1760700030_1019607_1389764608_89a9a3798b1b6776201ca54d6cd9be30.jpg resize: (1080, 1920) 1389764608 0.39633268123674414 treat image : temp/1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af.jpg resize: (1080, 1920) 1389764606 0.7914461525917648 treat image : temp/1760700030_1019607_1389764605_acf7b25c93e59df560b4efd9b9e590e0.jpg resize: (1080, 1920) 1389764605 -0.884025394455332 treat image : temp/1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75.jpg resize: (1080, 1920) 1389764603 0.33905204553340845 treat image : temp/1760700030_1019607_1389764572_46d696193f83e45b8c9c100bf20ba50e.jpg resize: (1080, 1920) 1389764572 -0.024113477597416666 treat image : temp/1760700030_1019607_1389764570_0429b0fa025d1011a0dc2aac0a257d4e.jpg resize: (1080, 1920) 1389764570 -0.6961744518253122 treat image : temp/1760700030_1019607_1389764566_bb988b36f2d8d72412fbc2cb4b54723b.jpg resize: (1080, 1920) 1389764566 0.6631562936152469 treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872.jpg resize: (1080, 1920) 1389764561 -1.1183750672729396 treat image : temp/1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab_rle_crop_4000184378_0.png resize: (127, 156) 1389805578 1.4453981324465102 treat image : temp/1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab_rle_crop_4000201279_0.png resize: (127, 156) 1389805579 1.4453981324465102 treat image : temp/1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab_rle_crop_4000184377_0.png resize: (99, 132) 1389805590 -2.055185401114005 treat image : temp/1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab_rle_crop_4000201280_0.png resize: (99, 132) 1389805604 -2.055185401114005 treat image : temp/1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4_rle_crop_4000184382_0.png resize: (160, 108) 1389805616 1.0620243755065044 treat image : temp/1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4_rle_crop_4000201764_0.png resize: (160, 108) 1389805617 1.0620243755065044 treat image : temp/1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4_rle_crop_4000184383_0.png resize: (59, 56) 1389805618 4.454716014893854 treat image : temp/1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4_rle_crop_4000201763_0.png resize: (59, 56) 1389805619 4.454716014893854 treat image : temp/1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000184387_0.png resize: (148, 95) 1389805620 -2.059861671323876 treat image : temp/1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000201789_0.png resize: (148, 95) 1389805621 -2.059861671323876 treat image : temp/1760700030_1019607_1389764608_89a9a3798b1b6776201ca54d6cd9be30_rle_crop_4000202069_0.png resize: (88, 125) 1389805622 -1.7537780848577873 treat image : temp/1760700030_1019607_1389764608_89a9a3798b1b6776201ca54d6cd9be30_rle_crop_4000184389_0.png resize: (88, 125) 1389805623 -1.7537780848577873 treat image : temp/1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000184395_0.png resize: (84, 85) 1389805624 -3.6432140752519238 treat image : temp/1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000202297_0.png resize: (84, 85) 1389805625 -3.6432140752519238 treat image : temp/1760700030_1019607_1389764572_46d696193f83e45b8c9c100bf20ba50e_rle_crop_4000184403_0.png resize: (99, 60) 1389805627 -0.29903827538903055 treat image : temp/1760700030_1019607_1389764572_46d696193f83e45b8c9c100bf20ba50e_rle_crop_4000207497_0.png resize: (99, 60) 1389805630 -0.29903827538903055 treat image : temp/1760700030_1019607_1389764570_0429b0fa025d1011a0dc2aac0a257d4e_rle_crop_4000207654_0.png resize: (113, 96) 1389805631 -0.8778260995066883 treat image : temp/1760700030_1019607_1389764570_0429b0fa025d1011a0dc2aac0a257d4e_rle_crop_4000184407_0.png resize: (113, 96) 1389805632 -0.8778260995066883 treat image : temp/1760700030_1019607_1389764570_0429b0fa025d1011a0dc2aac0a257d4e_rle_crop_4000207655_0.png resize: (123, 78) 1389805633 -0.20656713365661827 treat image : temp/1760700030_1019607_1389764570_0429b0fa025d1011a0dc2aac0a257d4e_rle_crop_4000184406_0.png resize: (123, 78) 1389805634 -0.20656713365661827 treat image : temp/1760700030_1019607_1389764566_bb988b36f2d8d72412fbc2cb4b54723b_rle_crop_4000184409_0.png resize: (234, 194) 1389805635 -0.7334221666403417 treat image : temp/1760700030_1019607_1389764566_bb988b36f2d8d72412fbc2cb4b54723b_rle_crop_4000207769_0.png resize: (234, 194) 1389805636 -0.7334221666403417 treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000184413_0.png resize: (122, 160) 1389805637 -2.0242730004799148 treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000208083_0.png resize: (122, 160) 1389805638 -2.0242730004799148 treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000184414_0.png resize: (89, 104) 1389805639 -2.075630001084129 treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000208082_0.png resize: (89, 104) 1389805640 -2.075630001084129 treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000184411_0.png resize: (107, 115) 1389805641 -0.8090453409436683 treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000208085_0.png resize: (107, 115) 1389805642 -0.8090453409436683 treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000184415_0.png resize: (121, 119) 1389805643 -1.2438383069691967 treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000208081_0.png resize: (121, 119) 1389805644 -1.2438383069691967 treat image : temp/1760700030_1019607_1389764608_89a9a3798b1b6776201ca54d6cd9be30_rle_crop_4000184391_0.png resize: (130, 111) 1389805652 -1.8598165706825034 treat image : temp/1760700030_1019607_1389764608_89a9a3798b1b6776201ca54d6cd9be30_rle_crop_4000202067_0.png resize: (130, 111) 1389805653 -1.8598165706825034 treat image : temp/1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000205130_0.png resize: (145, 72) 1389805654 -1.4258962075476758 treat image : temp/1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000184402_0.png resize: (145, 72) 1389805655 -1.4258962075476758 treat image : temp/1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab_rle_crop_4000397889_0.png resize: (193, 128) 1389805704 -1.2034249211549055 treat image : temp/1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab_rle_crop_4000201281_0.png resize: (85, 162) 1389805705 -0.8576719053306067 treat image : temp/1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab_rle_crop_4000184376_0.png resize: (85, 162) 1389805706 -0.8576719053306067 treat image : temp/1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f_rle_crop_4000184380_0.png resize: (120, 149) 1389805707 -3.3729653983095695 treat image : temp/1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f_rle_crop_4000201538_0.png resize: (120, 149) 1389805708 -3.3729653983095695 treat image : temp/1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f_rle_crop_4000184379_0.png resize: (522, 411) 1389805709 -0.09462390447104896 treat image : temp/1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f_rle_crop_4000397890_0.png resize: (521, 394) 1389805710 -0.37739271980260686 treat image : temp/1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f_rle_crop_4000201539_0.png resize: (522, 411) 1389805711 -0.09462390447104896 treat image : temp/1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f_rle_crop_4000184381_0.png resize: (57, 85) 1389805712 -4.335009664854822 treat image : temp/1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f_rle_crop_4000201537_0.png resize: (57, 85) 1389805713 -4.335009664854822 treat image : temp/1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4_rle_crop_4000397891_0.png resize: (500, 312) 1389805714 -0.40312526559328626 treat image : temp/1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4_rle_crop_4000184384_0.png resize: (503, 316) 1389805715 -0.4389563581787875 treat image : temp/1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4_rle_crop_4000201762_0.png resize: (503, 316) 1389805716 -0.4389563581787875 treat image : temp/1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000397893_0.png resize: (1001, 1602) 1389805717 0.04791187822403093 treat image : temp/1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000184386_0.png resize: (138, 162) 1389805718 0.2712477591081518 treat image : temp/1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000201790_0.png resize: (138, 162) 1389805719 0.2769611290692785 treat image : temp/1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000184385_0.png resize: (89, 119) 1389805720 1.4004220808856611 treat image : temp/1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000201791_0.png resize: (89, 119) 1389805721 1.4004220808856611 treat image : temp/1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000184388_0.png resize: (522, 318) 1389805722 0.3337154712828137 treat image : temp/1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000397892_0.png resize: (524, 322) 1389805723 0.34196642505493774 treat image : temp/1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000201788_0.png resize: (522, 318) 1389805724 0.3337154712828137 treat image : temp/1760700030_1019607_1389764608_89a9a3798b1b6776201ca54d6cd9be30_rle_crop_4000184390_0.png resize: (531, 328) 1389805725 0.3133962109168993 treat image : temp/1760700030_1019607_1389764608_89a9a3798b1b6776201ca54d6cd9be30_rle_crop_4000202068_0.png resize: (531, 328) 1389805726 0.3133962109168993 treat image : temp/1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000184392_0.png resize: (92, 140) 1389805727 -2.443804809025224 treat image : temp/1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000202300_0.png resize: (92, 140) 1389805728 -2.443804809025224 treat image : temp/1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000184394_0.png resize: (118, 105) 1389805729 -2.1002923910647753 treat image : temp/1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000202298_0.png resize: (118, 105) 1389805730 -2.1002923910647753 treat image : temp/1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000184393_0.png resize: (503, 348) 1389805731 0.25436213111697215 treat image : temp/1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000202299_0.png resize: (503, 348) 1389805732 0.25436213111697215 treat image : temp/1760700030_1019607_1389764605_acf7b25c93e59df560b4efd9b9e590e0_rle_crop_4000184397_0.png resize: (178, 110) 1389805733 -2.3891477090446505 treat image : temp/1760700030_1019607_1389764605_acf7b25c93e59df560b4efd9b9e590e0_rle_crop_4000202785_0.png resize: (178, 110) 1389805734 -2.3891477090446505 treat image : temp/1760700030_1019607_1389764605_acf7b25c93e59df560b4efd9b9e590e0_rle_crop_4000184396_0.png resize: (539, 351) 1389805735 0.16357468571113915 treat image : temp/1760700030_1019607_1389764605_acf7b25c93e59df560b4efd9b9e590e0_rle_crop_4000202786_0.png resize: (539, 351) 1389805736 0.16357468571113915 treat image : temp/1760700030_1019607_1389764605_acf7b25c93e59df560b4efd9b9e590e0_rle_crop_4000397894_0.png resize: (520, 339) 1389805737 0.22443565034146232 treat image : temp/1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000184398_0.png resize: (113, 111) 1389805738 -2.931405317136638 treat image : temp/1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000205134_0.png resize: (113, 111) 1389805740 -2.931405317136638 treat image : temp/1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000184399_0.png resize: (49, 72) 1389805741 -0.8330700160346349 treat image : temp/1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000205133_0.png resize: (49, 72) 1389805742 -0.8330700160346349 treat image : temp/1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000184401_0.png resize: (505, 329) 1389805743 0.05619861715146724 treat image : temp/1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000205131_0.png resize: (505, 329) 1389805744 0.05619861715146724 treat image : temp/1760700030_1019607_1389764572_46d696193f83e45b8c9c100bf20ba50e_rle_crop_4000397895_0.png resize: (520, 318) 1389805745 -0.3738619230063314 treat image : temp/1760700030_1019607_1389764572_46d696193f83e45b8c9c100bf20ba50e_rle_crop_4000184404_0.png resize: (513, 315) 1389805746 -0.381657715106336 treat image : temp/1760700030_1019607_1389764572_46d696193f83e45b8c9c100bf20ba50e_rle_crop_4000207496_0.png resize: (513, 315) 1389805747 -0.381657715106336 treat image : temp/1760700030_1019607_1389764570_0429b0fa025d1011a0dc2aac0a257d4e_rle_crop_4000184405_0.png resize: (463, 237) 1389805748 -1.4269164686276974 treat image : temp/1760700030_1019607_1389764570_0429b0fa025d1011a0dc2aac0a257d4e_rle_crop_4000207656_0.png resize: (463, 237) 1389805749 -1.4269164686276974 treat image : temp/1760700030_1019607_1389764566_bb988b36f2d8d72412fbc2cb4b54723b_rle_crop_4000184408_0.png resize: (234, 204) 1389805750 -0.29266283803258974 treat image : temp/1760700030_1019607_1389764566_bb988b36f2d8d72412fbc2cb4b54723b_rle_crop_4000207770_0.png resize: (234, 204) 1389805751 -0.29266283803258974 treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000208080_0.png resize: (112, 159) 1389805752 -5.865103278240029 treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000184416_0.png resize: (112, 159) 1389805753 -5.865103278240029 treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000184417_0.png resize: (85, 79) 1389805754 -3.5465475411991165 treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000208079_0.png resize: (85, 79) 1389805755 -3.5465475411991165 treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000184412_0.png resize: (91, 120) 1389805756 -4.024721988823009 treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000208084_0.png resize: (91, 120) 1389805757 -4.024721988823009 treat image : temp/1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000184400_0.png resize: (314, 100) 1389805760 -0.8987370875250194 treat image : temp/1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000205132_0.png resize: (314, 100) 1389805768 -0.8987370875250194 treat image : temp/1760700030_1019607_1389764566_bb988b36f2d8d72412fbc2cb4b54723b_rle_crop_4000184410_0.png resize: (112, 46) 1389805769 -1.1049233518135713 treat image : temp/1760700030_1019607_1389764566_bb988b36f2d8d72412fbc2cb4b54723b_rle_crop_4000207768_0.png resize: (112, 46) 1389805770 -1.1049233518135713 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 103 time used for this insertion : 0.03803300857543945 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 103 time used for this insertion : 0.0743408203125 save missing photos in datou_result : time spend for datou_step_exec : 11.477573156356812 time spend to save output : 0.1306607723236084 total time spend for step 6 : 11.60823392868042 step7:brightness Fri Oct 17 13:22:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab.jpg treat image : temp/1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f.jpg treat image : temp/1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4.jpg treat image : temp/1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d.jpg treat image : temp/1760700030_1019607_1389764608_89a9a3798b1b6776201ca54d6cd9be30.jpg treat image : temp/1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af.jpg treat image : temp/1760700030_1019607_1389764605_acf7b25c93e59df560b4efd9b9e590e0.jpg treat image : temp/1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75.jpg treat image : temp/1760700030_1019607_1389764572_46d696193f83e45b8c9c100bf20ba50e.jpg treat image : temp/1760700030_1019607_1389764570_0429b0fa025d1011a0dc2aac0a257d4e.jpg treat image : temp/1760700030_1019607_1389764566_bb988b36f2d8d72412fbc2cb4b54723b.jpg treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872.jpg treat image : temp/1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab_rle_crop_4000184378_0.png treat image : temp/1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab_rle_crop_4000201279_0.png treat image : temp/1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab_rle_crop_4000184377_0.png treat image : temp/1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab_rle_crop_4000201280_0.png treat image : temp/1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4_rle_crop_4000184382_0.png treat image : temp/1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4_rle_crop_4000201764_0.png treat image : temp/1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4_rle_crop_4000184383_0.png treat image : temp/1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4_rle_crop_4000201763_0.png treat image : temp/1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000184387_0.png treat image : temp/1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000201789_0.png treat image : temp/1760700030_1019607_1389764608_89a9a3798b1b6776201ca54d6cd9be30_rle_crop_4000202069_0.png treat image : temp/1760700030_1019607_1389764608_89a9a3798b1b6776201ca54d6cd9be30_rle_crop_4000184389_0.png treat image : temp/1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000184395_0.png treat image : temp/1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000202297_0.png treat image : temp/1760700030_1019607_1389764572_46d696193f83e45b8c9c100bf20ba50e_rle_crop_4000184403_0.png treat image : temp/1760700030_1019607_1389764572_46d696193f83e45b8c9c100bf20ba50e_rle_crop_4000207497_0.png treat image : temp/1760700030_1019607_1389764570_0429b0fa025d1011a0dc2aac0a257d4e_rle_crop_4000207654_0.png treat image : temp/1760700030_1019607_1389764570_0429b0fa025d1011a0dc2aac0a257d4e_rle_crop_4000184407_0.png treat image : temp/1760700030_1019607_1389764570_0429b0fa025d1011a0dc2aac0a257d4e_rle_crop_4000207655_0.png treat image : temp/1760700030_1019607_1389764570_0429b0fa025d1011a0dc2aac0a257d4e_rle_crop_4000184406_0.png treat image : temp/1760700030_1019607_1389764566_bb988b36f2d8d72412fbc2cb4b54723b_rle_crop_4000184409_0.png treat image : temp/1760700030_1019607_1389764566_bb988b36f2d8d72412fbc2cb4b54723b_rle_crop_4000207769_0.png treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000184413_0.png treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000208083_0.png treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000184414_0.png treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000208082_0.png treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000184411_0.png treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000208085_0.png treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000184415_0.png treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000208081_0.png treat image : temp/1760700030_1019607_1389764608_89a9a3798b1b6776201ca54d6cd9be30_rle_crop_4000184391_0.png treat image : temp/1760700030_1019607_1389764608_89a9a3798b1b6776201ca54d6cd9be30_rle_crop_4000202067_0.png treat image : temp/1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000205130_0.png treat image : temp/1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000184402_0.png treat image : temp/1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab_rle_crop_4000397889_0.png treat image : temp/1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab_rle_crop_4000201281_0.png treat image : temp/1760700030_1019607_1389764636_4469a85a4c6f6ea1e1064b01154defab_rle_crop_4000184376_0.png treat image : temp/1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f_rle_crop_4000184380_0.png treat image : temp/1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f_rle_crop_4000201538_0.png treat image : temp/1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f_rle_crop_4000184379_0.png treat image : temp/1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f_rle_crop_4000397890_0.png treat image : temp/1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f_rle_crop_4000201539_0.png treat image : temp/1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f_rle_crop_4000184381_0.png treat image : temp/1760700030_1019607_1389764634_23b30cf4629d4733eb8d2a7b7612074f_rle_crop_4000201537_0.png treat image : temp/1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4_rle_crop_4000397891_0.png treat image : temp/1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4_rle_crop_4000184384_0.png treat image : temp/1760700030_1019607_1389764610_6cdea7870baf05eea2ac6da7cb5414c4_rle_crop_4000201762_0.png treat image : temp/1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000397893_0.png treat image : temp/1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000184386_0.png treat image : temp/1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000201790_0.png treat image : temp/1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000184385_0.png treat image : temp/1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000201791_0.png treat image : temp/1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000184388_0.png treat image : temp/1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000397892_0.png treat image : temp/1760700030_1019607_1389764609_51c68961b60efdbbac91d6ec1357e04d_rle_crop_4000201788_0.png treat image : temp/1760700030_1019607_1389764608_89a9a3798b1b6776201ca54d6cd9be30_rle_crop_4000184390_0.png treat image : temp/1760700030_1019607_1389764608_89a9a3798b1b6776201ca54d6cd9be30_rle_crop_4000202068_0.png treat image : temp/1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000184392_0.png treat image : temp/1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000202300_0.png treat image : temp/1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000184394_0.png treat image : temp/1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000202298_0.png treat image : temp/1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000184393_0.png treat image : temp/1760700030_1019607_1389764606_41d6392374b64d0bba009db3541fb3af_rle_crop_4000202299_0.png treat image : temp/1760700030_1019607_1389764605_acf7b25c93e59df560b4efd9b9e590e0_rle_crop_4000184397_0.png treat image : temp/1760700030_1019607_1389764605_acf7b25c93e59df560b4efd9b9e590e0_rle_crop_4000202785_0.png treat image : temp/1760700030_1019607_1389764605_acf7b25c93e59df560b4efd9b9e590e0_rle_crop_4000184396_0.png treat image : temp/1760700030_1019607_1389764605_acf7b25c93e59df560b4efd9b9e590e0_rle_crop_4000202786_0.png treat image : temp/1760700030_1019607_1389764605_acf7b25c93e59df560b4efd9b9e590e0_rle_crop_4000397894_0.png treat image : temp/1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000184398_0.png treat image : temp/1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000205134_0.png treat image : temp/1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000184399_0.png treat image : temp/1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000205133_0.png treat image : temp/1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000184401_0.png treat image : temp/1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000205131_0.png treat image : temp/1760700030_1019607_1389764572_46d696193f83e45b8c9c100bf20ba50e_rle_crop_4000397895_0.png treat image : temp/1760700030_1019607_1389764572_46d696193f83e45b8c9c100bf20ba50e_rle_crop_4000184404_0.png treat image : temp/1760700030_1019607_1389764572_46d696193f83e45b8c9c100bf20ba50e_rle_crop_4000207496_0.png treat image : temp/1760700030_1019607_1389764570_0429b0fa025d1011a0dc2aac0a257d4e_rle_crop_4000184405_0.png treat image : temp/1760700030_1019607_1389764570_0429b0fa025d1011a0dc2aac0a257d4e_rle_crop_4000207656_0.png treat image : temp/1760700030_1019607_1389764566_bb988b36f2d8d72412fbc2cb4b54723b_rle_crop_4000184408_0.png treat image : temp/1760700030_1019607_1389764566_bb988b36f2d8d72412fbc2cb4b54723b_rle_crop_4000207770_0.png treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000208080_0.png treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000184416_0.png treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000184417_0.png treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000208079_0.png treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000184412_0.png treat image : temp/1760700030_1019607_1389764561_010e3a6e446d919c826de83e5603e872_rle_crop_4000208084_0.png treat image : temp/1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000184400_0.png treat image : temp/1760700030_1019607_1389764603_e4213097856be9f90773c147a4ffda75_rle_crop_4000205132_0.png treat image : temp/1760700030_1019607_1389764566_bb988b36f2d8d72412fbc2cb4b54723b_rle_crop_4000184410_0.png treat image : temp/1760700030_1019607_1389764566_bb988b36f2d8d72412fbc2cb4b54723b_rle_crop_4000207768_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 103 time used for this insertion : 0.043503522872924805 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 103 time used for this insertion : 0.07534551620483398 save missing photos in datou_result : time spend for datou_step_exec : 3.396951198577881 time spend to save output : 0.13705658912658691 total time spend for step 7 : 3.5340077877044678 step8:velours_tree Fri Oct 17 13:22:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09328675270080566 time spend to save output : 3.7670135498046875e-05 total time spend for step 8 : 0.09332442283630371 step9:send_mail_cod Fri Oct 17 13:22:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P27874709_17-10-2025_13_22_18.pdf 27875956 imagette278759561760700138 27875960 imagette278759601760700138 27875965 imagette278759651760700138 27875969 imagette278759691760700138 27875981 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette278759811760700138 27875985 imagette278759851760700140 27875989 imagette278759891760700140 27875991 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette278759911760700140 27875994 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette278759941760700140 27875997 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette278759971760700141 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=27874709 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/27875956,27875960,27875965,27875969,27875975,27875981,27875985,27875989,27875991,27875994,27875997?tags=pehd,metal,flou,pet_fonce,environnement,pet_clair,background,mal_croppe,carton,autre,papier args[1389764636] : ((1389764636, 0.8096752346259904, 492688767), (1389764636, 0.5148855664201739, 2107752395), '0.049758310828189316') We are sending mail with results at report@fotonower.com args[1389764634] : ((1389764634, 0.8406778615670669, 492688767), (1389764634, 0.6176076294580746, 2107752395), '0.049758310828189316') We are sending mail with results at report@fotonower.com args[1389764610] : ((1389764610, 2.2996567563875256, 492688767), (1389764610, 0.6963404443096278, 2107752395), '0.049758310828189316') We are sending mail with results at report@fotonower.com args[1389764609] : ((1389764609, 6.736801450470669, 492688767), (1389764609, 0.3135903091271522, 2107752395), '0.049758310828189316') We are sending mail with results at report@fotonower.com args[1389764608] : ((1389764608, 0.39633268123674414, 492688767), (1389764608, 0.27569133251052613, 2107752395), '0.049758310828189316') We are sending mail with results at report@fotonower.com args[1389764606] : ((1389764606, 0.7914461525917648, 492688767), (1389764606, 0.4304077938277518, 2107752395), '0.049758310828189316') We are sending mail with results at report@fotonower.com args[1389764605] : ((1389764605, -0.884025394455332, 492688767), (1389764605, 0.37567243970798186, 2107752395), '0.049758310828189316') We are sending mail with results at report@fotonower.com args[1389764603] : ((1389764603, 0.33905204553340845, 492688767), (1389764603, 0.6034832989701401, 2107752395), '0.049758310828189316') We are sending mail with results at report@fotonower.com args[1389764572] : ((1389764572, -0.024113477597416666, 492688767), (1389764572, 0.4853120664140003, 2107752395), '0.049758310828189316') We are sending mail with results at report@fotonower.com args[1389764570] : ((1389764570, -0.6961744518253122, 492688767), (1389764570, 0.6684451228244312, 2107752395), '0.049758310828189316') We are sending mail with results at report@fotonower.com args[1389764566] : ((1389764566, 0.6631562936152469, 492688767), (1389764566, 0.43036668679585677, 2107752395), '0.049758310828189316') We are sending mail with results at report@fotonower.com args[1389764561] : ((1389764561, -1.1183750672729396, 492688767), (1389764561, 0.2515439455649103, 2107752395), '0.049758310828189316') We are sending mail with results at report@fotonower.com refus_total : 0.049758310828189316 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=27874709 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27874709_17-10-2025_13_22_18.pdf results_Auto_P27874709_17-10-2025_13_22_18.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27874709_17-10-2025_13_22_18.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','27874709','results_Auto_P27874709_17-10-2025_13_22_18.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27874709_17-10-2025_13_22_18.pdf','pdf','','0.21','0.049758310828189316') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/27874709

https://www.fotonower.com/image?json=false&list_photos_id=1389764636
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389764634
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389764610
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.2996567563875256)
https://www.fotonower.com/image?json=false&list_photos_id=1389764609
La photo est trop floue, merci de reprendre une photo.(avec le score = 6.736801450470669)
https://www.fotonower.com/image?json=false&list_photos_id=1389764608
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389764606
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389764605
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389764603
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389764572
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389764570
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389764566
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389764561
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 4.98%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/27875981?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/27875991?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/27875994?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/27875997?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27874709_17-10-2025_13_22_18.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/27875956,27875960,27875965,27875969,27875975,27875981,27875985,27875989,27875991,27875994,27875997?tags=pehd,metal,flou,pet_fonce,environnement,pet_clair,background,mal_croppe,carton,autre,papier.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 17 Oct 2025 11:22:24 GMT Content-Length: 0 Connection: close X-Message-Id: Xm-kEmUWTG6UVfVZjE-LYg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1389764636, 1389764634, 1389764610, 1389764609, 1389764608, 1389764606, 1389764605, 1389764603, 1389764572, 1389764570, 1389764566, 1389764561] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764636', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764634', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764610', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764609', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764608', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764606', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764605', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764603', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764572', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764570', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764566', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764561', None, None, None, None, None, '3954326') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.09646034240722656 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.535322189331055 time spend to save output : 0.0967109203338623 total time spend for step 9 : 6.632033109664917 step10:split_time_score Fri Oct 17 13:22:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('07', 12),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 17102025 27874709 Nombre de photos uploadées : 12 / 23040 (0%) 17102025 27874709 Nombre de photos taguées (types de déchets): 0 / 12 (0%) 17102025 27874709 Nombre de photos taguées (volume) : 0 / 12 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 1.1920928955078125e-05 ???????????? elapsed_time : fill_and_build_computed_from_old_data 0.0006933212280273438 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.6423218250274658 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.049758310828189316 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27874709_17-10-2025_13_22_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27874709 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27874709 AND mptpi.`type`=3594 To do Qualite : 0.05309957837301587 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27874712_17-10-2025_11_24_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27874712 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27874712 AND mptpi.`type`=3594 To do Qualite : 0.11311177248677245 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27874751_17-10-2025_11_02_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27874751 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27874751 AND mptpi.`type`=3594 To do Qualite : 0.033860918209876543 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27880127_17-10-2025_13_11_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27880127 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27880127 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'17102025': {'nb_upload': 12, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1389764636, 1389764634, 1389764610, 1389764609, 1389764608, 1389764606, 1389764605, 1389764603, 1389764572, 1389764570, 1389764566, 1389764561] Looping around the photos to save general results len do output : 1 /27874709Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764636', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764634', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764610', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764609', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764608', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764606', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764605', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764603', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764572', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764570', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764566', None, None, None, None, None, '3954326') ('3318', None, None, None, None, None, None, None, '3954326') ('3318', '27874709', '1389764561', None, None, None, None, None, '3954326') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.037117958068847656 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.1406443119049072 time spend to save output : 0.03739595413208008 total time spend for step 10 : 2.1780402660369873 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 12 set_done_treatment 56.25user 16.42system 2:01.89elapsed 59%CPU (0avgtext+0avgdata 2834380maxresident)k 1440inputs+29904outputs (38major+1347412minor)pagefaults 0swaps