python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3325632 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4066416'] with mtr_portfolio_ids : ['28657922'] and first list_photo_ids : [] new path : /proc/3325632/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 0.9506776332855225 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Nov 18 13:10:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4359 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-11-18 13:10:31.989966: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-11-18 13:10:31.997597: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-11-18 13:10:31.999016: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f9d54000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-11-18 13:10:31.999070: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-11-18 13:10:32.001628: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-11-18 13:10:32.212780: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7244660 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-11-18 13:10:32.212842: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-11-18 13:10:32.214076: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-18 13:10:32.214554: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-18 13:10:32.217590: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-18 13:10:32.220519: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-18 13:10:32.221060: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-18 13:10:32.224230: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-18 13:10:32.225274: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-18 13:10:32.229552: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-18 13:10:32.230691: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-18 13:10:32.230770: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-18 13:10:32.231379: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-18 13:10:32.231395: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-18 13:10:32.231404: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-18 13:10:32.232392: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3754 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-11-18 13:10:32.513143: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-18 13:10:32.513838: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-18 13:10:32.513864: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-18 13:10:32.513890: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-18 13:10:32.513914: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-18 13:10:32.513937: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-18 13:10:32.513960: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-18 13:10:32.513985: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-18 13:10:32.515271: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-18 13:10:32.517181: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-18 13:10:32.517216: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-18 13:10:32.517232: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-18 13:10:32.517246: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-18 13:10:32.517260: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-18 13:10:32.517274: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-18 13:10:32.517287: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-18 13:10:32.517301: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-18 13:10:32.518146: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-18 13:10:32.518185: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-18 13:10:32.518193: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-18 13:10:32.518200: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-18 13:10:32.519160: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3754 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-11-18 13:10:44.760641: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-18 13:10:44.769146: E tensorflow/stream_executor/cuda/cuda_blas.cc:238] failed to create cublas handle: CUBLAS_STATUS_NOT_INITIALIZED 2025-11-18 13:10:44.774450: E tensorflow/stream_executor/cuda/cuda_blas.cc:238] failed to create cublas handle: CUBLAS_STATUS_NOT_INITIALIZED 2025-11-18 13:10:44.783657: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-18 13:10:44.789426: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-11-18 13:10:44.791384: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-11-18 13:10:50.862651: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.17G (3401449472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-18 13:10:51.652498: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-18 13:10:51.652602: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 error in detect the image : temp/1763467828_3325632_1395038458_1e2020cf4686d1eb88f838f501a5ecf0.jpg 2 root error(s) found. (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] [[mrcnn_detection/map/while/body/_1/GatherV2_1/_82]] (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] 0 successful operations. 0 derived errors ignored. [Op:__inference_keras_scratch_graph_13584] Function call stack: keras_scratch_graph -> keras_scratch_graph NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 Detection mask done ! Trying to reset tf kernel 3326131 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 246 tf kernel not reseted sub process len(results) : 4 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 4 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4359 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.002473592758178711 nb_pixel_total : 89576 time to create 1 rle with old method : 0.11464977264404297 length of segment : 337 time for calcul the mask position with numpy : 0.0035910606384277344 nb_pixel_total : 108019 time to create 1 rle with old method : 0.11805152893066406 length of segment : 421 time for calcul the mask position with numpy : 0.007503032684326172 nb_pixel_total : 229417 time to create 1 rle with new method : 0.03592967987060547 length of segment : 637 time for calcul the mask position with numpy : 0.0014853477478027344 nb_pixel_total : 69975 time to create 1 rle with old method : 0.07201766967773438 length of segment : 300 time for calcul the mask position with numpy : 0.0009884834289550781 nb_pixel_total : 51201 time to create 1 rle with old method : 0.05382871627807617 length of segment : 317 time for calcul the mask position with numpy : 0.0011684894561767578 nb_pixel_total : 60939 time to create 1 rle with old method : 0.06439542770385742 length of segment : 342 time for calcul the mask position with numpy : 0.0032041072845458984 nb_pixel_total : 185519 time to create 1 rle with new method : 0.011651277542114258 length of segment : 542 time for calcul the mask position with numpy : 0.002292156219482422 nb_pixel_total : 105534 time to create 1 rle with old method : 0.11650919914245605 length of segment : 363 time for calcul the mask position with numpy : 0.00037550926208496094 nb_pixel_total : 16920 time to create 1 rle with old method : 0.01852130889892578 length of segment : 162 time for calcul the mask position with numpy : 0.001007080078125 nb_pixel_total : 49633 time to create 1 rle with old method : 0.051807403564453125 length of segment : 314 time for calcul the mask position with numpy : 0.0009796619415283203 nb_pixel_total : 59512 time to create 1 rle with old method : 0.062391042709350586 length of segment : 269 time for calcul the mask position with numpy : 0.0008757114410400391 nb_pixel_total : 45301 time to create 1 rle with old method : 0.04898214340209961 length of segment : 338 time for calcul the mask position with numpy : 0.0005297660827636719 nb_pixel_total : 29078 time to create 1 rle with old method : 0.0316317081451416 length of segment : 226 time for calcul the mask position with numpy : 0.0006823539733886719 nb_pixel_total : 38740 time to create 1 rle with old method : 0.041489362716674805 length of segment : 246 time for calcul the mask position with numpy : 0.0004265308380126953 nb_pixel_total : 21017 time to create 1 rle with old method : 0.022304296493530273 length of segment : 152 time for calcul the mask position with numpy : 0.0005736351013183594 nb_pixel_total : 32943 time to create 1 rle with old method : 0.034648895263671875 length of segment : 207 time for calcul the mask position with numpy : 0.0019388198852539062 nb_pixel_total : 81298 time to create 1 rle with old method : 0.08626317977905273 length of segment : 301 time for calcul the mask position with numpy : 0.0009665489196777344 nb_pixel_total : 13125 time to create 1 rle with old method : 0.01747608184814453 length of segment : 120 time for calcul the mask position with numpy : 0.0026590824127197266 nb_pixel_total : 96761 time to create 1 rle with old method : 0.11716103553771973 length of segment : 312 time for calcul the mask position with numpy : 0.0018279552459716797 nb_pixel_total : 71720 time to create 1 rle with old method : 0.08381843566894531 length of segment : 328 time for calcul the mask position with numpy : 0.0012819766998291016 nb_pixel_total : 45907 time to create 1 rle with old method : 0.05353522300720215 length of segment : 341 time for calcul the mask position with numpy : 0.00043082237243652344 nb_pixel_total : 9436 time to create 1 rle with old method : 0.010154485702514648 length of segment : 116 time for calcul the mask position with numpy : 0.0005917549133300781 nb_pixel_total : 11977 time to create 1 rle with old method : 0.01282048225402832 length of segment : 133 time for calcul the mask position with numpy : 0.0018579959869384766 nb_pixel_total : 52228 time to create 1 rle with old method : 0.054773807525634766 length of segment : 347 time for calcul the mask position with numpy : 0.0011448860168457031 nb_pixel_total : 28404 time to create 1 rle with old method : 0.03136587142944336 length of segment : 194 time for calcul the mask position with numpy : 0.0023462772369384766 nb_pixel_total : 64606 time to create 1 rle with old method : 0.07226920127868652 length of segment : 389 time for calcul the mask position with numpy : 0.004078388214111328 nb_pixel_total : 105460 time to create 1 rle with old method : 0.11618709564208984 length of segment : 344 time for calcul the mask position with numpy : 0.0010151863098144531 nb_pixel_total : 30657 time to create 1 rle with old method : 0.03263068199157715 length of segment : 218 time for calcul the mask position with numpy : 0.018953561782836914 nb_pixel_total : 378077 time to create 1 rle with new method : 0.03264212608337402 length of segment : 940 time for calcul the mask position with numpy : 0.0010709762573242188 nb_pixel_total : 36705 time to create 1 rle with old method : 0.041556596755981445 length of segment : 258 time for calcul the mask position with numpy : 0.0014219284057617188 nb_pixel_total : 70832 time to create 1 rle with old method : 0.0802915096282959 length of segment : 372 time for calcul the mask position with numpy : 0.0031583309173583984 nb_pixel_total : 102426 time to create 1 rle with old method : 0.11406064033508301 length of segment : 627 time for calcul the mask position with numpy : 0.000774383544921875 nb_pixel_total : 21670 time to create 1 rle with old method : 0.024998903274536133 length of segment : 198 time for calcul the mask position with numpy : 0.001558542251586914 nb_pixel_total : 52451 time to create 1 rle with old method : 0.06047248840332031 length of segment : 287 time for calcul the mask position with numpy : 0.0024802684783935547 nb_pixel_total : 91140 time to create 1 rle with old method : 0.10174989700317383 length of segment : 505 time for calcul the mask position with numpy : 0.0023193359375 nb_pixel_total : 124455 time to create 1 rle with old method : 0.14018774032592773 length of segment : 310 time for calcul the mask position with numpy : 0.002379894256591797 nb_pixel_total : 78970 time to create 1 rle with old method : 0.08772492408752441 length of segment : 301 time for calcul the mask position with numpy : 0.0009553432464599609 nb_pixel_total : 20964 time to create 1 rle with old method : 0.024222373962402344 length of segment : 189 time for calcul the mask position with numpy : 0.0009927749633789062 nb_pixel_total : 26454 time to create 1 rle with old method : 0.030132293701171875 length of segment : 253 time for calcul the mask position with numpy : 0.0004470348358154297 nb_pixel_total : 28879 time to create 1 rle with old method : 0.03273439407348633 length of segment : 119 time for calcul the mask position with numpy : 0.0007381439208984375 nb_pixel_total : 19115 time to create 1 rle with old method : 0.021739721298217773 length of segment : 224 time for calcul the mask position with numpy : 0.0018334388732910156 nb_pixel_total : 34367 time to create 1 rle with old method : 0.040006399154663086 length of segment : 216 time for calcul the mask position with numpy : 0.0015091896057128906 nb_pixel_total : 35831 time to create 1 rle with old method : 0.040579795837402344 length of segment : 199 time for calcul the mask position with numpy : 0.0002551078796386719 nb_pixel_total : 11449 time to create 1 rle with old method : 0.013229131698608398 length of segment : 139 time for calcul the mask position with numpy : 0.0047910213470458984 nb_pixel_total : 159334 time to create 1 rle with new method : 0.009718894958496094 length of segment : 367 time for calcul the mask position with numpy : 0.001314401626586914 nb_pixel_total : 37101 time to create 1 rle with old method : 0.04065847396850586 length of segment : 237 time for calcul the mask position with numpy : 0.0018544197082519531 nb_pixel_total : 63903 time to create 1 rle with old method : 0.07140159606933594 length of segment : 288 time for calcul the mask position with numpy : 0.0007078647613525391 nb_pixel_total : 15945 time to create 1 rle with old method : 0.01772165298461914 length of segment : 153 time for calcul the mask position with numpy : 0.0029740333557128906 nb_pixel_total : 86209 time to create 1 rle with old method : 0.09682035446166992 length of segment : 196 time for calcul the mask position with numpy : 0.0005311965942382812 nb_pixel_total : 14472 time to create 1 rle with old method : 0.01583075523376465 length of segment : 266 time for calcul the mask position with numpy : 0.00247955322265625 nb_pixel_total : 55789 time to create 1 rle with old method : 0.06296348571777344 length of segment : 325 time for calcul the mask position with numpy : 0.0008380413055419922 nb_pixel_total : 8011 time to create 1 rle with old method : 0.00926065444946289 length of segment : 228 time for calcul the mask position with numpy : 0.0025026798248291016 nb_pixel_total : 103775 time to create 1 rle with old method : 0.1165151596069336 length of segment : 500 time for calcul the mask position with numpy : 0.0011820793151855469 nb_pixel_total : 30391 time to create 1 rle with old method : 0.03411245346069336 length of segment : 195 time for calcul the mask position with numpy : 0.0009467601776123047 nb_pixel_total : 32214 time to create 1 rle with old method : 0.03627514839172363 length of segment : 171 time for calcul the mask position with numpy : 0.0018088817596435547 nb_pixel_total : 66825 time to create 1 rle with old method : 0.0746614933013916 length of segment : 321 time for calcul the mask position with numpy : 0.0009276866912841797 nb_pixel_total : 17102 time to create 1 rle with old method : 0.019532203674316406 length of segment : 215 time for calcul the mask position with numpy : 0.00045371055603027344 nb_pixel_total : 12579 time to create 1 rle with old method : 0.01520848274230957 length of segment : 96 time for calcul the mask position with numpy : 0.0011010169982910156 nb_pixel_total : 33693 time to create 1 rle with old method : 0.038522958755493164 length of segment : 179 time for calcul the mask position with numpy : 0.0008585453033447266 nb_pixel_total : 25172 time to create 1 rle with old method : 0.029180526733398438 length of segment : 145 time for calcul the mask position with numpy : 0.0005345344543457031 nb_pixel_total : 16579 time to create 1 rle with old method : 0.019561290740966797 length of segment : 119 time for calcul the mask position with numpy : 0.008930444717407227 nb_pixel_total : 285040 time to create 1 rle with new method : 0.016888141632080078 length of segment : 756 time for calcul the mask position with numpy : 0.0011494159698486328 nb_pixel_total : 33396 time to create 1 rle with old method : 0.03707170486450195 length of segment : 257 time for calcul the mask position with numpy : 0.0011439323425292969 nb_pixel_total : 48536 time to create 1 rle with old method : 0.05581307411193848 length of segment : 285 time for calcul the mask position with numpy : 0.0007348060607910156 nb_pixel_total : 18958 time to create 1 rle with old method : 0.021063804626464844 length of segment : 228 time spent for convertir_results : 7.3134214878082275 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 65 chid ids of type : 3594 Number RLEs to save : 18980 save missing photos in datou_result : time spend for datou_step_exec : 53.37678575515747 time spend to save output : 1.1195952892303467 total time spend for step 1 : 54.49638104438782 step2:crop_condition Tue Nov 18 13:11:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 65 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 51 About to insert : list_path_to_insert length 51 new photo from crops ! About to upload 51 photos upload in portfolio : 3736932 init cache_photo without model_param we have 51 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763467901_3325632 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603011_0.png', 0, 332, 329, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603012_0.png', 0, 410, 421, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603013_0.png', 0, 852, 641, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603014_0.png', 0, 382, 299, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603015_0.png', 0, 241, 317, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603016_0.png', 0, 302, 332, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603017_0.png', 0, 664, 466, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603018_0.png', 0, 415, 357, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603019_0.png', 0, 189, 134, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603020_0.png', 0, 215, 302, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603021_0.png', 0, 291, 266, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603022_0.png', 0, 195, 337, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603023_0.png', 0, 207, 225, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603024_0.png', 0, 235, 227, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603025_0.png', 0, 202, 152, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603026_0.png', 0, 238, 205, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603027_0.png', 0, 401, 301, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603028_0.png', 0, 176, 119, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603029_0.png', 0, 473, 285, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603030_0.png', 0, 318, 320, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603031_0.png', 0, 299, 335, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603032_0.png', 0, 101, 116, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603033_0.png', 0, 140, 132, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603035_0.png', 0, 235, 194, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603037_0.png', 0, 469, 323, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603038_0.png', 0, 175, 215, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603040_0.png', 0, 206, 256, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603041_0.png', 0, 281, 338, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603042_0.png', 0, 565, 500, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603046_0.png', 0, 661, 296, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603047_0.png', 0, 400, 301, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603050_0.png', 0, 323, 119, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603051_0.png', 0, 138, 224, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603052_0.png', 0, 270, 215, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603054_0.png', 0, 131, 139, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603055_0.png', 0, 683, 341, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603057_0.png', 0, 292, 285, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603058_0.png', 0, 157, 152, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603061_0.png', 0, 382, 304, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603062_0.png', 0, 141, 188, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603063_0.png', 0, 364, 408, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603064_0.png', 0, 237, 192, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603065_0.png', 0, 265, 155, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603066_0.png', 0, 303, 293, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603067_0.png', 0, 108, 211, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603068_0.png', 0, 221, 91, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603069_0.png', 0, 264, 173, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603070_0.png', 0, 251, 139, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603072_0.png', 0, 521, 721, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603073_0.png', 0, 190, 254, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467910), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603074_0.png', 0, 279, 282, 0, 1763467910,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 51 photos in the portfolio 3736932 time of upload the photos Elapsed time : 11.644591569900513 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3736932 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763467917_3325632 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467920), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603034_0.png', 0, 201, 347, 0, 1763467920,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467920), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603036_0.png', 0, 282, 389, 0, 1763467920,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467920), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603043_0.png', 0, 254, 167, 0, 1763467920,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467920), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603045_0.png', 0, 296, 505, 0, 1763467920,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467920), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603048_0.png', 0, 248, 155, 0, 1763467920,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467920), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603049_0.png', 0, 163, 253, 0, 1763467920,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467920), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603056_0.png', 0, 216, 237, 0, 1763467920,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467920), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603060_0.png', 0, 71, 263, 0, 1763467920,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467920), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603071_0.png', 0, 185, 114, 0, 1763467920,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467920), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603075_0.png', 0, 130, 212, 0, 1763467920,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 10 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.2442140579223633 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763467925_3325632 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467926), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603039_0.png', 0, 797, 646, 0, 1763467926,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467926), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603044_0.png', 0, 437, 278, 0, 1763467926,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467926), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603053_0.png', 0, 294, 165, 0, 1763467926,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763467926), 0.0, 0.0, 14, '', 0, 0, '1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603059_0.png', 0, 731, 193, 0, 1763467926,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.5087132453918457 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1395038458, 1395038389, 1395038386, 1395038384, 1395038381] Looping around the photos to save general results len do output : 65 /1395045039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395045131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038458', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038389', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038386', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038384', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038381', None, None, None, None, None, '4066416') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 200 time used for this insertion : 0.02682185173034668 save_final save missing photos in datou_result : time spend for datou_step_exec : 43.251535177230835 time spend to save output : 0.029522418975830078 total time spend for step 2 : 43.281057596206665 step3:rle_unique_nms_with_priority Tue Nov 18 13:12:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 65 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ No data in photo_id : 1395038458 nb_obj : 16 nb_hashtags : 1 time to prepare the origin masks : 11.200459957122803 time for calcul the mask position with numpy : 0.62310791015625 nb_pixel_total : 7101076 time to create 1 rle with new method : 1.034299373626709 time for calcul the mask position with numpy : 0.02815079689025879 nb_pixel_total : 32943 time to create 1 rle with old method : 0.043494462966918945 time for calcul the mask position with numpy : 0.025037288665771484 nb_pixel_total : 21017 time to create 1 rle with old method : 0.023286104202270508 time for calcul the mask position with numpy : 0.024743080139160156 nb_pixel_total : 38740 time to create 1 rle with old method : 0.04229545593261719 time for calcul the mask position with numpy : 0.02519059181213379 nb_pixel_total : 29078 time to create 1 rle with old method : 0.03183913230895996 time for calcul the mask position with numpy : 0.02492380142211914 nb_pixel_total : 45301 time to create 1 rle with old method : 0.050249576568603516 time for calcul the mask position with numpy : 0.025377988815307617 nb_pixel_total : 59512 time to create 1 rle with old method : 0.06435298919677734 time for calcul the mask position with numpy : 0.02416539192199707 nb_pixel_total : 49633 time to create 1 rle with old method : 0.053725481033325195 time for calcul the mask position with numpy : 0.024633407592773438 nb_pixel_total : 16920 time to create 1 rle with old method : 0.018548011779785156 time for calcul the mask position with numpy : 0.024859189987182617 nb_pixel_total : 105534 time to create 1 rle with old method : 0.11395478248596191 time for calcul the mask position with numpy : 0.02580571174621582 nb_pixel_total : 185519 time to create 1 rle with new method : 0.9544146060943604 time for calcul the mask position with numpy : 0.026415586471557617 nb_pixel_total : 60939 time to create 1 rle with old method : 0.06649470329284668 time for calcul the mask position with numpy : 0.02685260772705078 nb_pixel_total : 51201 time to create 1 rle with old method : 0.05683159828186035 time for calcul the mask position with numpy : 0.02778029441833496 nb_pixel_total : 69975 time to create 1 rle with old method : 0.07939386367797852 time for calcul the mask position with numpy : 0.029166460037231445 nb_pixel_total : 229417 time to create 1 rle with new method : 0.7403151988983154 time for calcul the mask position with numpy : 0.02858901023864746 nb_pixel_total : 108019 time to create 1 rle with old method : 0.11989951133728027 time for calcul the mask position with numpy : 0.026009559631347656 nb_pixel_total : 89576 time to create 1 rle with old method : 0.09899759292602539 create new chi : 4.732403039932251 time to delete rle : 0.02873063087463379 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 12506 TO DO : save crop sub photo not yet done ! save time : 0.7309129238128662 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 15.887824535369873 time for calcul the mask position with numpy : 1.3905901908874512 nb_pixel_total : 7072079 time to create 1 rle with new method : 0.8983452320098877 time for calcul the mask position with numpy : 0.04253983497619629 nb_pixel_total : 10402 time to create 1 rle with old method : 0.01197052001953125 time for calcul the mask position with numpy : 0.04673409461975098 nb_pixel_total : 21670 time to create 1 rle with old method : 0.024152517318725586 time for calcul the mask position with numpy : 0.046329498291015625 nb_pixel_total : 93056 time to create 1 rle with old method : 0.11629438400268555 time for calcul the mask position with numpy : 0.04665398597717285 nb_pixel_total : 70832 time to create 1 rle with old method : 0.07960367202758789 time for calcul the mask position with numpy : 0.04646587371826172 nb_pixel_total : 36705 time to create 1 rle with old method : 0.04072260856628418 time for calcul the mask position with numpy : 0.04753232002258301 nb_pixel_total : 378077 time to create 1 rle with new method : 0.8935518264770508 time for calcul the mask position with numpy : 0.04037594795227051 nb_pixel_total : 30657 time to create 1 rle with old method : 0.03339433670043945 time for calcul the mask position with numpy : 0.041489362716674805 nb_pixel_total : 105460 time to create 1 rle with old method : 0.11734151840209961 time for calcul the mask position with numpy : 0.0432429313659668 nb_pixel_total : 64606 time to create 1 rle with old method : 0.07258224487304688 time for calcul the mask position with numpy : 0.04013776779174805 nb_pixel_total : 28404 time to create 1 rle with old method : 0.03599357604980469 time for calcul the mask position with numpy : 0.02715015411376953 nb_pixel_total : 52228 time to create 1 rle with old method : 0.05784296989440918 time for calcul the mask position with numpy : 0.04532265663146973 nb_pixel_total : 11977 time to create 1 rle with old method : 0.013393640518188477 time for calcul the mask position with numpy : 0.043209075927734375 nb_pixel_total : 9436 time to create 1 rle with old method : 0.010662317276000977 time for calcul the mask position with numpy : 0.04379892349243164 nb_pixel_total : 45907 time to create 1 rle with old method : 0.05032205581665039 time for calcul the mask position with numpy : 0.037657976150512695 nb_pixel_total : 71720 time to create 1 rle with old method : 0.08343172073364258 time for calcul the mask position with numpy : 0.03638505935668945 nb_pixel_total : 96761 time to create 1 rle with old method : 0.10596799850463867 time for calcul the mask position with numpy : 0.035925865173339844 nb_pixel_total : 13125 time to create 1 rle with old method : 0.01467442512512207 time for calcul the mask position with numpy : 0.0345456600189209 nb_pixel_total : 81298 time to create 1 rle with old method : 0.08967208862304688 create new chi : 4.961656332015991 time to delete rle : 0.001634836196899414 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 13419 TO DO : save crop sub photo not yet done ! save time : 0.7441058158874512 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 17.710891008377075 time for calcul the mask position with numpy : 0.43863749504089355 nb_pixel_total : 7390044 time to create 1 rle with new method : 0.6520531177520752 time for calcul the mask position with numpy : 0.040090322494506836 nb_pixel_total : 55789 time to create 1 rle with old method : 0.06036186218261719 time for calcul the mask position with numpy : 0.04043936729431152 nb_pixel_total : 14472 time to create 1 rle with old method : 0.01611471176147461 time for calcul the mask position with numpy : 0.04073596000671387 nb_pixel_total : 86209 time to create 1 rle with old method : 0.09257125854492188 time for calcul the mask position with numpy : 0.039327144622802734 nb_pixel_total : 15945 time to create 1 rle with old method : 0.01754474639892578 time for calcul the mask position with numpy : 0.04013943672180176 nb_pixel_total : 63903 time to create 1 rle with old method : 0.06967806816101074 time for calcul the mask position with numpy : 0.03166079521179199 nb_pixel_total : 37101 time to create 1 rle with old method : 0.039508819580078125 time for calcul the mask position with numpy : 0.025290727615356445 nb_pixel_total : 159313 time to create 1 rle with new method : 0.5530295372009277 time for calcul the mask position with numpy : 0.024850130081176758 nb_pixel_total : 11449 time to create 1 rle with old method : 0.012532234191894531 time for calcul the mask position with numpy : 0.02408909797668457 nb_pixel_total : 35831 time to create 1 rle with old method : 0.03831768035888672 time for calcul the mask position with numpy : 0.024944067001342773 nb_pixel_total : 34367 time to create 1 rle with old method : 0.03751373291015625 time for calcul the mask position with numpy : 0.02510976791381836 nb_pixel_total : 19115 time to create 1 rle with old method : 0.021369218826293945 time for calcul the mask position with numpy : 0.024777650833129883 nb_pixel_total : 28879 time to create 1 rle with old method : 0.03207278251647949 time for calcul the mask position with numpy : 0.024997472763061523 nb_pixel_total : 26454 time to create 1 rle with old method : 0.028817176818847656 time for calcul the mask position with numpy : 0.024483680725097656 nb_pixel_total : 20964 time to create 1 rle with old method : 0.02260446548461914 time for calcul the mask position with numpy : 0.024175167083740234 nb_pixel_total : 78970 time to create 1 rle with old method : 0.08499884605407715 time for calcul the mask position with numpy : 0.02493000030517578 nb_pixel_total : 124455 time to create 1 rle with old method : 0.13423848152160645 time for calcul the mask position with numpy : 0.023736953735351562 nb_pixel_total : 91140 time to create 1 rle with old method : 0.09909772872924805 create new chi : 3.0223548412323 time to delete rle : 0.0013608932495117188 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 10726 TO DO : save crop sub photo not yet done ! save time : 0.6370434761047363 nb_obj : 14 nb_hashtags : 2 time to prepare the origin masks : 4.6738011837005615 time for calcul the mask position with numpy : 0.37380003929138184 nb_pixel_total : 7562129 time to create 1 rle with new method : 0.8220992088317871 time for calcul the mask position with numpy : 0.02486276626586914 nb_pixel_total : 18958 time to create 1 rle with old method : 0.021172285079956055 time for calcul the mask position with numpy : 0.025414466857910156 nb_pixel_total : 48536 time to create 1 rle with old method : 0.053830862045288086 time for calcul the mask position with numpy : 0.025892972946166992 nb_pixel_total : 33396 time to create 1 rle with old method : 0.03654003143310547 time for calcul the mask position with numpy : 0.026753664016723633 nb_pixel_total : 285040 time to create 1 rle with new method : 0.7342479228973389 time for calcul the mask position with numpy : 0.026273488998413086 nb_pixel_total : 16579 time to create 1 rle with old method : 0.026556015014648438 time for calcul the mask position with numpy : 0.02700662612915039 nb_pixel_total : 25172 time to create 1 rle with old method : 0.03693675994873047 time for calcul the mask position with numpy : 0.02448129653930664 nb_pixel_total : 33693 time to create 1 rle with old method : 0.036280155181884766 time for calcul the mask position with numpy : 0.02482771873474121 nb_pixel_total : 12579 time to create 1 rle with old method : 0.013877153396606445 time for calcul the mask position with numpy : 0.025094032287597656 nb_pixel_total : 17102 time to create 1 rle with old method : 0.01849985122680664 time for calcul the mask position with numpy : 0.02519059181213379 nb_pixel_total : 66825 time to create 1 rle with old method : 0.07317757606506348 time for calcul the mask position with numpy : 0.02468276023864746 nb_pixel_total : 32214 time to create 1 rle with old method : 0.03511500358581543 time for calcul the mask position with numpy : 0.024567604064941406 nb_pixel_total : 30391 time to create 1 rle with old method : 0.03339958190917969 time for calcul the mask position with numpy : 0.02735137939453125 nb_pixel_total : 103775 time to create 1 rle with old method : 0.112518310546875 time for calcul the mask position with numpy : 0.024834156036376953 nb_pixel_total : 8011 time to create 1 rle with old method : 0.00886392593383789 create new chi : 2.8637733459472656 time to delete rle : 0.0012578964233398438 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 9550 TO DO : save crop sub photo not yet done ! save time : 0.5632157325744629 map_output_result : {1395038458: (0.0, 'Should be the crop_list due to order', 0.0), 1395038389: (0.0, 'Should be the crop_list due to order', 0), 1395038386: (0.0, 'Should be the crop_list due to order', 0), 1395038384: (0.0, 'Should be the crop_list due to order', 0), 1395038381: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1395038458, 1395038389, 1395038386, 1395038384, 1395038381] Looping around the photos to save general results len do output : 5 /1395038458.Didn't retrieve data . /1395038389.Didn't retrieve data . /1395038386.Didn't retrieve data . /1395038384.Didn't retrieve data . /1395038381.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038458', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038389', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038386', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038384', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038381', None, None, None, None, None, '4066416') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.012917518615722656 save_final save missing photos in datou_result : time spend for datou_step_exec : 69.0546977519989 time spend to save output : 0.013293266296386719 total time spend for step 3 : 69.06799101829529 step4:ventilate_hashtags_in_portfolio Tue Nov 18 13:13:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28657922 get user id for portfolio 28657922 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28657922 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','flou','pehd','carton','autre','mal_croppe','papier','pet_clair','pet_fonce','background','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28657922 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','flou','pehd','carton','autre','mal_croppe','papier','pet_clair','pet_fonce','background','environnement')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28657922 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','flou','pehd','carton','autre','mal_croppe','papier','pet_clair','pet_fonce','background','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28658082,28658083,28658084,28658085,28658086,28658087,28658088,28658089,28658090,28658091,28658092?tags=metal,flou,pehd,carton,autre,mal_croppe,papier,pet_clair,pet_fonce,background,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1395038458, 1395038389, 1395038386, 1395038384, 1395038381] Looping around the photos to save general results len do output : 1 /28657922. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038458', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038389', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038386', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038384', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038381', None, None, None, None, None, '4066416') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.014155387878417969 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6929652690887451 time spend to save output : 0.014601707458496094 total time spend for step 4 : 1.7075669765472412 step5:final Tue Nov 18 13:13:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1395038458: ('0.09771103395061728',), 1395038389: ('0.09771103395061728',), 1395038386: ('0.09771103395061728',), 1395038384: ('0.09771103395061728',), 1395038381: ('0.09771103395061728',)} new output for save of step final : {1395038458: ('0.09771103395061728',), 1395038389: ('0.09771103395061728',), 1395038386: ('0.09771103395061728',), 1395038384: ('0.09771103395061728',), 1395038381: ('0.09771103395061728',)} [1395038458, 1395038389, 1395038386, 1395038384, 1395038381] Looping around the photos to save general results len do output : 5 /1395038458.Didn't retrieve data . /1395038389.Didn't retrieve data . /1395038386.Didn't retrieve data . /1395038384.Didn't retrieve data . /1395038381.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038458', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038389', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038386', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038384', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038381', None, None, None, None, None, '4066416') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.012522459030151367 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11923718452453613 time spend to save output : 0.012853384017944336 total time spend for step 5 : 0.13209056854248047 step6:blur_detection Tue Nov 18 13:13:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1763467828_3325632_1395038458_1e2020cf4686d1eb88f838f501a5ecf0.jpg resize: (2160, 3840) 1395038458 -6.81766563005422 treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111.jpg resize: (2160, 3840) 1395038389 -6.664313914567748 treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499.jpg resize: (2160, 3840) 1395038386 -6.6447224026460425 treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89.jpg resize: (2160, 3840) 1395038384 -6.598764890071721 treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6.jpg resize: (2160, 3840) 1395038381 -6.825403930099133 treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603011_0.png resize: (329, 332) 1395045039 -2.0859228388668973 treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603012_0.png resize: (421, 410) 1395045040 -2.516372976319891 treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603013_0.png resize: (641, 852) 1395045041 -4.007102816674683 treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603014_0.png resize: (299, 382) 1395045042 -4.734328812710193 treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603015_0.png resize: (317, 241) 1395045043 -2.12293817166367 treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603016_0.png resize: (332, 302) 1395045044 -3.4817944811220967 treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603017_0.png resize: (466, 664) 1395045045 -3.569890027155516 treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603018_0.png resize: (357, 415) 1395045046 -4.9323050375029585 treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603019_0.png resize: (134, 189) 1395045047 -3.939210623957184 treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603020_0.png resize: (302, 215) 1395045048 -3.7831068349161026 treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603021_0.png resize: (266, 291) 1395045049 -2.8980105460888876 treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603022_0.png resize: (337, 195) 1395045050 -3.0223462686573344 treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603023_0.png resize: (225, 207) 1395045051 -3.5068779194810875 treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603024_0.png resize: (227, 235) 1395045052 -2.7332387873329917 treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603025_0.png resize: (152, 202) 1395045053 -2.0118434658427002 treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603026_0.png resize: (205, 238) 1395045054 -2.3654749353793196 treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603027_0.png resize: (301, 401) 1395045055 -2.5839507703850226 treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603028_0.png resize: (119, 176) 1395045056 -3.132751356545761 treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603029_0.png resize: (285, 473) 1395045057 -3.3351761363643386 treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603030_0.png resize: (320, 318) 1395045058 -4.070067870722406 treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603031_0.png resize: (335, 299) 1395045059 -2.79774624749749 treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603032_0.png resize: (116, 101) 1395045060 -3.2923764890849805 treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603033_0.png resize: (132, 140) 1395045061 -4.2733249169526495 treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603035_0.png resize: (194, 235) 1395045062 -1.8522246397741406 treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603037_0.png resize: (323, 469) 1395045063 -2.2280942703588145 treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603038_0.png resize: (215, 175) 1395045064 -3.3454759347268435 treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603040_0.png resize: (256, 206) 1395045065 -4.504785390539845 treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603041_0.png resize: (338, 281) 1395045066 -4.749231654648114 treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603042_0.png resize: (500, 565) 1395045067 -3.871643512559797 treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603046_0.png resize: (296, 661) 1395045068 -3.8411346871844527 treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603047_0.png resize: (301, 400) 1395045069 -3.1503676904645728 treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603050_0.png resize: (119, 323) 1395045070 -3.1870418583119515 treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603051_0.png resize: (224, 138) 1395045071 -2.6817001575711887 treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603052_0.png resize: (215, 270) 1395045072 -1.584211891397334 treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603054_0.png resize: (139, 131) 1395045073 -4.375433246647447 treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603055_0.png resize: (341, 683) 1395045074 -2.6918021631156055 treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603057_0.png resize: (285, 292) 1395045075 -3.7359603543050817 treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603058_0.png resize: (152, 157) 1395045076 -3.511264988021657 treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603061_0.png resize: (304, 382) 1395045077 -3.677593600036945 treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603062_0.png resize: (188, 141) 1395045078 1.4403412274367442 treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603063_0.png resize: (408, 364) 1395045080 -2.3127177565067116 treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603064_0.png resize: (192, 237) 1395045081 1.0525316097690098 treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603065_0.png resize: (155, 265) 1395045082 -2.8365672657557517 treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603066_0.png resize: (293, 303) 1395045083 -3.9578163398852593 treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603067_0.png resize: (211, 108) 1395045084 -4.999214611648941 treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603068_0.png resize: (91, 221) 1395045085 -3.100795133588994 treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603069_0.png resize: (173, 264) 1395045086 -3.6872816476430392 treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603070_0.png resize: (139, 251) 1395045088 -3.7851771762322137 treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603072_0.png resize: (721, 521) 1395045089 -4.53157951778944 treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603073_0.png resize: (254, 190) 1395045090 -3.058336736078434 treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603074_0.png resize: (282, 279) 1395045091 -2.329662497923808 treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603034_0.png resize: (347, 201) 1395045112 -3.9488589398999374 treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603036_0.png resize: (389, 282) 1395045113 -2.4047131703670144 treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603043_0.png resize: (167, 254) 1395045115 -2.442137377263576 treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603045_0.png resize: (505, 296) 1395045116 -2.199115289471563 treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603048_0.png resize: (155, 248) 1395045117 -2.762435412434811 treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603049_0.png resize: (253, 163) 1395045118 -2.70107660731015 treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603056_0.png resize: (237, 216) 1395045120 -4.608206326116559 treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603060_0.png resize: (263, 71) 1395045121 -3.908551773428593 treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603071_0.png resize: (114, 185) 1395045122 -1.826352171818905 treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603075_0.png resize: (212, 130) 1395045124 -1.925829070648524 treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603039_0.png resize: (646, 797) 1395045128 -3.2530828247744923 treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603044_0.png resize: (278, 437) 1395045129 -3.8017430023645558 treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603053_0.png resize: (165, 294) 1395045130 -3.575386479270099 treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603059_0.png resize: (193, 731) 1395045131 -2.771695011276194 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 70 time used for this insertion : 0.01458120346069336 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 70 time used for this insertion : 0.015732765197753906 save missing photos in datou_result : time spend for datou_step_exec : 20.62017250061035 time spend to save output : 0.0354001522064209 total time spend for step 6 : 20.655572652816772 step7:brightness Tue Nov 18 13:13:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1763467828_3325632_1395038458_1e2020cf4686d1eb88f838f501a5ecf0.jpg treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111.jpg treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499.jpg treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89.jpg treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6.jpg treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603011_0.png treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603012_0.png treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603013_0.png treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603014_0.png treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603015_0.png treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603016_0.png treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603017_0.png treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603018_0.png treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603019_0.png treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603020_0.png treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603021_0.png treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603022_0.png treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603023_0.png treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603024_0.png treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603025_0.png treat image : temp/1763467828_3325632_1395038389_2f29a7e76a99500a11de0a4d9ae77111_rle_crop_4037603026_0.png treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603027_0.png treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603028_0.png treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603029_0.png treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603030_0.png treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603031_0.png treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603032_0.png treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603033_0.png treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603035_0.png treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603037_0.png treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603038_0.png treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603040_0.png treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603041_0.png treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603042_0.png treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603046_0.png treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603047_0.png treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603050_0.png treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603051_0.png treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603052_0.png treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603054_0.png treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603055_0.png treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603057_0.png treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603058_0.png treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603061_0.png treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603062_0.png treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603063_0.png treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603064_0.png treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603065_0.png treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603066_0.png treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603067_0.png treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603068_0.png treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603069_0.png treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603070_0.png treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603072_0.png treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603073_0.png treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603074_0.png treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603034_0.png treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603036_0.png treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603043_0.png treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603045_0.png treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603048_0.png treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603049_0.png treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603056_0.png treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603060_0.png treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603071_0.png treat image : temp/1763467828_3325632_1395038381_31ea895d751e9ea24d39a59c16a61fd6_rle_crop_4037603075_0.png treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603039_0.png treat image : temp/1763467828_3325632_1395038386_df4aa0f2c7029ee4d7021f85f7ffb499_rle_crop_4037603044_0.png treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603053_0.png treat image : temp/1763467828_3325632_1395038384_b3cea109c920d24f4f2955a154be6e89_rle_crop_4037603059_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 70 time used for this insertion : 0.019451379776000977 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 70 time used for this insertion : 0.01918196678161621 save missing photos in datou_result : time spend for datou_step_exec : 5.373209714889526 time spend to save output : 0.043700456619262695 total time spend for step 7 : 5.416910171508789 step8:velours_tree Tue Nov 18 13:13:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.13310575485229492 time spend to save output : 4.696846008300781e-05 total time spend for step 8 : 0.13315272331237793 step9:send_mail_cod Tue Nov 18 13:13:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28657922_18-11-2025_13_13_43.pdf 28658082 imagette286580821763468023 28658083 imagette286580831763468024 28658084 imagette286580841763468024 28658085 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette286580851763468024 28658086 imagette286580861763468024 28658087 imagette286580871763468024 28658088 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette286580881763468024 28658089 change filename to text .change filename to text .change filename to text .change filename to text .imagette286580891763468026 28658090 imagette286580901763468027 28658091 imagette286580911763468027 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28657922 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28658082,28658083,28658084,28658085,28658086,28658087,28658088,28658089,28658090,28658091,28658092?tags=metal,flou,pehd,carton,autre,mal_croppe,papier,pet_clair,pet_fonce,background,environnement args[1395038458] : ((1395038458, -6.81766563005422, 492609224), (1395038458, 0.9577525199102793, 2107752395), '0.09771103395061728') We are sending mail with results at report@fotonower.com args[1395038389] : ((1395038389, -6.664313914567748, 492609224), (1395038389, 0.8538152105066036, 2107752395), '0.09771103395061728') We are sending mail with results at report@fotonower.com args[1395038386] : ((1395038386, -6.6447224026460425, 492609224), (1395038386, 1.1945552465938913, 2107752395), '0.09771103395061728') We are sending mail with results at report@fotonower.com args[1395038384] : ((1395038384, -6.598764890071721, 492609224), (1395038384, 1.2141635018645396, 2107752395), '0.09771103395061728') We are sending mail with results at report@fotonower.com args[1395038381] : ((1395038381, -6.825403930099133, 492609224), (1395038381, 1.5927634449829982, 2107752395), '0.09771103395061728') We are sending mail with results at report@fotonower.com refus_total : 0.09771103395061728 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28657922 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28657922_18-11-2025_13_13_43.pdf results_Auto_P28657922_18-11-2025_13_13_43.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28657922_18-11-2025_13_13_43.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28657922','results_Auto_P28657922_18-11-2025_13_13_43.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28657922_18-11-2025_13_13_43.pdf','pdf','','0.4','0.09771103395061728') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28657922

https://www.fotonower.com/image?json=false&list_photos_id=1395038458
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395038389
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395038386
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395038384
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395038381
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 9.77%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/28658085?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/28658088?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/28658089?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28657922_18-11-2025_13_13_43.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28658082,28658083,28658084,28658085,28658086,28658087,28658088,28658089,28658090,28658091,28658092?tags=metal,flou,pehd,carton,autre,mal_croppe,papier,pet_clair,pet_fonce,background,environnement.


L'équipe Fotonower 202 b'' Date: Tue, 18 Nov 2025 12:13:49 GMT Content-Length: 0 Connection: close Server: nginx X-Message-Id: ZJSPPxL2TuiHXsx0lPe_NA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1395038458, 1395038389, 1395038386, 1395038384, 1395038381] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038458', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038389', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038386', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038384', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038381', None, None, None, None, None, '4066416') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.014104127883911133 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.364101886749268 time spend to save output : 0.014376163482666016 total time spend for step 9 : 5.378478050231934 step10:split_time_score Tue Nov 18 13:13:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('12', 5),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 18112025 28657922 Nombre de photos uploadées : 5 / 23040 (0%) 18112025 28657922 Nombre de photos taguées (types de déchets): 0 / 5 (0%) 18112025 28657922 Nombre de photos taguées (volume) : 0 / 5 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ????? elapsed_time : fill_and_build_computed_from_old_data 0.0003333091735839844 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.21523761749267578 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.08037002907052856 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28644831_18-11-2025_07_17_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28644831 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28644831 AND mptpi.`type`=3726 To do Qualite : 0.025395582636412724 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28651816_18-11-2025_10_11_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28651816 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28651816 AND mptpi.`type`=3726 To do Qualite : 0.01403200388307422 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28653862_18-11-2025_11_12_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28653862 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28653862 AND mptpi.`type`=3726 To do Qualite : 0.026990863690157366 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28655135_18-11-2025_11_39_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28655135 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28655135 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28657920 order by id desc limit 1 Qualite : 0.09771103395061728 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28657922_18-11-2025_13_13_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28657922 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28657922 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'18112025': {'nb_upload': 5, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1395038458, 1395038389, 1395038386, 1395038384, 1395038381] Looping around the photos to save general results len do output : 1 /28657922Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038458', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038389', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038386', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038384', None, None, None, None, None, '4066416') ('3318', None, None, None, None, None, None, None, '4066416') ('3318', '28657922', '1395038381', None, None, None, None, None, '4066416') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.015805959701538086 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.9494264125823975 time spend to save output : 0.01598525047302246 total time spend for step 10 : 1.96541166305542 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 5 set_done_treatment 77.22user 103.10system 3:26.94elapsed 87%CPU (0avgtext+0avgdata 3810476maxresident)k 536400inputs+74704outputs (172major+6739631minor)pagefaults 0swaps