python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2965821 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4287992'] with mtr_portfolio_ids : ['29801549'] and first list_photo_ids : [] new path : /proc/2965821/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 2.07209849357605 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Dec 30 12:10:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10605 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-12-30 12:10:34.218752: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-12-30 12:10:34.254563: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-12-30 12:10:34.256383: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f4e70000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-12-30 12:10:34.256432: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-12-30 12:10:34.261659: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-12-30 12:10:34.499985: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3f309140 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-12-30 12:10:34.500055: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-12-30 12:10:34.502046: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-30 12:10:34.503123: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-30 12:10:34.507159: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-30 12:10:34.526501: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-30 12:10:34.527606: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-30 12:10:34.559641: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-30 12:10:34.564165: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-30 12:10:34.620983: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-30 12:10:34.622898: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-30 12:10:34.623335: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-30 12:10:34.624293: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-30 12:10:34.624314: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-30 12:10:34.624325: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-30 12:10:34.626342: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9826 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-12-30 12:10:34.938227: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-30 12:10:34.938391: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-30 12:10:34.938848: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-30 12:10:34.938878: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-30 12:10:34.938904: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-30 12:10:34.938930: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-30 12:10:34.938956: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-30 12:10:34.938982: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-30 12:10:34.940743: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-30 12:10:34.942382: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-30 12:10:34.942480: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-30 12:10:34.942510: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-30 12:10:34.942540: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-30 12:10:34.942569: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-30 12:10:34.942593: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-30 12:10:34.942619: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-30 12:10:34.942646: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-30 12:10:34.944427: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-30 12:10:34.944472: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-30 12:10:34.944488: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-30 12:10:34.944500: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-30 12:10:34.946437: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9826 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-12-30 12:10:47.080525: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-30 12:10:47.310482: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 Detection mask done ! Trying to reset tf kernel 2966228 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5316 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10605 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [324, 1626, 552, 1812] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005931854248046875 nb_pixel_total : 15967 time to create 1 rle with old method : 0.020078182220458984 length of segment : 204 DEBUG bbox = [1686, 2016, 1812, 2130] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00020313262939453125 nb_pixel_total : 6503 time to create 1 rle with old method : 0.007828474044799805 length of segment : 115 DEBUG bbox = [258, 792, 462, 1014] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005214214324951172 nb_pixel_total : 25347 time to create 1 rle with old method : 0.029706239700317383 length of segment : 187 DEBUG bbox = [702, 2040, 846, 2226] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002722740173339844 nb_pixel_total : 12937 time to create 1 rle with old method : 0.015671730041503906 length of segment : 126 DEBUG bbox = [1896, 2562, 2040, 2844] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003311634063720703 nb_pixel_total : 17194 time to create 1 rle with old method : 0.020021677017211914 length of segment : 111 DEBUG bbox = [1686, 786, 1818, 894] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0001704692840576172 nb_pixel_total : 7856 time to create 1 rle with old method : 0.009234905242919922 length of segment : 109 DEBUG bbox = [774, 1140, 948, 1464] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005528926849365234 nb_pixel_total : 29462 time to create 1 rle with old method : 0.03510141372680664 length of segment : 161 DEBUG bbox = [888, 2106, 1176, 2238] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00043845176696777344 nb_pixel_total : 21419 time to create 1 rle with old method : 0.02409982681274414 length of segment : 230 DEBUG bbox = [648, 1656, 834, 1920] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000476837158203125 nb_pixel_total : 33621 time to create 1 rle with old method : 0.03796792030334473 length of segment : 171 DEBUG bbox = [1578, 1440, 1824, 1662] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004546642303466797 nb_pixel_total : 27944 time to create 1 rle with old method : 0.030797958374023438 length of segment : 220 DEBUG bbox = [1260, 2250, 1464, 2730] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006551742553710938 nb_pixel_total : 30603 time to create 1 rle with old method : 0.03401947021484375 length of segment : 151 DEBUG bbox = [1254, 2244, 1446, 2466] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004379749298095703 nb_pixel_total : 18097 time to create 1 rle with old method : 0.021581411361694336 length of segment : 153 DEBUG bbox = [1926, 1962, 2082, 2094] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002243518829345703 nb_pixel_total : 14702 time to create 1 rle with old method : 0.016902446746826172 length of segment : 144 DEBUG bbox = [456, 852, 690, 1152] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005922317504882812 nb_pixel_total : 37690 time to create 1 rle with old method : 0.0419921875 length of segment : 231 DEBUG bbox = [12, 2388, 156, 2580] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002944469451904297 nb_pixel_total : 18645 time to create 1 rle with old method : 0.022240877151489258 length of segment : 136 DEBUG bbox = [876, 1506, 1992, 2016] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0036242008209228516 nb_pixel_total : 66051 time to create 1 rle with old method : 0.07715368270874023 length of segment : 950 DEBUG bbox = [678, 894, 864, 1158] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00047659873962402344 nb_pixel_total : 30615 time to create 1 rle with old method : 0.0353090763092041 length of segment : 160 DEBUG bbox = [1032, 1074, 1248, 1356] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005152225494384766 nb_pixel_total : 36673 time to create 1 rle with old method : 0.04190683364868164 length of segment : 200 DEBUG bbox = [6, 2700, 126, 2988] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003600120544433594 nb_pixel_total : 24168 time to create 1 rle with old method : 0.03194618225097656 length of segment : 113 DEBUG bbox = [510, 1668, 948, 1968] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009772777557373047 nb_pixel_total : 56133 time to create 1 rle with old method : 0.06276321411132812 length of segment : 360 DEBUG bbox = [456, 1254, 708, 1458] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00043272972106933594 nb_pixel_total : 24281 time to create 1 rle with old method : 0.0322878360748291 length of segment : 214 DEBUG bbox = [1176, 1314, 1428, 1446] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00035071372985839844 nb_pixel_total : 21369 time to create 1 rle with old method : 0.024048328399658203 length of segment : 245 DEBUG bbox = [1476, 1848, 1650, 2034] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000331878662109375 nb_pixel_total : 18280 time to create 1 rle with old method : 0.02080225944519043 length of segment : 158 DEBUG bbox = [144, 1356, 732, 2382] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.2760045528411865 nb_pixel_total : 288813 time to create 1 rle with new method : 0.03099226951599121 length of segment : 586 DEBUG bbox = [1872, 1290, 2004, 1488] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006859302520751953 nb_pixel_total : 18609 time to create 1 rle with old method : 0.021448850631713867 length of segment : 123 DEBUG bbox = [264, 2388, 426, 2526] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003631114959716797 nb_pixel_total : 12072 time to create 1 rle with old method : 0.014242410659790039 length of segment : 132 DEBUG bbox = [612, 2430, 756, 2568] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00039196014404296875 nb_pixel_total : 13788 time to create 1 rle with old method : 0.016715049743652344 length of segment : 127 DEBUG bbox = [2022, 2232, 2160, 2490] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006172657012939453 nb_pixel_total : 26473 time to create 1 rle with old method : 0.031235694885253906 length of segment : 136 DEBUG bbox = [456, 1338, 630, 1554] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006659030914306641 nb_pixel_total : 24470 time to create 1 rle with old method : 0.028625011444091797 length of segment : 160 DEBUG bbox = [990, 336, 1278, 534] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010387897491455078 nb_pixel_total : 33427 time to create 1 rle with old method : 0.03876209259033203 length of segment : 274 DEBUG bbox = [1998, 1920, 2160, 2148] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005414485931396484 nb_pixel_total : 20271 time to create 1 rle with old method : 0.024530887603759766 length of segment : 151 DEBUG bbox = [828, 2388, 1050, 2622] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008554458618164062 nb_pixel_total : 30935 time to create 1 rle with old method : 0.03473305702209473 length of segment : 192 DEBUG bbox = [228, 708, 438, 996] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009229183197021484 nb_pixel_total : 36676 time to create 1 rle with old method : 0.04178881645202637 length of segment : 203 DEBUG bbox = [582, 1164, 774, 1530] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008730888366699219 nb_pixel_total : 42457 time to create 1 rle with old method : 0.0481877326965332 length of segment : 175 DEBUG bbox = [1974, 2064, 2094, 2208] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00024628639221191406 nb_pixel_total : 12286 time to create 1 rle with old method : 0.014131784439086914 length of segment : 115 DEBUG bbox = [174, 96, 396, 276] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007596015930175781 nb_pixel_total : 26361 time to create 1 rle with old method : 0.03023695945739746 length of segment : 207 DEBUG bbox = [0, 1740, 120, 1956] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004436969757080078 nb_pixel_total : 14971 time to create 1 rle with old method : 0.01719379425048828 length of segment : 101 DEBUG bbox = [726, 2856, 942, 3048] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005176067352294922 nb_pixel_total : 24782 time to create 1 rle with old method : 0.028980016708374023 length of segment : 203 DEBUG bbox = [1836, 1872, 2016, 1968] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003707408905029297 nb_pixel_total : 12052 time to create 1 rle with old method : 0.013980865478515625 length of segment : 169 DEBUG bbox = [1848, 1608, 2040, 1782] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00045180320739746094 nb_pixel_total : 14749 time to create 1 rle with old method : 0.016963958740234375 length of segment : 156 DEBUG bbox = [678, 2154, 1002, 2466] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012955665588378906 nb_pixel_total : 50508 time to create 1 rle with old method : 0.05695986747741699 length of segment : 306 DEBUG bbox = [894, 1338, 1158, 1578] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009298324584960938 nb_pixel_total : 32207 time to create 1 rle with old method : 0.03859138488769531 length of segment : 219 DEBUG bbox = [324, 948, 570, 1164] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008363723754882812 nb_pixel_total : 13491 time to create 1 rle with old method : 0.016004323959350586 length of segment : 188 DEBUG bbox = [1104, 2832, 1428, 2958] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006639957427978516 nb_pixel_total : 22125 time to create 1 rle with old method : 0.025668859481811523 length of segment : 315 DEBUG bbox = [558, 1998, 702, 2214] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005593299865722656 nb_pixel_total : 17511 time to create 1 rle with old method : 0.019791603088378906 length of segment : 121 DEBUG bbox = [1194, 1860, 1434, 2034] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007367134094238281 nb_pixel_total : 19210 time to create 1 rle with old method : 0.021924734115600586 length of segment : 219 DEBUG bbox = [372, 462, 546, 594] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004620552062988281 nb_pixel_total : 11683 time to create 1 rle with old method : 0.013660907745361328 length of segment : 137 DEBUG bbox = [996, 2058, 1206, 2268] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007593631744384766 nb_pixel_total : 21861 time to create 1 rle with old method : 0.025562763214111328 length of segment : 182 DEBUG bbox = [204, 2742, 606, 2964] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015001296997070312 nb_pixel_total : 27055 time to create 1 rle with old method : 0.03099226951599121 length of segment : 338 DEBUG bbox = [12, 2484, 144, 2694] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005316734313964844 nb_pixel_total : 16937 time to create 1 rle with old method : 0.01932215690612793 length of segment : 118 DEBUG bbox = [1728, 1140, 1944, 1350] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008091926574707031 nb_pixel_total : 24703 time to create 1 rle with old method : 0.03107595443725586 length of segment : 191 DEBUG bbox = [444, 2598, 630, 2760] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00040268898010253906 nb_pixel_total : 15822 time to create 1 rle with old method : 0.017776012420654297 length of segment : 175 DEBUG bbox = [618, 660, 750, 798] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00041174888610839844 nb_pixel_total : 11872 time to create 1 rle with old method : 0.013882160186767578 length of segment : 119 DEBUG bbox = [1980, 1806, 2136, 1938] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00045013427734375 nb_pixel_total : 12760 time to create 1 rle with old method : 0.01488041877746582 length of segment : 158 DEBUG bbox = [150, 2388, 564, 2658] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015032291412353516 nb_pixel_total : 57824 time to create 1 rle with old method : 0.0659642219543457 length of segment : 390 DEBUG bbox = [1356, 450, 1596, 600] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007073879241943359 nb_pixel_total : 18905 time to create 1 rle with old method : 0.020644187927246094 length of segment : 201 DEBUG bbox = [702, 1392, 894, 1560] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005850791931152344 nb_pixel_total : 15306 time to create 1 rle with old method : 0.01796698570251465 length of segment : 170 DEBUG bbox = [1512, 2064, 1782, 2256] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009136199951171875 nb_pixel_total : 31787 time to create 1 rle with old method : 0.03621101379394531 length of segment : 264 DEBUG bbox = [84, 24, 546, 216] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014226436614990234 nb_pixel_total : 41519 time to create 1 rle with old method : 0.047260284423828125 length of segment : 396 DEBUG bbox = [852, 2526, 1314, 2940] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002434253692626953 nb_pixel_total : 93927 time to create 1 rle with old method : 0.10549283027648926 length of segment : 405 DEBUG bbox = [1866, 1452, 2082, 1746] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009875297546386719 nb_pixel_total : 32100 time to create 1 rle with old method : 0.03744769096374512 length of segment : 173 DEBUG bbox = [1938, 906, 2070, 1026] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00043654441833496094 nb_pixel_total : 9569 time to create 1 rle with old method : 0.010887384414672852 length of segment : 128 DEBUG bbox = [1374, 1368, 1740, 1626] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015294551849365234 nb_pixel_total : 46505 time to create 1 rle with old method : 0.05319023132324219 length of segment : 347 DEBUG bbox = [1932, 1218, 2142, 1410] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007009506225585938 nb_pixel_total : 21789 time to create 1 rle with old method : 0.025014877319335938 length of segment : 187 DEBUG bbox = [486, 2520, 648, 2664] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005612373352050781 nb_pixel_total : 15028 time to create 1 rle with old method : 0.017232656478881836 length of segment : 146 DEBUG bbox = [402, 1818, 570, 2010] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006170272827148438 nb_pixel_total : 19495 time to create 1 rle with old method : 0.022214174270629883 length of segment : 153 DEBUG bbox = [966, 2574, 1248, 2814] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011887550354003906 nb_pixel_total : 36192 time to create 1 rle with old method : 0.04111838340759277 length of segment : 274 DEBUG bbox = [1788, 2208, 2034, 2508] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001280069351196289 nb_pixel_total : 40941 time to create 1 rle with old method : 0.04738974571228027 length of segment : 230 DEBUG bbox = [1464, 1758, 1644, 1926] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006420612335205078 nb_pixel_total : 24090 time to create 1 rle with old method : 0.027089357376098633 length of segment : 172 DEBUG bbox = [1710, 1914, 1836, 2010] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003337860107421875 nb_pixel_total : 8183 time to create 1 rle with old method : 0.009191513061523438 length of segment : 110 DEBUG bbox = [354, 912, 696, 1332] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002668619155883789 nb_pixel_total : 73070 time to create 1 rle with old method : 0.10620641708374023 length of segment : 354 DEBUG bbox = [42, 1512, 264, 1776] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009629726409912109 nb_pixel_total : 31597 time to create 1 rle with old method : 0.03485107421875 length of segment : 229 DEBUG bbox = [324, 1320, 486, 1518] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004863739013671875 nb_pixel_total : 21214 time to create 1 rle with old method : 0.024244308471679688 length of segment : 149 DEBUG bbox = [1590, 708, 1770, 858] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006022453308105469 nb_pixel_total : 17875 time to create 1 rle with old method : 0.019669055938720703 length of segment : 166 DEBUG bbox = [1650, 1722, 1830, 1878] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005145072937011719 nb_pixel_total : 16010 time to create 1 rle with old method : 0.01844191551208496 length of segment : 167 DEBUG bbox = [1668, 2046, 1782, 2274] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004036426544189453 nb_pixel_total : 19494 time to create 1 rle with old method : 0.022901296615600586 length of segment : 105 DEBUG bbox = [1986, 1920, 2148, 2268] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007956027984619141 nb_pixel_total : 22725 time to create 1 rle with old method : 0.026081085205078125 length of segment : 152 DEBUG bbox = [1644, 1158, 1884, 1404] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007998943328857422 nb_pixel_total : 31247 time to create 1 rle with old method : 0.035407066345214844 length of segment : 231 time spent for convertir_results : 5.118279457092285 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 78 chid ids of type : 3594 Number RLEs to save : 16144 save missing photos in datou_result : time spend for datou_step_exec : 62.91628122329712 time spend to save output : 1.0969159603118896 total time spend for step 1 : 64.01319718360901 step2:crop_condition Tue Dec 30 12:11:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 78 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 48 About to insert : list_path_to_insert length 48 new photo from crops ! About to upload 48 photos upload in portfolio : 3736932 init cache_photo without model_param we have 48 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767093103_2965821 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420153_0.png', 0, 98, 114, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420154_0.png', 0, 220, 168, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420155_0.png', 0, 181, 124, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420156_0.png', 0, 247, 111, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420157_0.png', 0, 103, 108, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420160_0.png', 0, 250, 170, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420163_0.png', 0, 200, 153, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420164_0.png', 0, 125, 143, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420165_0.png', 0, 240, 215, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420169_0.png', 0, 275, 200, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420171_0.png', 0, 269, 360, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420172_0.png', 0, 179, 214, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659922_795bbe42ef7760439982a62eddb43aab_rle_crop_4085420173_0.png', 0, 120, 244, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659922_795bbe42ef7760439982a62eddb43aab_rle_crop_4085420174_0.png', 0, 174, 158, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659922_795bbe42ef7760439982a62eddb43aab_rle_crop_4085420176_0.png', 0, 186, 119, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659922_795bbe42ef7760439982a62eddb43aab_rle_crop_4085420177_0.png', 0, 123, 132, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420179_0.png', 0, 235, 134, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420180_0.png', 0, 200, 160, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420182_0.png', 0, 191, 151, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420186_0.png', 0, 142, 104, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420189_0.png', 0, 172, 192, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420190_0.png', 0, 94, 169, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420191_0.png', 0, 144, 156, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420192_0.png', 0, 284, 263, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420193_0.png', 0, 224, 205, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420194_0.png', 0, 179, 194, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420195_0.png', 0, 113, 323, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420197_0.png', 0, 160, 219, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420199_0.png', 0, 203, 182, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420200_0.png', 0, 181, 337, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420204_0.png', 0, 137, 118, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420207_0.png', 0, 135, 195, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420208_0.png', 0, 160, 167, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659888_ff868829bf03ef9fb6d0c5d83c8a430e_rle_crop_4085420209_0.png', 0, 172, 264, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659888_ff868829bf03ef9fb6d0c5d83c8a430e_rle_crop_4085420210_0.png', 0, 180, 386, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659888_ff868829bf03ef9fb6d0c5d83c8a430e_rle_crop_4085420211_0.png', 0, 371, 405, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659871_72e7b9acbbc8d2e4c9eba5438edf3700_rle_crop_4085420213_0.png', 0, 119, 127, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659871_72e7b9acbbc8d2e4c9eba5438edf3700_rle_crop_4085420214_0.png', 0, 233, 326, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659871_72e7b9acbbc8d2e4c9eba5438edf3700_rle_crop_4085420215_0.png', 0, 186, 187, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420218_0.png', 0, 224, 274, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420219_0.png', 0, 299, 211, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420221_0.png', 0, 95, 110, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420224_0.png', 0, 175, 149, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420225_0.png', 0, 143, 166, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659869_df9b98f3329c06623335f79f105582b8_rle_crop_4085420226_0.png', 0, 154, 167, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659869_df9b98f3329c06623335f79f105582b8_rle_crop_4085420227_0.png', 0, 212, 105, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659869_df9b98f3329c06623335f79f105582b8_rle_crop_4085420228_0.png', 0, 267, 139, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093111), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659869_df9b98f3329c06623335f79f105582b8_rle_crop_4085420229_0.png', 0, 241, 231, 0, 1767093111,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 48 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.677614688873291 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 13 About to insert : list_path_to_insert length 13 new photo from crops ! About to upload 13 photos upload in portfolio : 3736932 init cache_photo without model_param we have 13 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767093117_2965821 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093119), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420152_0.png', 0, 134, 203, 0, 1767093119,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093119), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420158_0.png', 0, 280, 160, 0, 1767093119,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093119), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420162_0.png', 0, 427, 149, 0, 1767093119,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093119), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420181_0.png', 0, 185, 274, 0, 1767093119,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093119), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420183_0.png', 0, 221, 192, 0, 1767093119,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093119), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420184_0.png', 0, 249, 203, 0, 1767093119,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093119), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420185_0.png', 0, 307, 173, 0, 1767093119,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093119), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420196_0.png', 0, 189, 120, 0, 1767093119,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093119), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420198_0.png', 0, 115, 137, 0, 1767093119,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093119), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420203_0.png', 0, 132, 175, 0, 1767093119,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093119), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420205_0.png', 0, 108, 154, 0, 1767093119,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093119), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420206_0.png', 0, 238, 388, 0, 1767093119,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093119), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420223_0.png', 0, 250, 199, 0, 1767093119,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 13 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.366603136062622 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767093122_2965821 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093123), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420168_0.png', 0, 246, 156, 0, 1767093123,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093123), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659922_795bbe42ef7760439982a62eddb43aab_rle_crop_4085420178_0.png', 0, 122, 126, 0, 1767093123,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093123), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659871_72e7b9acbbc8d2e4c9eba5438edf3700_rle_crop_4085420216_0.png', 0, 139, 145, 0, 1767093123,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093123), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659871_72e7b9acbbc8d2e4c9eba5438edf3700_rle_crop_4085420217_0.png', 0, 169, 153, 0, 1767093123,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.3614084720611572 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3736932 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767093127_2965821 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093129), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420166_0.png', 0, 179, 135, 0, 1767093129,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093129), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420170_0.png', 0, 254, 109, 0, 1767093129,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093129), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659922_795bbe42ef7760439982a62eddb43aab_rle_crop_4085420175_0.png', 0, 969, 505, 0, 1767093129,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093129), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420187_0.png', 0, 176, 196, 0, 1767093129,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093129), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420188_0.png', 0, 214, 99, 0, 1767093129,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093129), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420201_0.png', 0, 184, 110, 0, 1767093129,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093129), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659871_72e7b9acbbc8d2e4c9eba5438edf3700_rle_crop_4085420212_0.png', 0, 269, 172, 0, 1767093129,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093129), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420222_0.png', 0, 417, 322, 0, 1767093129,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 8 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.520909070968628 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767093132_2965821 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093133), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420161_0.png', 0, 179, 220, 0, 1767093133,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093133), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420167_0.png', 0, 445, 940, 0, 1767093133,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093133), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420202_0.png', 0, 194, 191, 0, 1767093133,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093133), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420220_0.png', 0, 162, 168, 0, 1767093133,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.3235061168670654 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767093135_2965821 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767093136), 0.0, 0.0, 14, '', 0, 0, '1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420159_0.png', 0, 120, 230, 0, 1767093136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6696581840515137 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1401659967, 1401659928, 1401659922, 1401659918, 1401659915, 1401659912, 1401659888, 1401659871, 1401659870, 1401659869] Looping around the photos to save general results len do output : 78 /1401670741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401670824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659967', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659928', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659922', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659918', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659915', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659912', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659888', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659871', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659870', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659869', None, None, None, None, None, '4287992') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 244 time used for this insertion : 0.04869484901428223 save_final save missing photos in datou_result : time spend for datou_step_exec : 41.850300788879395 time spend to save output : 0.05181264877319336 total time spend for step 2 : 41.90211343765259 step3:rle_unique_nms_with_priority Tue Dec 30 12:12:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 78 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 11 nb_hashtags : 4 time to prepare the origin masks : 5.96044135093689 time for calcul the mask position with numpy : 0.4867572784423828 nb_pixel_total : 8065547 time to create 1 rle with new method : 0.8978710174560547 time for calcul the mask position with numpy : 0.03957653045654297 nb_pixel_total : 30603 time to create 1 rle with old method : 0.03419160842895508 time for calcul the mask position with numpy : 0.040329933166503906 nb_pixel_total : 27944 time to create 1 rle with old method : 0.03194761276245117 time for calcul the mask position with numpy : 0.03940606117248535 nb_pixel_total : 33621 time to create 1 rle with old method : 0.0389711856842041 time for calcul the mask position with numpy : 0.04176759719848633 nb_pixel_total : 21419 time to create 1 rle with old method : 0.025541305541992188 time for calcul the mask position with numpy : 0.045340538024902344 nb_pixel_total : 29462 time to create 1 rle with old method : 0.033339500427246094 time for calcul the mask position with numpy : 0.03893923759460449 nb_pixel_total : 7856 time to create 1 rle with old method : 0.008857965469360352 time for calcul the mask position with numpy : 0.038919687271118164 nb_pixel_total : 17194 time to create 1 rle with old method : 0.019925832748413086 time for calcul the mask position with numpy : 0.04307913780212402 nb_pixel_total : 12937 time to create 1 rle with old method : 0.01513051986694336 time for calcul the mask position with numpy : 0.03254961967468262 nb_pixel_total : 25347 time to create 1 rle with old method : 0.029481887817382812 time for calcul the mask position with numpy : 0.02988600730895996 nb_pixel_total : 6503 time to create 1 rle with old method : 0.007700920104980469 time for calcul the mask position with numpy : 0.024072647094726562 nb_pixel_total : 15967 time to create 1 rle with old method : 0.018418312072753906 create new chi : 2.101928472518921 time to delete rle : 0.021969318389892578 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++Number RLEs to save : 5730 TO DO : save crop sub photo not yet done ! save time : 0.4150044918060303 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 6.517877578735352 time for calcul the mask position with numpy : 0.9835190773010254 nb_pixel_total : 7967345 time to create 1 rle with new method : 0.7501723766326904 time for calcul the mask position with numpy : 0.041802406311035156 nb_pixel_total : 24281 time to create 1 rle with old method : 0.028843402862548828 time for calcul the mask position with numpy : 0.04002261161804199 nb_pixel_total : 56133 time to create 1 rle with old method : 0.06885504722595215 time for calcul the mask position with numpy : 0.0439600944519043 nb_pixel_total : 24168 time to create 1 rle with old method : 0.034577369689941406 time for calcul the mask position with numpy : 0.036376237869262695 nb_pixel_total : 36673 time to create 1 rle with old method : 0.04079294204711914 time for calcul the mask position with numpy : 0.032759904861450195 nb_pixel_total : 30615 time to create 1 rle with old method : 0.033356428146362305 time for calcul the mask position with numpy : 0.02492523193359375 nb_pixel_total : 66051 time to create 1 rle with old method : 0.07775640487670898 time for calcul the mask position with numpy : 0.026717185974121094 nb_pixel_total : 18645 time to create 1 rle with old method : 0.021030902862548828 time for calcul the mask position with numpy : 0.024671554565429688 nb_pixel_total : 37690 time to create 1 rle with old method : 0.04279685020446777 time for calcul the mask position with numpy : 0.02418375015258789 nb_pixel_total : 14702 time to create 1 rle with old method : 0.016365528106689453 time for calcul the mask position with numpy : 0.02386784553527832 nb_pixel_total : 18097 time to create 1 rle with old method : 0.020803213119506836 create new chi : 2.4882659912109375 time to delete rle : 0.001554250717163086 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++Number RLEs to save : 7482 TO DO : save crop sub photo not yet done ! save time : 0.5077016353607178 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 3.6570401191711426 time for calcul the mask position with numpy : 0.8784165382385254 nb_pixel_total : 7921469 time to create 1 rle with new method : 1.0670008659362793 time for calcul the mask position with numpy : 0.025547504425048828 nb_pixel_total : 13788 time to create 1 rle with old method : 0.01614856719970703 time for calcul the mask position with numpy : 0.02420806884765625 nb_pixel_total : 12072 time to create 1 rle with old method : 0.014105081558227539 time for calcul the mask position with numpy : 0.027799606323242188 nb_pixel_total : 18609 time to create 1 rle with old method : 0.02152252197265625 time for calcul the mask position with numpy : 0.029303789138793945 nb_pixel_total : 288813 time to create 1 rle with new method : 0.9594242572784424 time for calcul the mask position with numpy : 0.02518296241760254 nb_pixel_total : 18280 time to create 1 rle with old method : 0.020273685455322266 time for calcul the mask position with numpy : 0.023946523666381836 nb_pixel_total : 21369 time to create 1 rle with old method : 0.024088621139526367 create new chi : 3.2323760986328125 time to delete rle : 0.0006442070007324219 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 4902 TO DO : save crop sub photo not yet done ! save time : 0.35419416427612305 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 5.581440448760986 time for calcul the mask position with numpy : 0.7185258865356445 nb_pixel_total : 8026073 time to create 1 rle with new method : 0.7456052303314209 time for calcul the mask position with numpy : 0.04425859451293945 nb_pixel_total : 14971 time to create 1 rle with old method : 0.017047882080078125 time for calcul the mask position with numpy : 0.04015016555786133 nb_pixel_total : 26361 time to create 1 rle with old method : 0.030760765075683594 time for calcul the mask position with numpy : 0.028474807739257812 nb_pixel_total : 12286 time to create 1 rle with old method : 0.014317512512207031 time for calcul the mask position with numpy : 0.025974035263061523 nb_pixel_total : 42457 time to create 1 rle with old method : 0.0491788387298584 time for calcul the mask position with numpy : 0.026856660842895508 nb_pixel_total : 36676 time to create 1 rle with old method : 0.0426480770111084 time for calcul the mask position with numpy : 0.02724003791809082 nb_pixel_total : 30935 time to create 1 rle with old method : 0.03597712516784668 time for calcul the mask position with numpy : 0.026001930236816406 nb_pixel_total : 20271 time to create 1 rle with old method : 0.023609161376953125 time for calcul the mask position with numpy : 0.02724289894104004 nb_pixel_total : 33427 time to create 1 rle with old method : 0.038469791412353516 time for calcul the mask position with numpy : 0.02576160430908203 nb_pixel_total : 24470 time to create 1 rle with old method : 0.028405189514160156 time for calcul the mask position with numpy : 0.027481555938720703 nb_pixel_total : 26473 time to create 1 rle with old method : 0.031173229217529297 create new chi : 2.1294403076171875 time to delete rle : 0.0008881092071533203 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++Number RLEs to save : 5588 TO DO : save crop sub photo not yet done ! save time : 0.41524314880371094 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 3.9016644954681396 time for calcul the mask position with numpy : 1.1682946681976318 nb_pixel_total : 8106975 time to create 1 rle with new method : 2.3874337673187256 time for calcul the mask position with numpy : 0.02915358543395996 nb_pixel_total : 17511 time to create 1 rle with old method : 0.029420852661132812 time for calcul the mask position with numpy : 0.038820505142211914 nb_pixel_total : 22125 time to create 1 rle with old method : 0.02970719337463379 time for calcul the mask position with numpy : 0.04476356506347656 nb_pixel_total : 13491 time to create 1 rle with old method : 0.019374370574951172 time for calcul the mask position with numpy : 0.04639124870300293 nb_pixel_total : 32207 time to create 1 rle with old method : 0.05012679100036621 time for calcul the mask position with numpy : 0.04611515998840332 nb_pixel_total : 50508 time to create 1 rle with old method : 0.07451605796813965 time for calcul the mask position with numpy : 0.043631792068481445 nb_pixel_total : 14749 time to create 1 rle with old method : 0.02043771743774414 time for calcul the mask position with numpy : 0.04432177543640137 nb_pixel_total : 12052 time to create 1 rle with old method : 0.014777660369873047 time for calcul the mask position with numpy : 0.04501605033874512 nb_pixel_total : 24782 time to create 1 rle with old method : 0.035031795501708984 create new chi : 4.236330986022949 time to delete rle : 0.0011980533599853516 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++Number RLEs to save : 5514 TO DO : save crop sub photo not yet done ! save time : 0.4120481014251709 nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 7.259449243545532 time for calcul the mask position with numpy : 0.63759446144104 nb_pixel_total : 8040462 time to create 1 rle with new method : 0.9147539138793945 time for calcul the mask position with numpy : 0.03801608085632324 nb_pixel_total : 15306 time to create 1 rle with old method : 0.017086029052734375 time for calcul the mask position with numpy : 0.04156947135925293 nb_pixel_total : 18905 time to create 1 rle with old method : 0.022017955780029297 time for calcul the mask position with numpy : 0.04046034812927246 nb_pixel_total : 57824 time to create 1 rle with old method : 0.06412267684936523 time for calcul the mask position with numpy : 0.03928804397583008 nb_pixel_total : 12760 time to create 1 rle with old method : 0.01434946060180664 time for calcul the mask position with numpy : 0.04004096984863281 nb_pixel_total : 11872 time to create 1 rle with old method : 0.01390528678894043 time for calcul the mask position with numpy : 0.042029380798339844 nb_pixel_total : 15822 time to create 1 rle with old method : 0.01859116554260254 time for calcul the mask position with numpy : 0.042195796966552734 nb_pixel_total : 24703 time to create 1 rle with old method : 0.02741861343383789 time for calcul the mask position with numpy : 0.0369565486907959 nb_pixel_total : 16937 time to create 1 rle with old method : 0.01885700225830078 time for calcul the mask position with numpy : 0.024068355560302734 nb_pixel_total : 27055 time to create 1 rle with old method : 0.030679941177368164 time for calcul the mask position with numpy : 0.02670574188232422 nb_pixel_total : 21861 time to create 1 rle with old method : 0.03507399559020996 time for calcul the mask position with numpy : 0.027301311492919922 nb_pixel_total : 11683 time to create 1 rle with old method : 0.014994621276855469 time for calcul the mask position with numpy : 0.024326801300048828 nb_pixel_total : 19210 time to create 1 rle with old method : 0.02136063575744629 create new chi : 2.317139148712158 time to delete rle : 0.001026153564453125 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++Number RLEs to save : 6956 TO DO : save crop sub photo not yet done ! save time : 0.5025904178619385 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 1.837794303894043 time for calcul the mask position with numpy : 0.7508149147033691 nb_pixel_total : 8127167 time to create 1 rle with new method : 0.9546201229095459 time for calcul the mask position with numpy : 0.027204513549804688 nb_pixel_total : 93927 time to create 1 rle with old method : 0.1217050552368164 time for calcul the mask position with numpy : 0.02530503273010254 nb_pixel_total : 41519 time to create 1 rle with old method : 0.04782223701477051 time for calcul the mask position with numpy : 0.025564193725585938 nb_pixel_total : 31787 time to create 1 rle with old method : 0.036359310150146484 create new chi : 2.032371997833252 time to delete rle : 0.0006387233734130859 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 4290 TO DO : save crop sub photo not yet done ! save time : 0.3246593475341797 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 3.289891242980957 time for calcul the mask position with numpy : 0.5271327495574951 nb_pixel_total : 8149914 time to create 1 rle with new method : 0.9565496444702148 time for calcul the mask position with numpy : 0.04062771797180176 nb_pixel_total : 19495 time to create 1 rle with old method : 0.02590489387512207 time for calcul the mask position with numpy : 0.03738522529602051 nb_pixel_total : 15028 time to create 1 rle with old method : 0.019277572631835938 time for calcul the mask position with numpy : 0.026282787322998047 nb_pixel_total : 21789 time to create 1 rle with old method : 0.024675607681274414 time for calcul the mask position with numpy : 0.02515125274658203 nb_pixel_total : 46505 time to create 1 rle with old method : 0.0531463623046875 time for calcul the mask position with numpy : 0.026117563247680664 nb_pixel_total : 9569 time to create 1 rle with old method : 0.010828495025634766 time for calcul the mask position with numpy : 0.024176597595214844 nb_pixel_total : 32100 time to create 1 rle with old method : 0.03781318664550781 create new chi : 1.8798034191131592 time to delete rle : 0.0007226467132568359 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 4428 TO DO : save crop sub photo not yet done ! save time : 0.32483983039855957 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 5.012680292129517 time for calcul the mask position with numpy : 0.5157222747802734 nb_pixel_total : 8041238 time to create 1 rle with new method : 1.3190128803253174 time for calcul the mask position with numpy : 0.03142356872558594 nb_pixel_total : 17875 time to create 1 rle with old method : 0.021297931671142578 time for calcul the mask position with numpy : 0.03232598304748535 nb_pixel_total : 21214 time to create 1 rle with old method : 0.024918556213378906 time for calcul the mask position with numpy : 0.025632619857788086 nb_pixel_total : 31597 time to create 1 rle with old method : 0.04497814178466797 time for calcul the mask position with numpy : 0.02829575538635254 nb_pixel_total : 73070 time to create 1 rle with old method : 0.09424972534179688 time for calcul the mask position with numpy : 0.025658607482910156 nb_pixel_total : 8183 time to create 1 rle with old method : 0.009474515914916992 time for calcul the mask position with numpy : 0.02603435516357422 nb_pixel_total : 24090 time to create 1 rle with old method : 0.02800154685974121 time for calcul the mask position with numpy : 0.029720306396484375 nb_pixel_total : 40941 time to create 1 rle with old method : 0.04753565788269043 time for calcul the mask position with numpy : 0.026373863220214844 nb_pixel_total : 36192 time to create 1 rle with old method : 0.0455167293548584 create new chi : 2.440643787384033 time to delete rle : 0.0009834766387939453 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 5528 TO DO : save crop sub photo not yet done ! save time : 0.4212765693664551 nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 2.5206685066223145 time for calcul the mask position with numpy : 0.620729923248291 nb_pixel_total : 8204924 time to create 1 rle with new method : 0.9941692352294922 time for calcul the mask position with numpy : 0.02380204200744629 nb_pixel_total : 31247 time to create 1 rle with old method : 0.035906076431274414 time for calcul the mask position with numpy : 0.024554729461669922 nb_pixel_total : 22725 time to create 1 rle with old method : 0.025885343551635742 time for calcul the mask position with numpy : 0.02397775650024414 nb_pixel_total : 19494 time to create 1 rle with old method : 0.021437644958496094 time for calcul the mask position with numpy : 0.02447986602783203 nb_pixel_total : 16010 time to create 1 rle with old method : 0.01807546615600586 create new chi : 1.8575468063354492 time to delete rle : 0.0005443096160888672 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 3470 TO DO : save crop sub photo not yet done ! save time : 0.27046656608581543 map_output_result : {1401659967: (0.0, 'Should be the crop_list due to order', 0), 1401659928: (0.0, 'Should be the crop_list due to order', 0), 1401659922: (0.0, 'Should be the crop_list due to order', 0), 1401659918: (0.0, 'Should be the crop_list due to order', 0), 1401659915: (0.0, 'Should be the crop_list due to order', 0), 1401659912: (0.0, 'Should be the crop_list due to order', 0), 1401659888: (0.0, 'Should be the crop_list due to order', 0), 1401659871: (0.0, 'Should be the crop_list due to order', 0), 1401659870: (0.0, 'Should be the crop_list due to order', 0), 1401659869: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1401659967, 1401659928, 1401659922, 1401659918, 1401659915, 1401659912, 1401659888, 1401659871, 1401659870, 1401659869] Looping around the photos to save general results len do output : 10 /1401659967.Didn't retrieve data . /1401659928.Didn't retrieve data . /1401659922.Didn't retrieve data . /1401659918.Didn't retrieve data . /1401659915.Didn't retrieve data . /1401659912.Didn't retrieve data . /1401659888.Didn't retrieve data . /1401659871.Didn't retrieve data . /1401659870.Didn't retrieve data . /1401659869.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659967', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659928', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659922', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659918', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659915', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659912', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659888', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659871', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659870', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659869', None, None, None, None, None, '4287992') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.015401601791381836 save_final save missing photos in datou_result : time spend for datou_step_exec : 75.56086325645447 time spend to save output : 0.015842914581298828 total time spend for step 3 : 75.57670617103577 step4:ventilate_hashtags_in_portfolio Tue Dec 30 12:13:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 29801549 get user id for portfolio 29801549 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29801549 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','autre','papier','mal_croppe','pet_clair','flou','environnement','metal','background','pet_fonce','pehd')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29801549 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','autre','papier','mal_croppe','pet_clair','flou','environnement','metal','background','pet_fonce','pehd')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29801549 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','autre','papier','mal_croppe','pet_clair','flou','environnement','metal','background','pet_fonce','pehd')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/29802075,29802076,29802077,29802078,29802079,29802080,29802081,29802082,29802083,29802084,29802085?tags=carton,autre,papier,mal_croppe,pet_clair,flou,environnement,metal,background,pet_fonce,pehd Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1401659967, 1401659928, 1401659922, 1401659918, 1401659915, 1401659912, 1401659888, 1401659871, 1401659870, 1401659869] Looping around the photos to save general results len do output : 1 /29801549. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659967', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659928', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659922', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659918', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659915', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659912', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659888', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659871', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659870', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659869', None, None, None, None, None, '4287992') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.01952981948852539 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.9683864116668701 time spend to save output : 0.019784927368164062 total time spend for step 4 : 1.9881713390350342 step5:final Tue Dec 30 12:13:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1401659967: ('0.027643783757716044',), 1401659928: ('0.027643783757716044',), 1401659922: ('0.027643783757716044',), 1401659918: ('0.027643783757716044',), 1401659915: ('0.027643783757716044',), 1401659912: ('0.027643783757716044',), 1401659888: ('0.027643783757716044',), 1401659871: ('0.027643783757716044',), 1401659870: ('0.027643783757716044',), 1401659869: ('0.027643783757716044',)} new output for save of step final : {1401659967: ('0.027643783757716044',), 1401659928: ('0.027643783757716044',), 1401659922: ('0.027643783757716044',), 1401659918: ('0.027643783757716044',), 1401659915: ('0.027643783757716044',), 1401659912: ('0.027643783757716044',), 1401659888: ('0.027643783757716044',), 1401659871: ('0.027643783757716044',), 1401659870: ('0.027643783757716044',), 1401659869: ('0.027643783757716044',)} [1401659967, 1401659928, 1401659922, 1401659918, 1401659915, 1401659912, 1401659888, 1401659871, 1401659870, 1401659869] Looping around the photos to save general results len do output : 10 /1401659967.Didn't retrieve data . /1401659928.Didn't retrieve data . /1401659922.Didn't retrieve data . /1401659918.Didn't retrieve data . /1401659915.Didn't retrieve data . /1401659912.Didn't retrieve data . /1401659888.Didn't retrieve data . /1401659871.Didn't retrieve data . /1401659870.Didn't retrieve data . /1401659869.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659967', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659928', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659922', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659918', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659915', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659912', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659888', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659871', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659870', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659869', None, None, None, None, None, '4287992') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.01528310775756836 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13858532905578613 time spend to save output : 0.015785694122314453 total time spend for step 5 : 0.15437102317810059 step6:blur_detection Tue Dec 30 12:13:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6.jpg resize: (2160, 3840) 1401659967 -6.455532315622683 treat image : temp/1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb.jpg resize: (2160, 3840) 1401659928 -7.048936874726732 treat image : temp/1767093028_2965821_1401659922_795bbe42ef7760439982a62eddb43aab.jpg resize: (2160, 3840) 1401659922 -7.1209783798461945 treat image : temp/1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d.jpg resize: (2160, 3840) 1401659918 -7.173658762167427 treat image : temp/1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72.jpg resize: (2160, 3840) 1401659915 -7.113381576695871 treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9.jpg resize: (2160, 3840) 1401659912 -7.146753059966331 treat image : temp/1767093028_2965821_1401659888_ff868829bf03ef9fb6d0c5d83c8a430e.jpg resize: (2160, 3840) 1401659888 -7.195839458353105 treat image : temp/1767093028_2965821_1401659871_72e7b9acbbc8d2e4c9eba5438edf3700.jpg resize: (2160, 3840) 1401659871 -6.830453452238268 treat image : temp/1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519.jpg resize: (2160, 3840) 1401659870 -7.038506659004228 treat image : temp/1767093028_2965821_1401659869_df9b98f3329c06623335f79f105582b8.jpg resize: (2160, 3840) 1401659869 -3.4049746756601182 treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420153_0.png resize: (114, 98) 1401670741 -4.208980126976688 treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420154_0.png resize: (168, 220) 1401670742 -2.587504167909727 treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420155_0.png resize: (124, 181) 1401670743 -3.605383435327382 treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420156_0.png resize: (111, 247) 1401670744 -3.7526168622954836 treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420157_0.png resize: (108, 103) 1401670745 -4.169641127377515 treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420160_0.png resize: (170, 250) 1401670746 -3.9441053005706848 treat image : temp/1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420163_0.png resize: (153, 200) 1401670747 -4.562247722238265 treat image : temp/1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420164_0.png resize: (143, 125) 1401670748 -4.327000332769834 treat image : temp/1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420165_0.png resize: (215, 240) 1401670749 -3.567291715918969 treat image : temp/1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420169_0.png resize: (200, 275) 1401670750 -3.8348805893044413 treat image : temp/1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420171_0.png resize: (360, 269) 1401670751 -4.589654158861185 treat image : temp/1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420172_0.png resize: (214, 179) 1401670752 -1.9121882505171144 treat image : temp/1767093028_2965821_1401659922_795bbe42ef7760439982a62eddb43aab_rle_crop_4085420173_0.png resize: (244, 120) 1401670753 -4.63186326886981 treat image : temp/1767093028_2965821_1401659922_795bbe42ef7760439982a62eddb43aab_rle_crop_4085420174_0.png resize: (158, 174) 1401670754 -3.3181636970217387 treat image : temp/1767093028_2965821_1401659922_795bbe42ef7760439982a62eddb43aab_rle_crop_4085420176_0.png resize: (119, 186) 1401670755 -4.124127019880007 treat image : temp/1767093028_2965821_1401659922_795bbe42ef7760439982a62eddb43aab_rle_crop_4085420177_0.png resize: (132, 123) 1401670756 -2.290599477322445 treat image : temp/1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420179_0.png resize: (134, 235) 1401670757 -4.003681586035053 treat image : temp/1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420180_0.png resize: (160, 200) 1401670758 -4.003405917921448 treat image : temp/1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420182_0.png resize: (151, 191) 1401670759 -4.023094427721022 treat image : temp/1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420186_0.png resize: (104, 142) 1401670760 -4.584797941931776 treat image : temp/1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420189_0.png resize: (192, 172) 1401670761 -3.5047021292303993 treat image : temp/1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420190_0.png resize: (169, 94) 1401670762 0.41103627990828306 treat image : temp/1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420191_0.png resize: (156, 144) 1401670763 -3.685830430200934 treat image : temp/1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420192_0.png resize: (263, 284) 1401670764 -3.452877652730055 treat image : temp/1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420193_0.png resize: (205, 224) 1401670765 -4.320369184900564 treat image : temp/1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420194_0.png resize: (194, 179) 1401670766 -2.523972621594302 treat image : temp/1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420195_0.png resize: (323, 113) 1401670767 -3.200105332322941 treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420197_0.png resize: (219, 160) 1401670768 -4.311591108297134 treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420199_0.png resize: (182, 203) 1401670769 -4.152413431411443 treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420200_0.png resize: (337, 181) 1401670770 -2.813449948899653 treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420204_0.png resize: (118, 137) 1401670771 -2.261118630679938 treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420207_0.png resize: (195, 135) 1401670772 -4.615998441348088 treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420208_0.png resize: (167, 160) 1401670773 -3.131807610991986 treat image : temp/1767093028_2965821_1401659888_ff868829bf03ef9fb6d0c5d83c8a430e_rle_crop_4085420209_0.png resize: (264, 172) 1401670774 -4.590379242295125 treat image : temp/1767093028_2965821_1401659888_ff868829bf03ef9fb6d0c5d83c8a430e_rle_crop_4085420210_0.png resize: (386, 180) 1401670775 -4.280396835908099 treat image : temp/1767093028_2965821_1401659888_ff868829bf03ef9fb6d0c5d83c8a430e_rle_crop_4085420211_0.png resize: (405, 371) 1401670776 -4.313923755298782 treat image : temp/1767093028_2965821_1401659871_72e7b9acbbc8d2e4c9eba5438edf3700_rle_crop_4085420213_0.png resize: (127, 119) 1401670777 -5.142732819242024 treat image : temp/1767093028_2965821_1401659871_72e7b9acbbc8d2e4c9eba5438edf3700_rle_crop_4085420214_0.png resize: (326, 233) 1401670778 -4.589423130967015 treat image : temp/1767093028_2965821_1401659871_72e7b9acbbc8d2e4c9eba5438edf3700_rle_crop_4085420215_0.png resize: (187, 186) 1401670779 -4.989822927762994 treat image : temp/1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420218_0.png resize: (274, 224) 1401670780 -4.766185676319305 treat image : temp/1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420219_0.png resize: (211, 299) 1401670781 -5.0807349752798 treat image : temp/1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420221_0.png resize: (110, 95) 1401670782 -4.162604195912628 treat image : temp/1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420224_0.png resize: (149, 175) 1401670784 -3.9721424535340817 treat image : temp/1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420225_0.png resize: (166, 143) 1401670785 -3.7264912504239076 treat image : temp/1767093028_2965821_1401659869_df9b98f3329c06623335f79f105582b8_rle_crop_4085420226_0.png resize: (167, 154) 1401670786 -4.396041879057435 treat image : temp/1767093028_2965821_1401659869_df9b98f3329c06623335f79f105582b8_rle_crop_4085420227_0.png resize: (105, 212) 1401670787 -2.9278973030405417 treat image : temp/1767093028_2965821_1401659869_df9b98f3329c06623335f79f105582b8_rle_crop_4085420228_0.png resize: (139, 267) 1401670788 -3.900790716950852 treat image : temp/1767093028_2965821_1401659869_df9b98f3329c06623335f79f105582b8_rle_crop_4085420229_0.png resize: (231, 241) 1401670789 -4.7352256325589135 treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420152_0.png resize: (203, 134) 1401670790 -3.23037083257271 treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420158_0.png resize: (160, 280) 1401670791 -2.21199813600893 treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420162_0.png resize: (149, 427) 1401670792 -4.2312137815731035 treat image : temp/1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420181_0.png resize: (274, 185) 1401670793 -4.263012793115612 treat image : temp/1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420183_0.png resize: (192, 221) 1401670794 -3.416212443654722 treat image : temp/1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420184_0.png resize: (203, 249) 1401670795 -3.325405648822708 treat image : temp/1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420185_0.png resize: (173, 307) 1401670796 -2.7207842003239193 treat image : temp/1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420196_0.png resize: (120, 189) 1401670797 -3.0113119502475634 treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420198_0.png resize: (137, 115) 1401670798 -2.6597624228644983 treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420203_0.png resize: (175, 132) 1401670799 -3.2195915367882932 treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420205_0.png resize: (154, 108) 1401670800 -3.8109079185819175 treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420206_0.png resize: (388, 238) 1401670801 -2.117755191784808 treat image : temp/1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420223_0.png resize: (199, 250) 1401670802 -3.2174559532372045 treat image : temp/1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420168_0.png resize: (156, 246) 1401670804 -4.195190676268258 treat image : temp/1767093028_2965821_1401659922_795bbe42ef7760439982a62eddb43aab_rle_crop_4085420178_0.png resize: (126, 122) 1401670805 -2.330540903630674 treat image : temp/1767093028_2965821_1401659871_72e7b9acbbc8d2e4c9eba5438edf3700_rle_crop_4085420216_0.png resize: (145, 139) 1401670806 -3.9949263055712674 treat image : temp/1767093028_2965821_1401659871_72e7b9acbbc8d2e4c9eba5438edf3700_rle_crop_4085420217_0.png resize: (153, 169) 1401670807 -4.865311431567402 treat image : temp/1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420166_0.png resize: (135, 179) 1401670810 -4.432855530508534 treat image : temp/1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420170_0.png resize: (109, 254) 1401670811 -3.4748884835616094 treat image : temp/1767093028_2965821_1401659922_795bbe42ef7760439982a62eddb43aab_rle_crop_4085420175_0.png resize: (505, 969) 1401670812 -4.960081268379106 treat image : temp/1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420187_0.png resize: (196, 176) 1401670813 -5.446419548509377 treat image : temp/1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420188_0.png resize: (99, 214) 1401670814 -3.0098871542736623 treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420201_0.png resize: (110, 184) 1401670815 -4.5285748901274845 treat image : temp/1767093028_2965821_1401659871_72e7b9acbbc8d2e4c9eba5438edf3700_rle_crop_4085420212_0.png resize: (172, 269) 1401670816 -4.807426529514082 treat image : temp/1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420222_0.png resize: (322, 417) 1401670817 -4.4590402527184505 treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420161_0.png resize: (220, 179) 1401670820 -5.1642361625548405 treat image : temp/1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420167_0.png resize: (940, 445) 1401670821 -2.922053409844842 treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420202_0.png resize: (191, 194) 1401670822 -4.261819229691765 treat image : temp/1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420220_0.png resize: (168, 162) 1401670823 -3.4217182073217 treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420159_0.png resize: (230, 120) 1401670824 -4.348737973603839 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 88 time used for this insertion : 0.0175473690032959 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 88 time used for this insertion : 0.018770933151245117 save missing photos in datou_result : time spend for datou_step_exec : 42.197072982788086 time spend to save output : 0.0422360897064209 total time spend for step 6 : 42.23930907249451 step7:brightness Tue Dec 30 12:14:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6.jpg treat image : temp/1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb.jpg treat image : temp/1767093028_2965821_1401659922_795bbe42ef7760439982a62eddb43aab.jpg treat image : temp/1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d.jpg treat image : temp/1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72.jpg treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9.jpg treat image : temp/1767093028_2965821_1401659888_ff868829bf03ef9fb6d0c5d83c8a430e.jpg treat image : temp/1767093028_2965821_1401659871_72e7b9acbbc8d2e4c9eba5438edf3700.jpg treat image : temp/1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519.jpg treat image : temp/1767093028_2965821_1401659869_df9b98f3329c06623335f79f105582b8.jpg treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420153_0.png treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420154_0.png treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420155_0.png treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420156_0.png treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420157_0.png treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420160_0.png treat image : temp/1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420163_0.png treat image : temp/1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420164_0.png treat image : temp/1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420165_0.png treat image : temp/1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420169_0.png treat image : temp/1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420171_0.png treat image : temp/1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420172_0.png treat image : temp/1767093028_2965821_1401659922_795bbe42ef7760439982a62eddb43aab_rle_crop_4085420173_0.png treat image : temp/1767093028_2965821_1401659922_795bbe42ef7760439982a62eddb43aab_rle_crop_4085420174_0.png treat image : temp/1767093028_2965821_1401659922_795bbe42ef7760439982a62eddb43aab_rle_crop_4085420176_0.png treat image : temp/1767093028_2965821_1401659922_795bbe42ef7760439982a62eddb43aab_rle_crop_4085420177_0.png treat image : temp/1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420179_0.png treat image : temp/1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420180_0.png treat image : temp/1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420182_0.png treat image : temp/1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420186_0.png treat image : temp/1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420189_0.png treat image : temp/1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420190_0.png treat image : temp/1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420191_0.png treat image : temp/1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420192_0.png treat image : temp/1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420193_0.png treat image : temp/1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420194_0.png treat image : temp/1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420195_0.png treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420197_0.png treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420199_0.png treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420200_0.png treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420204_0.png treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420207_0.png treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420208_0.png treat image : temp/1767093028_2965821_1401659888_ff868829bf03ef9fb6d0c5d83c8a430e_rle_crop_4085420209_0.png treat image : temp/1767093028_2965821_1401659888_ff868829bf03ef9fb6d0c5d83c8a430e_rle_crop_4085420210_0.png treat image : temp/1767093028_2965821_1401659888_ff868829bf03ef9fb6d0c5d83c8a430e_rle_crop_4085420211_0.png treat image : temp/1767093028_2965821_1401659871_72e7b9acbbc8d2e4c9eba5438edf3700_rle_crop_4085420213_0.png treat image : temp/1767093028_2965821_1401659871_72e7b9acbbc8d2e4c9eba5438edf3700_rle_crop_4085420214_0.png treat image : temp/1767093028_2965821_1401659871_72e7b9acbbc8d2e4c9eba5438edf3700_rle_crop_4085420215_0.png treat image : temp/1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420218_0.png treat image : temp/1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420219_0.png treat image : temp/1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420221_0.png treat image : temp/1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420224_0.png treat image : temp/1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420225_0.png treat image : temp/1767093028_2965821_1401659869_df9b98f3329c06623335f79f105582b8_rle_crop_4085420226_0.png treat image : temp/1767093028_2965821_1401659869_df9b98f3329c06623335f79f105582b8_rle_crop_4085420227_0.png treat image : temp/1767093028_2965821_1401659869_df9b98f3329c06623335f79f105582b8_rle_crop_4085420228_0.png treat image : temp/1767093028_2965821_1401659869_df9b98f3329c06623335f79f105582b8_rle_crop_4085420229_0.png treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420152_0.png treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420158_0.png treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420162_0.png treat image : temp/1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420181_0.png treat image : temp/1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420183_0.png treat image : temp/1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420184_0.png treat image : temp/1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420185_0.png treat image : temp/1767093028_2965821_1401659915_49881387a44dae13a590a4c8a9886b72_rle_crop_4085420196_0.png treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420198_0.png treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420203_0.png treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420205_0.png treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420206_0.png treat image : temp/1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420223_0.png treat image : temp/1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420168_0.png treat image : temp/1767093028_2965821_1401659922_795bbe42ef7760439982a62eddb43aab_rle_crop_4085420178_0.png treat image : temp/1767093028_2965821_1401659871_72e7b9acbbc8d2e4c9eba5438edf3700_rle_crop_4085420216_0.png treat image : temp/1767093028_2965821_1401659871_72e7b9acbbc8d2e4c9eba5438edf3700_rle_crop_4085420217_0.png treat image : temp/1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420166_0.png treat image : temp/1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420170_0.png treat image : temp/1767093028_2965821_1401659922_795bbe42ef7760439982a62eddb43aab_rle_crop_4085420175_0.png treat image : temp/1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420187_0.png treat image : temp/1767093028_2965821_1401659918_efeb3cac5f7eb6b7d7a2961f9c08351d_rle_crop_4085420188_0.png treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420201_0.png treat image : temp/1767093028_2965821_1401659871_72e7b9acbbc8d2e4c9eba5438edf3700_rle_crop_4085420212_0.png treat image : temp/1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420222_0.png treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420161_0.png treat image : temp/1767093028_2965821_1401659928_f19e77c0f80ecfbbf9efa738cf1248cb_rle_crop_4085420167_0.png treat image : temp/1767093028_2965821_1401659912_148207735c54a5a9257b38b78da245b9_rle_crop_4085420202_0.png treat image : temp/1767093028_2965821_1401659870_c2b980e7e1f3e748727e17a3bc9ec519_rle_crop_4085420220_0.png treat image : temp/1767093028_2965821_1401659967_2551012a025adbfd9c8c3ec802d2ecb6_rle_crop_4085420159_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 88 time used for this insertion : 0.016870737075805664 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 88 time used for this insertion : 0.019357681274414062 save missing photos in datou_result : time spend for datou_step_exec : 10.804227590560913 time spend to save output : 0.041832923889160156 total time spend for step 7 : 10.846060514450073 step8:velours_tree Tue Dec 30 12:14:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.08179450035095215 time spend to save output : 3.9577484130859375e-05 total time spend for step 8 : 0.08183407783508301 step9:send_mail_cod Tue Dec 30 12:14:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P29801549_30-12-2025_12_14_27.pdf 29802075 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette298020751767093267 29802076 change filename to text .change filename to text .change filename to text .change filename to text .imagette298020761767093268 29802077 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette298020771767093268 29802078 imagette298020781767093270 29802079 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette298020791767093270 29802080 imagette298020801767093271 29802082 change filename to text .change filename to text .change filename to text .change filename to text .imagette298020821767093271 29802083 imagette298020831767093271 29802084 change filename to text .imagette298020841767093271 29802085 imagette298020851767093271 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=29801549 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/29802075,29802076,29802077,29802078,29802079,29802080,29802081,29802082,29802083,29802084,29802085?tags=carton,autre,papier,mal_croppe,pet_clair,flou,environnement,metal,background,pet_fonce,pehd your option no_mail is active, we will not send the real mail to your client args[1401659967] : ((1401659967, -6.455532315622683, 492609224), (1401659967, -0.12072300734457785, 496442774), '0.027643783757716044') We are sending mail with results at report@fotonower.com args[1401659928] : ((1401659928, -7.048936874726732, 492609224), (1401659928, 0.1475657475196438, 2107752395), '0.027643783757716044') We are sending mail with results at report@fotonower.com args[1401659922] : ((1401659922, -7.1209783798461945, 492609224), (1401659922, 0.21112253896565797, 2107752395), '0.027643783757716044') We are sending mail with results at report@fotonower.com args[1401659918] : ((1401659918, -7.173658762167427, 492609224), (1401659918, 0.1317503201371729, 2107752395), '0.027643783757716044') We are sending mail with results at report@fotonower.com args[1401659915] : ((1401659915, -7.113381576695871, 492609224), (1401659915, 0.13849423763932783, 2107752395), '0.027643783757716044') We are sending mail with results at report@fotonower.com args[1401659912] : ((1401659912, -7.146753059966331, 492609224), (1401659912, 0.08808561624862606, 2107752395), '0.027643783757716044') We are sending mail with results at report@fotonower.com args[1401659888] : ((1401659888, -7.195839458353105, 492609224), (1401659888, 0.07109574047749062, 2107752395), '0.027643783757716044') We are sending mail with results at report@fotonower.com args[1401659871] : ((1401659871, -6.830453452238268, 492609224), (1401659871, -0.11038064838998236, 496442774), '0.027643783757716044') We are sending mail with results at report@fotonower.com args[1401659870] : ((1401659870, -7.038506659004228, 492609224), (1401659870, -0.07633297583839425, 496442774), '0.027643783757716044') We are sending mail with results at report@fotonower.com args[1401659869] : ((1401659869, -3.4049746756601182, 492609224), (1401659869, -2.543225277686489, 501862349), '0.027643783757716044') We are sending mail with results at report@fotonower.com refus_total : 0.027643783757716044 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=29801549 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29801549_30-12-2025_12_14_27.pdf results_Auto_P29801549_30-12-2025_12_14_27.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29801549_30-12-2025_12_14_27.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','29801549','results_Auto_P29801549_30-12-2025_12_14_27.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29801549_30-12-2025_12_14_27.pdf','pdf','','0.54','0.027643783757716044') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1401659967, 1401659928, 1401659922, 1401659918, 1401659915, 1401659912, 1401659888, 1401659871, 1401659870, 1401659869] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659967', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659928', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659922', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659918', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659915', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659912', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659888', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659871', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659870', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659869', None, None, None, None, None, '4287992') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.016065120697021484 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.888774394989014 time spend to save output : 0.01635146141052246 total time spend for step 9 : 6.905125856399536 step10:split_time_score Tue Dec 30 12:14:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 30122025 29801549 Nombre de photos uploadées : 10 / 23040 (0%) 30122025 29801549 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 30122025 29801549 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005056858062744141 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.23888516426086426 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.013069787219964494 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29793812_30-12-2025_07_10_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29793812 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29793812 AND mptpi.`type`=3726 To do Qualite : 0.05357912969393003 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29795651_30-12-2025_09_16_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29795651 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29795651 AND mptpi.`type`=3594 To do Qualite : 0.0531924090258891 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29801535_30-12-2025_12_14_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29801535 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29801535 AND mptpi.`type`=3726 To do Qualite : 0.027643783757716044 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29801549_30-12-2025_12_14_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29801549 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29801549 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'30122025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1401659967, 1401659928, 1401659922, 1401659918, 1401659915, 1401659912, 1401659888, 1401659871, 1401659870, 1401659869] Looping around the photos to save general results len do output : 1 /29801549Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659967', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659928', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659922', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659918', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659915', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659912', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659888', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659871', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659870', None, None, None, None, None, '4287992') ('3318', None, None, None, None, None, None, None, '4287992') ('3318', '29801549', '1401659869', None, None, None, None, None, '4287992') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.015705347061157227 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.7313196659088135 time spend to save output : 0.01588892936706543 total time spend for step 10 : 0.7472085952758789 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 98.35user 115.61system 4:09.82elapsed 85%CPU (0avgtext+0avgdata 4514652maxresident)k 2107352inputs+71344outputs (7508major+11105389minor)pagefaults 0swaps