python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2856028 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4311814'] with mtr_portfolio_ids : ['29953694'] and first list_photo_ids : [] new path : /proc/2856028/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 1.6282637119293213 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Jan 5 10:10:31 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10605 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2026-01-05 10:10:35.092002: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2026-01-05 10:10:35.118501: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2026-01-05 10:10:35.120432: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f0f6c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2026-01-05 10:10:35.120477: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2026-01-05 10:10:35.123599: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2026-01-05 10:10:35.395846: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3461b900 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2026-01-05 10:10:35.395914: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2026-01-05 10:10:35.397258: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-05 10:10:35.398970: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-05 10:10:35.433964: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-05 10:10:35.436867: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-05 10:10:35.441160: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-05 10:10:35.444583: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-05 10:10:35.446714: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-05 10:10:35.453587: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-05 10:10:35.455752: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-05 10:10:35.455883: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-05 10:10:35.457658: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-05 10:10:35.457685: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-05 10:10:35.457699: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-05 10:10:35.459963: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9826 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2026-01-05 10:10:35.839733: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-05 10:10:35.839826: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-05 10:10:35.839845: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-05 10:10:35.839860: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-05 10:10:35.839875: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-05 10:10:35.839889: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-05 10:10:35.839905: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-05 10:10:35.839920: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-05 10:10:35.841236: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-05 10:10:35.842510: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-05 10:10:35.842554: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-05 10:10:35.842573: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-05 10:10:35.842590: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-05 10:10:35.842608: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-05 10:10:35.842624: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-05 10:10:35.842640: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-05 10:10:35.842657: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-05 10:10:35.843958: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-05 10:10:35.843997: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-05 10:10:35.844006: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-05 10:10:35.844015: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-05 10:10:35.845380: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9826 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2026-01-05 10:10:48.538875: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-05 10:10:48.717709: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 9 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 Detection mask done ! Trying to reset tf kernel 2856585 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 346 tf kernel not reseted sub process len(results) : 9 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 9 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6828 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [30, 1704, 462, 2268] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003651857376098633 nb_pixel_total : 111394 time to create 1 rle with old method : 0.14003539085388184 length of segment : 500 DEBUG bbox = [1638, 1776, 1842, 1992] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007500648498535156 nb_pixel_total : 23981 time to create 1 rle with old method : 0.03180098533630371 length of segment : 192 DEBUG bbox = [1326, 1650, 1476, 1776] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00026106834411621094 nb_pixel_total : 13782 time to create 1 rle with old method : 0.015924453735351562 length of segment : 143 DEBUG bbox = [684, 354, 1242, 732] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0024275779724121094 nb_pixel_total : 89120 time to create 1 rle with old method : 0.10043859481811523 length of segment : 584 DEBUG bbox = [450, 1260, 702, 1434] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004992485046386719 nb_pixel_total : 25259 time to create 1 rle with old method : 0.031063556671142578 length of segment : 218 DEBUG bbox = [1908, 2292, 2118, 2502] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00044345855712890625 nb_pixel_total : 24063 time to create 1 rle with old method : 0.02752852439880371 length of segment : 196 DEBUG bbox = [282, 828, 744, 1344] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001970529556274414 nb_pixel_total : 123384 time to create 1 rle with old method : 0.1413402557373047 length of segment : 414 DEBUG bbox = [954, 2076, 1632, 2856] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.015552520751953125 nb_pixel_total : 372265 time to create 1 rle with new method : 0.02689337730407715 length of segment : 744 DEBUG bbox = [594, 1368, 1266, 1890] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0027031898498535156 nb_pixel_total : 149251 time to create 1 rle with old method : 0.16612529754638672 length of segment : 657 DEBUG bbox = [660, 1062, 1032, 1686] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0023844242095947266 nb_pixel_total : 122058 time to create 1 rle with old method : 0.16174578666687012 length of segment : 420 DEBUG bbox = [1062, 2484, 1476, 2766] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013797283172607422 nb_pixel_total : 45259 time to create 1 rle with old method : 0.06256675720214844 length of segment : 360 DEBUG bbox = [1248, 2718, 1782, 3048] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0028243064880371094 nb_pixel_total : 111295 time to create 1 rle with old method : 0.14194464683532715 length of segment : 478 DEBUG bbox = [972, 2802, 1452, 3216] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0021295547485351562 nb_pixel_total : 109282 time to create 1 rle with old method : 0.13726043701171875 length of segment : 410 DEBUG bbox = [636, 2100, 948, 2442] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001275777816772461 nb_pixel_total : 59294 time to create 1 rle with old method : 0.08244490623474121 length of segment : 346 DEBUG bbox = [1434, 1578, 1782, 1920] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010383129119873047 nb_pixel_total : 63446 time to create 1 rle with old method : 0.07112908363342285 length of segment : 353 DEBUG bbox = [660, 396, 936, 576] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005326271057128906 nb_pixel_total : 34400 time to create 1 rle with old method : 0.04036116600036621 length of segment : 237 DEBUG bbox = [456, 2790, 834, 2982] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00087738037109375 nb_pixel_total : 43697 time to create 1 rle with old method : 0.07940387725830078 length of segment : 345 DEBUG bbox = [498, 540, 696, 744] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006077289581298828 nb_pixel_total : 17113 time to create 1 rle with old method : 0.03407907485961914 length of segment : 173 DEBUG bbox = [888, 1002, 1566, 1644] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0042722225189208984 nb_pixel_total : 200553 time to create 1 rle with new method : 0.019403696060180664 length of segment : 585 DEBUG bbox = [186, 930, 450, 1152] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005497932434082031 nb_pixel_total : 27989 time to create 1 rle with old method : 0.0349268913269043 length of segment : 209 DEBUG bbox = [1920, 1680, 2160, 2004] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006849765777587891 nb_pixel_total : 50592 time to create 1 rle with old method : 0.05634570121765137 length of segment : 227 DEBUG bbox = [18, 210, 252, 402] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004165172576904297 nb_pixel_total : 33537 time to create 1 rle with old method : 0.036849021911621094 length of segment : 231 DEBUG bbox = [624, 744, 972, 1044] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009124279022216797 nb_pixel_total : 64661 time to create 1 rle with old method : 0.07234025001525879 length of segment : 379 DEBUG bbox = [324, 1410, 936, 2124] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0029294490814208984 nb_pixel_total : 214265 time to create 1 rle with new method : 0.01354837417602539 length of segment : 633 DEBUG bbox = [558, 2856, 936, 3024] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005466938018798828 nb_pixel_total : 36527 time to create 1 rle with old method : 0.04585075378417969 length of segment : 354 DEBUG bbox = [294, 966, 636, 1338] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017292499542236328 nb_pixel_total : 73311 time to create 1 rle with old method : 0.08563566207885742 length of segment : 413 DEBUG bbox = [918, 2040, 1548, 2418] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003462076187133789 nb_pixel_total : 119912 time to create 1 rle with old method : 0.17026734352111816 length of segment : 603 DEBUG bbox = [900, 1068, 1170, 1368] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012023448944091797 nb_pixel_total : 48755 time to create 1 rle with old method : 0.05786609649658203 length of segment : 267 DEBUG bbox = [2034, 1092, 2154, 1254] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00028777122497558594 nb_pixel_total : 15909 time to create 1 rle with old method : 0.019528627395629883 length of segment : 122 DEBUG bbox = [1530, 1452, 1656, 1626] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005211830139160156 nb_pixel_total : 12071 time to create 1 rle with old method : 0.016301631927490234 length of segment : 112 DEBUG bbox = [1722, 1272, 1998, 1446] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010514259338378906 nb_pixel_total : 34393 time to create 1 rle with old method : 0.038926124572753906 length of segment : 264 DEBUG bbox = [48, 2496, 402, 2952] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0022792816162109375 nb_pixel_total : 106096 time to create 1 rle with old method : 0.12235021591186523 length of segment : 379 DEBUG bbox = [1182, 2460, 1536, 2604] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008656978607177734 nb_pixel_total : 33276 time to create 1 rle with old method : 0.04085373878479004 length of segment : 325 DEBUG bbox = [168, 1920, 318, 2082] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004494190216064453 nb_pixel_total : 15191 time to create 1 rle with old method : 0.020232439041137695 length of segment : 131 DEBUG bbox = [774, 1368, 1380, 2082] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.005075931549072266 nb_pixel_total : 245963 time to create 1 rle with new method : 0.015007495880126953 length of segment : 537 DEBUG bbox = [462, 2070, 696, 2256] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009365081787109375 nb_pixel_total : 27645 time to create 1 rle with old method : 0.03426170349121094 length of segment : 234 DEBUG bbox = [1824, 804, 2142, 1344] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002176046371459961 nb_pixel_total : 126256 time to create 1 rle with old method : 0.14901232719421387 length of segment : 355 DEBUG bbox = [1566, 2610, 2112, 3210] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0036962032318115234 nb_pixel_total : 154530 time to create 1 rle with new method : 0.010596275329589844 length of segment : 689 DEBUG bbox = [300, 342, 702, 774] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0020754337310791016 nb_pixel_total : 61637 time to create 1 rle with old method : 0.0709373950958252 length of segment : 354 DEBUG bbox = [1260, 1182, 1410, 1422] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006353855133056641 nb_pixel_total : 26809 time to create 1 rle with old method : 0.029752254486083984 length of segment : 135 DEBUG bbox = [150, 1200, 492, 1428] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001211404800415039 nb_pixel_total : 31010 time to create 1 rle with old method : 0.03506588935852051 length of segment : 349 DEBUG bbox = [1182, 1920, 1662, 2340] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002555370330810547 nb_pixel_total : 114410 time to create 1 rle with old method : 0.12787580490112305 length of segment : 455 DEBUG bbox = [42, 180, 438, 648] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002614259719848633 nb_pixel_total : 121874 time to create 1 rle with old method : 0.1335597038269043 length of segment : 394 DEBUG bbox = [630, 1506, 750, 1746] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00047397613525390625 nb_pixel_total : 17730 time to create 1 rle with old method : 0.020380735397338867 length of segment : 105 DEBUG bbox = [840, 600, 1050, 1032] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011463165283203125 nb_pixel_total : 57192 time to create 1 rle with old method : 0.06711864471435547 length of segment : 207 DEBUG bbox = [0, 516, 216, 852] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008256435394287109 nb_pixel_total : 40201 time to create 1 rle with old method : 0.04557633399963379 length of segment : 192 DEBUG bbox = [222, 936, 600, 1170] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012655258178710938 nb_pixel_total : 54472 time to create 1 rle with old method : 0.06151771545410156 length of segment : 350 DEBUG bbox = [696, 1152, 1020, 1674] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018544197082519531 nb_pixel_total : 71463 time to create 1 rle with old method : 0.08138036727905273 length of segment : 300 DEBUG bbox = [450, 114, 756, 372] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011849403381347656 nb_pixel_total : 46458 time to create 1 rle with old method : 0.049814462661743164 length of segment : 302 DEBUG bbox = [972, 630, 1338, 1188] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002252340316772461 nb_pixel_total : 76400 time to create 1 rle with old method : 0.08338379859924316 length of segment : 292 DEBUG bbox = [684, 144, 1242, 666] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0029642581939697266 nb_pixel_total : 109987 time to create 1 rle with old method : 0.12172627449035645 length of segment : 631 DEBUG bbox = [1194, 1482, 1530, 1728] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011055469512939453 nb_pixel_total : 42784 time to create 1 rle with old method : 0.04923510551452637 length of segment : 321 DEBUG bbox = [894, 1326, 1146, 1542] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009524822235107422 nb_pixel_total : 29102 time to create 1 rle with old method : 0.03329658508300781 length of segment : 220 DEBUG bbox = [1662, 1374, 1926, 1860] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017294883728027344 nb_pixel_total : 75578 time to create 1 rle with old method : 0.08396792411804199 length of segment : 300 DEBUG bbox = [1296, 1050, 1602, 1344] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012378692626953125 nb_pixel_total : 52169 time to create 1 rle with old method : 0.05862545967102051 length of segment : 279 DEBUG bbox = [1776, 1008, 1932, 1266] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005595684051513672 nb_pixel_total : 27540 time to create 1 rle with old method : 0.030732393264770508 length of segment : 164 DEBUG bbox = [462, 546, 588, 804] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004830360412597656 nb_pixel_total : 19360 time to create 1 rle with old method : 0.021878719329833984 length of segment : 128 DEBUG bbox = [852, 1500, 1098, 1716] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006649494171142578 nb_pixel_total : 31991 time to create 1 rle with old method : 0.03627467155456543 length of segment : 228 DEBUG bbox = [1158, 1296, 1464, 1524] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006084442138671875 nb_pixel_total : 24879 time to create 1 rle with old method : 0.027600765228271484 length of segment : 263 DEBUG bbox = [132, 2064, 558, 2484] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0021796226501464844 nb_pixel_total : 81077 time to create 1 rle with old method : 0.08965158462524414 length of segment : 381 DEBUG bbox = [252, 1338, 834, 2016] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.006769895553588867 nb_pixel_total : 168471 time to create 1 rle with new method : 0.012933969497680664 length of segment : 776 DEBUG bbox = [186, 2466, 468, 2574] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009474754333496094 nb_pixel_total : 18665 time to create 1 rle with old method : 0.027712583541870117 length of segment : 269 DEBUG bbox = [1836, 2376, 1962, 2532] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00041222572326660156 nb_pixel_total : 10395 time to create 1 rle with old method : 0.011775016784667969 length of segment : 112 DEBUG bbox = [0, 1866, 186, 2094] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007534027099609375 nb_pixel_total : 24317 time to create 1 rle with old method : 0.027001380920410156 length of segment : 226 DEBUG bbox = [1080, 2916, 1470, 3564] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003208160400390625 nb_pixel_total : 145110 time to create 1 rle with old method : 0.15752696990966797 length of segment : 379 DEBUG bbox = [1398, 960, 1578, 1182] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006721019744873047 nb_pixel_total : 15739 time to create 1 rle with old method : 0.018115520477294922 length of segment : 200 DEBUG bbox = [1098, 552, 1254, 732] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005624294281005859 nb_pixel_total : 17744 time to create 1 rle with old method : 0.0198209285736084 length of segment : 144 DEBUG bbox = [180, 678, 396, 768] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005362033843994141 nb_pixel_total : 13008 time to create 1 rle with old method : 0.014587163925170898 length of segment : 206 DEBUG bbox = [30, 360, 360, 516] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009608268737792969 nb_pixel_total : 31375 time to create 1 rle with old method : 0.03560638427734375 length of segment : 317 DEBUG bbox = [432, 1272, 768, 1818] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002528667449951172 nb_pixel_total : 87110 time to create 1 rle with old method : 0.09729862213134766 length of segment : 321 DEBUG bbox = [234, 996, 420, 1182] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005958080291748047 nb_pixel_total : 21477 time to create 1 rle with old method : 0.02460312843322754 length of segment : 175 DEBUG bbox = [1632, 1680, 1938, 2142] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017654895782470703 nb_pixel_total : 72043 time to create 1 rle with old method : 0.08243441581726074 length of segment : 249 DEBUG bbox = [936, 2304, 1350, 2856] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002730131149291992 nb_pixel_total : 112470 time to create 1 rle with old method : 0.1241304874420166 length of segment : 406 DEBUG bbox = [1338, 2604, 1674, 3030] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016715526580810547 nb_pixel_total : 89283 time to create 1 rle with old method : 0.10218191146850586 length of segment : 367 DEBUG bbox = [294, 1722, 396, 1884] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00040793418884277344 nb_pixel_total : 9721 time to create 1 rle with old method : 0.011719942092895508 length of segment : 87 DEBUG bbox = [240, 630, 516, 804] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008912086486816406 nb_pixel_total : 15400 time to create 1 rle with old method : 0.018082857131958008 length of segment : 246 DEBUG bbox = [0, 24, 318, 300] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014395713806152344 nb_pixel_total : 64454 time to create 1 rle with old method : 0.07375144958496094 length of segment : 304 time spent for convertir_results : 9.370063543319702 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 77 chid ids of type : 3594 Number RLEs to save : 24953 save missing photos in datou_result : time spend for datou_step_exec : 67.33535313606262 time spend to save output : 1.6905779838562012 total time spend for step 1 : 69.02593111991882 step2:crop_condition Mon Jan 5 10:11:40 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 77 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 37 About to insert : list_path_to_insert length 37 new photo from crops ! About to upload 37 photos upload in portfolio : 3736932 init cache_photo without model_param we have 37 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767604312_2856028 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822513_0.png', 0, 497, 657, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822514_0.png', 0, 613, 318, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822515_0.png', 0, 240, 342, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822518_0.png', 0, 332, 292, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822519_0.png', 0, 326, 330, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504679_855b3b9f28897492745f9b86d30ada50_rle_crop_4090822522_0.png', 0, 187, 173, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504679_855b3b9f28897492745f9b86d30ada50_rle_crop_4090822523_0.png', 0, 552, 585, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504679_855b3b9f28897492745f9b86d30ada50_rle_crop_4090822524_0.png', 0, 205, 208, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504679_855b3b9f28897492745f9b86d30ada50_rle_crop_4090822525_0.png', 0, 322, 227, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504679_855b3b9f28897492745f9b86d30ada50_rle_crop_4090822527_0.png', 0, 274, 319, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504674_caed35f5ed6908736f675a53335b4d53_rle_crop_4090822529_0.png', 0, 166, 354, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504674_caed35f5ed6908736f675a53335b4d53_rle_crop_4090822530_0.png', 0, 371, 298, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504674_caed35f5ed6908736f675a53335b4d53_rle_crop_4090822532_0.png', 0, 267, 266, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504674_caed35f5ed6908736f675a53335b4d53_rle_crop_4090822533_0.png', 0, 151, 119, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504666_e636df319ce29fbd439fe9f2796bc02a_rle_crop_4090822534_0.png', 0, 170, 112, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504666_e636df319ce29fbd439fe9f2796bc02a_rle_crop_4090822535_0.png', 0, 162, 263, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504666_e636df319ce29fbd439fe9f2796bc02a_rle_crop_4090822536_0.png', 0, 454, 341, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504666_e636df319ce29fbd439fe9f2796bc02a_rle_crop_4090822539_0.png', 0, 597, 537, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822543_0.png', 0, 382, 351, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822544_0.png', 0, 238, 132, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822545_0.png', 0, 210, 334, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822549_0.png', 0, 404, 179, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822553_0.png', 0, 235, 292, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822554_0.png', 0, 438, 268, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822555_0.png', 0, 484, 524, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822556_0.png', 0, 230, 274, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822557_0.png', 0, 201, 218, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822563_0.png', 0, 181, 245, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822566_0.png', 0, 106, 251, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822567_0.png', 0, 146, 112, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822568_0.png', 0, 219, 175, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504655_7533da09781f9782900fb4a6e2dcaad0_rle_crop_4090822570_0.png', 0, 209, 153, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504655_7533da09781f9782900fb4a6e2dcaad0_rle_crop_4090822572_0.png', 0, 85, 204, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a_rle_crop_4090822575_0.png', 0, 171, 175, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a_rle_crop_4090822577_0.png', 0, 514, 351, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a_rle_crop_4090822580_0.png', 0, 141, 237, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604320), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a_rle_crop_4090822581_0.png', 0, 263, 291, 0, 1767604320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 37 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.441423416137695 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3736932 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767604327_2856028 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604328), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822512_0.png', 0, 756, 656, 0, 1767604328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604328), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504666_e636df319ce29fbd439fe9f2796bc02a_rle_crop_4090822537_0.png', 0, 141, 325, 0, 1767604328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604328), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822540_0.png', 0, 174, 206, 0, 1767604328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604328), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822548_0.png', 0, 214, 100, 0, 1767604328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604328), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822561_0.png', 0, 254, 96, 0, 1767604328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604328), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822562_0.png', 0, 192, 224, 0, 1767604328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604328), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504655_7533da09781f9782900fb4a6e2dcaad0_rle_crop_4090822573_0.png', 0, 150, 313, 0, 1767604328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604328), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a_rle_crop_4090822576_0.png', 0, 414, 248, 0, 1767604328,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 8 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.1884851455688477 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767604331_2856028 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604332), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822507_0.png', 0, 117, 143, 0, 1767604332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604332), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822520_0.png', 0, 178, 228, 0, 1767604332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604332), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822521_0.png', 0, 167, 345, 0, 1767604332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604332), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504666_e636df319ce29fbd439fe9f2796bc02a_rle_crop_4090822538_0.png', 0, 139, 130, 0, 1767604332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604332), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504655_7533da09781f9782900fb4a6e2dcaad0_rle_crop_4090822571_0.png', 0, 148, 144, 0, 1767604332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604332), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a_rle_crop_4090822579_0.png', 0, 144, 84, 0, 1767604332,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.098097801208496 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 3736932 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767604343_2856028 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604348), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822505_0.png', 0, 527, 415, 0, 1767604348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604348), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822508_0.png', 0, 301, 503, 0, 1767604348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604348), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822509_0.png', 0, 171, 215, 0, 1767604348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604348), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822511_0.png', 0, 429, 414, 0, 1767604348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604348), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822516_0.png', 0, 296, 466, 0, 1767604348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604348), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822517_0.png', 0, 372, 410, 0, 1767604348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604348), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504679_855b3b9f28897492745f9b86d30ada50_rle_crop_4090822526_0.png', 0, 178, 230, 0, 1767604348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604348), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504674_caed35f5ed6908736f675a53335b4d53_rle_crop_4090822528_0.png', 0, 661, 519, 0, 1767604348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604348), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504674_caed35f5ed6908736f675a53335b4d53_rle_crop_4090822531_0.png', 0, 294, 593, 0, 1767604348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604348), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822541_0.png', 0, 522, 312, 0, 1767604348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604348), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822542_0.png', 0, 521, 482, 0, 1767604348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604348), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822546_0.png', 0, 389, 419, 0, 1767604348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604348), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822547_0.png', 0, 401, 372, 0, 1767604348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604348), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822550_0.png', 0, 316, 186, 0, 1767604348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604348), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822551_0.png', 0, 221, 349, 0, 1767604348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604348), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822558_0.png', 0, 465, 229, 0, 1767604348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604348), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822559_0.png', 0, 254, 270, 0, 1767604348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604348), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822564_0.png', 0, 330, 375, 0, 1767604348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604348), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822565_0.png', 0, 581, 517, 0, 1767604348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604348), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504655_7533da09781f9782900fb4a6e2dcaad0_rle_crop_4090822569_0.png', 0, 563, 376, 0, 1767604348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604348), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504655_7533da09781f9782900fb4a6e2dcaad0_rle_crop_4090822574_0.png', 0, 474, 316, 0, 1767604348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 21 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.127098083496094 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767604351_2856028 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604352), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822506_0.png', 0, 196, 188, 0, 1767604352,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604352), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822552_0.png', 0, 405, 300, 0, 1767604352,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604352), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a_rle_crop_4090822578_0.png', 0, 421, 280, 0, 1767604352,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1792190074920654 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767604354_2856028 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604354), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822510_0.png', 0, 201, 196, 0, 1767604354,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767604354), 0.0, 0.0, 14, '', 0, 0, '1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822560_0.png', 0, 245, 153, 0, 1767604354,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7869453430175781 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1402504725, 1402504723, 1402504679, 1402504674, 1402504666, 1402504661, 1402504659, 1402504655, 1402504605] Looping around the photos to save general results len do output : 77 /1402509911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402509975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402510249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504725', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504723', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504679', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504674', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504666', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504661', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504659', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504655', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504605', None, None, None, None, None, '4311814') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 240 time used for this insertion : 0.050812721252441406 save_final save missing photos in datou_result : time spend for datou_step_exec : 53.948185205459595 time spend to save output : 0.053543806076049805 total time spend for step 2 : 54.001729011535645 step3:rle_unique_nms_with_priority Mon Jan 5 10:12:34 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 77 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 9 nb_hashtags : 6 time to prepare the origin masks : 6.13586950302124 time for calcul the mask position with numpy : 0.6715219020843506 nb_pixel_total : 7361901 time to create 1 rle with new method : 0.9074263572692871 time for calcul the mask position with numpy : 0.0271451473236084 nb_pixel_total : 149251 time to create 1 rle with old method : 0.16427135467529297 time for calcul the mask position with numpy : 0.030977249145507812 nb_pixel_total : 372265 time to create 1 rle with new method : 0.7666025161743164 time for calcul the mask position with numpy : 0.04507184028625488 nb_pixel_total : 123384 time to create 1 rle with old method : 0.13451385498046875 time for calcul the mask position with numpy : 0.042691946029663086 nb_pixel_total : 24063 time to create 1 rle with old method : 0.03771662712097168 time for calcul the mask position with numpy : 0.03372526168823242 nb_pixel_total : 25259 time to create 1 rle with old method : 0.03328299522399902 time for calcul the mask position with numpy : 0.027632713317871094 nb_pixel_total : 89120 time to create 1 rle with old method : 0.09676456451416016 time for calcul the mask position with numpy : 0.02554464340209961 nb_pixel_total : 13782 time to create 1 rle with old method : 0.015111446380615234 time for calcul the mask position with numpy : 0.02469801902770996 nb_pixel_total : 23981 time to create 1 rle with old method : 0.026193618774414062 time for calcul the mask position with numpy : 0.025864124298095703 nb_pixel_total : 111394 time to create 1 rle with old method : 0.12121367454528809 create new chi : 3.334768295288086 time to delete rle : 0.024871110916137695 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++Number RLEs to save : 9456 TO DO : save crop sub photo not yet done ! save time : 0.6099240779876709 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 4.443981170654297 time for calcul the mask position with numpy : 0.9203331470489502 nb_pixel_total : 7706143 time to create 1 rle with new method : 1.026390790939331 time for calcul the mask position with numpy : 0.02724599838256836 nb_pixel_total : 43697 time to create 1 rle with old method : 0.05244636535644531 time for calcul the mask position with numpy : 0.029120683670043945 nb_pixel_total : 34400 time to create 1 rle with old method : 0.03872418403625488 time for calcul the mask position with numpy : 0.026620864868164062 nb_pixel_total : 63446 time to create 1 rle with old method : 0.07064366340637207 time for calcul the mask position with numpy : 0.028733015060424805 nb_pixel_total : 59294 time to create 1 rle with old method : 0.0718069076538086 time for calcul the mask position with numpy : 0.02766275405883789 nb_pixel_total : 108808 time to create 1 rle with old method : 0.13047051429748535 time for calcul the mask position with numpy : 0.025238752365112305 nb_pixel_total : 111295 time to create 1 rle with old method : 0.12203240394592285 time for calcul the mask position with numpy : 0.02576160430908203 nb_pixel_total : 45259 time to create 1 rle with old method : 0.05034804344177246 time for calcul the mask position with numpy : 0.025257349014282227 nb_pixel_total : 122058 time to create 1 rle with old method : 0.13637471199035645 create new chi : 2.8840036392211914 time to delete rle : 0.0014417171478271484 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 7978 TO DO : save crop sub photo not yet done ! save time : 0.5537025928497314 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 3.119825601577759 time for calcul the mask position with numpy : 0.9389023780822754 nb_pixel_total : 7899955 time to create 1 rle with new method : 0.9103891849517822 time for calcul the mask position with numpy : 0.027043819427490234 nb_pixel_total : 64661 time to create 1 rle with old method : 0.07712268829345703 time for calcul the mask position with numpy : 0.02936577796936035 nb_pixel_total : 33537 time to create 1 rle with old method : 0.04094886779785156 time for calcul the mask position with numpy : 0.028090953826904297 nb_pixel_total : 50592 time to create 1 rle with old method : 0.06416964530944824 time for calcul the mask position with numpy : 0.03039407730102539 nb_pixel_total : 27989 time to create 1 rle with old method : 0.03525424003601074 time for calcul the mask position with numpy : 0.025957584381103516 nb_pixel_total : 200553 time to create 1 rle with new method : 1.2092182636260986 time for calcul the mask position with numpy : 0.02607440948486328 nb_pixel_total : 17113 time to create 1 rle with old method : 0.01921224594116211 create new chi : 3.539369583129883 time to delete rle : 0.0010478496551513672 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5768 TO DO : save crop sub photo not yet done ! save time : 0.3922412395477295 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 4.088175535202026 time for calcul the mask position with numpy : 0.5929379463195801 nb_pixel_total : 7785721 time to create 1 rle with new method : 1.2250702381134033 time for calcul the mask position with numpy : 0.038675546646118164 nb_pixel_total : 15909 time to create 1 rle with old method : 0.01961350440979004 time for calcul the mask position with numpy : 0.03713250160217285 nb_pixel_total : 48755 time to create 1 rle with old method : 0.05448484420776367 time for calcul the mask position with numpy : 0.03206157684326172 nb_pixel_total : 119912 time to create 1 rle with old method : 0.1380300521850586 time for calcul the mask position with numpy : 0.027981281280517578 nb_pixel_total : 73311 time to create 1 rle with old method : 0.08228588104248047 time for calcul the mask position with numpy : 0.02867603302001953 nb_pixel_total : 36527 time to create 1 rle with old method : 0.05124521255493164 time for calcul the mask position with numpy : 0.04433321952819824 nb_pixel_total : 214265 time to create 1 rle with new method : 0.6764745712280273 create new chi : 3.1278393268585205 time to delete rle : 0.0011591911315917969 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 6944 TO DO : save crop sub photo not yet done ! save time : 0.4606199264526367 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 3.6758742332458496 time for calcul the mask position with numpy : 0.9076237678527832 nb_pixel_total : 7847410 time to create 1 rle with new method : 0.5881161689758301 time for calcul the mask position with numpy : 0.02775859832763672 nb_pixel_total : 245963 time to create 1 rle with new method : 1.02195405960083 time for calcul the mask position with numpy : 0.024539470672607422 nb_pixel_total : 15191 time to create 1 rle with old method : 0.01716756820678711 time for calcul the mask position with numpy : 0.03204059600830078 nb_pixel_total : 33276 time to create 1 rle with old method : 0.037064552307128906 time for calcul the mask position with numpy : 0.04113364219665527 nb_pixel_total : 106096 time to create 1 rle with old method : 0.11712193489074707 time for calcul the mask position with numpy : 0.03476214408874512 nb_pixel_total : 34393 time to create 1 rle with old method : 0.03810739517211914 time for calcul the mask position with numpy : 0.024208545684814453 nb_pixel_total : 12071 time to create 1 rle with old method : 0.013503074645996094 create new chi : 2.998326301574707 time to delete rle : 0.001005411148071289 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 5656 TO DO : save crop sub photo not yet done ! save time : 0.39128851890563965 nb_obj : 16 nb_hashtags : 4 time to prepare the origin masks : 8.95610761642456 time for calcul the mask position with numpy : 0.9794774055480957 nb_pixel_total : 7156326 time to create 1 rle with new method : 1.2009587287902832 time for calcul the mask position with numpy : 0.024120092391967773 nb_pixel_total : 109987 time to create 1 rle with old method : 0.12367725372314453 time for calcul the mask position with numpy : 0.025139808654785156 nb_pixel_total : 76400 time to create 1 rle with old method : 0.08534455299377441 time for calcul the mask position with numpy : 0.025980234146118164 nb_pixel_total : 46458 time to create 1 rle with old method : 0.05157184600830078 time for calcul the mask position with numpy : 0.025909423828125 nb_pixel_total : 71463 time to create 1 rle with old method : 0.07902050018310547 time for calcul the mask position with numpy : 0.02543926239013672 nb_pixel_total : 54472 time to create 1 rle with old method : 0.06054258346557617 time for calcul the mask position with numpy : 0.025113821029663086 nb_pixel_total : 40201 time to create 1 rle with old method : 0.04430818557739258 time for calcul the mask position with numpy : 0.02666330337524414 nb_pixel_total : 57192 time to create 1 rle with old method : 0.06387543678283691 time for calcul the mask position with numpy : 0.027000904083251953 nb_pixel_total : 17730 time to create 1 rle with old method : 0.019973039627075195 time for calcul the mask position with numpy : 0.026195049285888672 nb_pixel_total : 121874 time to create 1 rle with old method : 0.1330554485321045 time for calcul the mask position with numpy : 0.025646686553955078 nb_pixel_total : 114410 time to create 1 rle with old method : 0.12441802024841309 time for calcul the mask position with numpy : 0.025879859924316406 nb_pixel_total : 31010 time to create 1 rle with old method : 0.03451037406921387 time for calcul the mask position with numpy : 0.0251767635345459 nb_pixel_total : 26809 time to create 1 rle with old method : 0.030107498168945312 time for calcul the mask position with numpy : 0.026250839233398438 nb_pixel_total : 61637 time to create 1 rle with old method : 0.06904435157775879 time for calcul the mask position with numpy : 0.02709794044494629 nb_pixel_total : 154530 time to create 1 rle with new method : 0.9935696125030518 time for calcul the mask position with numpy : 0.025628328323364258 nb_pixel_total : 126256 time to create 1 rle with old method : 0.13762903213500977 time for calcul the mask position with numpy : 0.025158405303955078 nb_pixel_total : 27645 time to create 1 rle with old method : 0.030986547470092773 create new chi : 4.747034788131714 time to delete rle : 0.0017521381378173828 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 12848 TO DO : save crop sub photo not yet done ! save time : 0.7938082218170166 nb_obj : 13 nb_hashtags : 4 time to prepare the origin masks : 7.478577613830566 time for calcul the mask position with numpy : 0.7132790088653564 nb_pixel_total : 7688072 time to create 1 rle with new method : 1.4173851013183594 time for calcul the mask position with numpy : 0.04033470153808594 nb_pixel_total : 24317 time to create 1 rle with old method : 0.02690410614013672 time for calcul the mask position with numpy : 0.025393247604370117 nb_pixel_total : 10395 time to create 1 rle with old method : 0.011353015899658203 time for calcul the mask position with numpy : 0.023726463317871094 nb_pixel_total : 18665 time to create 1 rle with old method : 0.020262718200683594 time for calcul the mask position with numpy : 0.026324748992919922 nb_pixel_total : 168471 time to create 1 rle with new method : 0.8227121829986572 time for calcul the mask position with numpy : 0.0251922607421875 nb_pixel_total : 81077 time to create 1 rle with old method : 0.08900237083435059 time for calcul the mask position with numpy : 0.025943517684936523 nb_pixel_total : 24879 time to create 1 rle with old method : 0.0270845890045166 time for calcul the mask position with numpy : 0.025635957717895508 nb_pixel_total : 31991 time to create 1 rle with old method : 0.03704500198364258 time for calcul the mask position with numpy : 0.023245573043823242 nb_pixel_total : 19360 time to create 1 rle with old method : 0.019858837127685547 time for calcul the mask position with numpy : 0.02433156967163086 nb_pixel_total : 27540 time to create 1 rle with old method : 0.029334545135498047 time for calcul the mask position with numpy : 0.026018381118774414 nb_pixel_total : 52169 time to create 1 rle with old method : 0.05561041831970215 time for calcul the mask position with numpy : 0.025871753692626953 nb_pixel_total : 75578 time to create 1 rle with old method : 0.08047962188720703 time for calcul the mask position with numpy : 0.025980710983276367 nb_pixel_total : 29102 time to create 1 rle with old method : 0.03179311752319336 time for calcul the mask position with numpy : 0.024852991104125977 nb_pixel_total : 42784 time to create 1 rle with old method : 0.05302619934082031 create new chi : 3.852757692337036 time to delete rle : 0.0018873214721679688 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 9494 TO DO : save crop sub photo not yet done ! save time : 0.6372766494750977 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 3.0371530055999756 time for calcul the mask position with numpy : 0.8621563911437988 nb_pixel_total : 7984314 time to create 1 rle with new method : 0.8323774337768555 time for calcul the mask position with numpy : 0.026614904403686523 nb_pixel_total : 87110 time to create 1 rle with old method : 0.10756802558898926 time for calcul the mask position with numpy : 0.02291417121887207 nb_pixel_total : 31375 time to create 1 rle with old method : 0.033911705017089844 time for calcul the mask position with numpy : 0.02271890640258789 nb_pixel_total : 13008 time to create 1 rle with old method : 0.01360940933227539 time for calcul the mask position with numpy : 0.025852441787719727 nb_pixel_total : 17744 time to create 1 rle with old method : 0.026157855987548828 time for calcul the mask position with numpy : 0.0262448787689209 nb_pixel_total : 15739 time to create 1 rle with old method : 0.022314071655273438 time for calcul the mask position with numpy : 0.024892091751098633 nb_pixel_total : 145110 time to create 1 rle with old method : 0.16958880424499512 create new chi : 2.263533353805542 time to delete rle : 0.001428365707397461 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 5294 TO DO : save crop sub photo not yet done ! save time : 0.4020390510559082 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 3.3863236904144287 time for calcul the mask position with numpy : 0.5041494369506836 nb_pixel_total : 7909552 time to create 1 rle with new method : 0.7104969024658203 time for calcul the mask position with numpy : 0.02386760711669922 nb_pixel_total : 64454 time to create 1 rle with old method : 0.06922578811645508 time for calcul the mask position with numpy : 0.023551464080810547 nb_pixel_total : 15400 time to create 1 rle with old method : 0.016631603240966797 time for calcul the mask position with numpy : 0.024881362915039062 nb_pixel_total : 9721 time to create 1 rle with old method : 0.01612997055053711 time for calcul the mask position with numpy : 0.02676987648010254 nb_pixel_total : 89283 time to create 1 rle with old method : 0.1003427505493164 time for calcul the mask position with numpy : 0.024177074432373047 nb_pixel_total : 112470 time to create 1 rle with old method : 0.1218264102935791 time for calcul the mask position with numpy : 0.03503894805908203 nb_pixel_total : 72043 time to create 1 rle with old method : 0.07483911514282227 time for calcul the mask position with numpy : 0.023738861083984375 nb_pixel_total : 21477 time to create 1 rle with old method : 0.023077964782714844 create new chi : 1.8616459369659424 time to delete rle : 0.00087738037109375 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 5828 TO DO : save crop sub photo not yet done ! save time : 0.4156830310821533 map_output_result : {1402504725: (0.0, 'Should be the crop_list due to order', 0), 1402504723: (0.0, 'Should be the crop_list due to order', 0), 1402504679: (0.0, 'Should be the crop_list due to order', 0), 1402504674: (0.0, 'Should be the crop_list due to order', 0), 1402504666: (0.0, 'Should be the crop_list due to order', 0), 1402504661: (0.0, 'Should be the crop_list due to order', 0), 1402504659: (0.0, 'Should be the crop_list due to order', 0), 1402504655: (0.0, 'Should be the crop_list due to order', 0), 1402504605: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1402504725, 1402504723, 1402504679, 1402504674, 1402504666, 1402504661, 1402504659, 1402504655, 1402504605] Looping around the photos to save general results len do output : 9 /1402504725.Didn't retrieve data . /1402504723.Didn't retrieve data . /1402504679.Didn't retrieve data . /1402504674.Didn't retrieve data . /1402504666.Didn't retrieve data . /1402504661.Didn't retrieve data . /1402504659.Didn't retrieve data . /1402504655.Didn't retrieve data . /1402504605.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504725', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504723', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504679', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504674', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504666', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504661', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504659', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504655', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504605', None, None, None, None, None, '4311814') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.022182941436767578 save_final save missing photos in datou_result : time spend for datou_step_exec : 78.83404970169067 time spend to save output : 0.02258896827697754 total time spend for step 3 : 78.85663866996765 step4:ventilate_hashtags_in_portfolio Mon Jan 5 10:13:53 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 29953694 get user id for portfolio 29953694 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29953694 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','background','carton','pehd','autre','environnement','pet_fonce','mal_croppe','papier','flou','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29953694 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','background','carton','pehd','autre','environnement','pet_fonce','mal_croppe','papier','flou','metal')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29953694 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','background','carton','pehd','autre','environnement','pet_fonce','mal_croppe','papier','flou','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/29954164,29954165,29954166,29954167,29954168,29954169,29954170,29954171,29954172,29954173,29954174?tags=pet_clair,background,carton,pehd,autre,environnement,pet_fonce,mal_croppe,papier,flou,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1402504725, 1402504723, 1402504679, 1402504674, 1402504666, 1402504661, 1402504659, 1402504655, 1402504605] Looping around the photos to save general results len do output : 1 /29953694. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504725', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504723', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504679', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504674', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504666', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504661', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504659', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504655', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504605', None, None, None, None, None, '4311814') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.01645493507385254 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.026390552520752 time spend to save output : 0.016703367233276367 total time spend for step 4 : 2.0430939197540283 step5:final Mon Jan 5 10:13:55 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1402504725: ('0.07113508980624142',), 1402504723: ('0.07113508980624142',), 1402504679: ('0.07113508980624142',), 1402504674: ('0.07113508980624142',), 1402504666: ('0.07113508980624142',), 1402504661: ('0.07113508980624142',), 1402504659: ('0.07113508980624142',), 1402504655: ('0.07113508980624142',), 1402504605: ('0.07113508980624142',)} new output for save of step final : {1402504725: ('0.07113508980624142',), 1402504723: ('0.07113508980624142',), 1402504679: ('0.07113508980624142',), 1402504674: ('0.07113508980624142',), 1402504666: ('0.07113508980624142',), 1402504661: ('0.07113508980624142',), 1402504659: ('0.07113508980624142',), 1402504655: ('0.07113508980624142',), 1402504605: ('0.07113508980624142',)} [1402504725, 1402504723, 1402504679, 1402504674, 1402504666, 1402504661, 1402504659, 1402504655, 1402504605] Looping around the photos to save general results len do output : 9 /1402504725.Didn't retrieve data . /1402504723.Didn't retrieve data . /1402504679.Didn't retrieve data . /1402504674.Didn't retrieve data . /1402504666.Didn't retrieve data . /1402504661.Didn't retrieve data . /1402504659.Didn't retrieve data . /1402504655.Didn't retrieve data . /1402504605.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504725', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504723', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504679', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504674', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504666', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504661', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504659', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504655', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504605', None, None, None, None, None, '4311814') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.014671087265014648 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1372973918914795 time spend to save output : 0.015234231948852539 total time spend for step 5 : 0.15253162384033203 step6:blur_detection Mon Jan 5 10:13:55 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5.jpg resize: (2160, 3840) 1402504725 -6.28208614387206 treat image : temp/1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff.jpg resize: (2160, 3840) 1402504723 -6.3999773702018885 treat image : temp/1767604230_2856028_1402504679_855b3b9f28897492745f9b86d30ada50.jpg resize: (2160, 3840) 1402504679 -7.051856042999046 treat image : temp/1767604230_2856028_1402504674_caed35f5ed6908736f675a53335b4d53.jpg resize: (2160, 3840) 1402504674 -7.141757548168626 treat image : temp/1767604230_2856028_1402504666_e636df319ce29fbd439fe9f2796bc02a.jpg resize: (2160, 3840) 1402504666 -6.886247149495311 treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489.jpg resize: (2160, 3840) 1402504661 -7.268935220163669 treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e.jpg resize: (2160, 3840) 1402504659 -7.0080866727654865 treat image : temp/1767604230_2856028_1402504655_7533da09781f9782900fb4a6e2dcaad0.jpg resize: (2160, 3840) 1402504655 -7.154635819125109 treat image : temp/1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a.jpg resize: (2160, 3840) 1402504605 -6.865929131209757 treat image : temp/1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822513_0.png resize: (657, 497) 1402509911 -4.715354434425799 treat image : temp/1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822514_0.png resize: (318, 613) 1402509912 -3.7214449025738348 treat image : temp/1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822515_0.png resize: (342, 240) 1402509913 -3.5339085500096044 treat image : temp/1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822518_0.png resize: (292, 332) 1402509914 -4.0688167355443055 treat image : temp/1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822519_0.png resize: (330, 326) 1402509915 -4.826511343429323 treat image : temp/1767604230_2856028_1402504679_855b3b9f28897492745f9b86d30ada50_rle_crop_4090822522_0.png resize: (173, 187) 1402509916 -3.8078226566818385 treat image : temp/1767604230_2856028_1402504679_855b3b9f28897492745f9b86d30ada50_rle_crop_4090822523_0.png resize: (585, 552) 1402509917 -4.521266829922297 treat image : temp/1767604230_2856028_1402504679_855b3b9f28897492745f9b86d30ada50_rle_crop_4090822524_0.png resize: (208, 205) 1402509918 -3.865501106488593 treat image : temp/1767604230_2856028_1402504679_855b3b9f28897492745f9b86d30ada50_rle_crop_4090822525_0.png resize: (227, 322) 1402509919 -5.160059909957642 treat image : temp/1767604230_2856028_1402504679_855b3b9f28897492745f9b86d30ada50_rle_crop_4090822527_0.png resize: (319, 274) 1402509920 -4.9415819932208676 treat image : temp/1767604230_2856028_1402504674_caed35f5ed6908736f675a53335b4d53_rle_crop_4090822529_0.png resize: (354, 166) 1402509921 -3.907087293752859 treat image : temp/1767604230_2856028_1402504674_caed35f5ed6908736f675a53335b4d53_rle_crop_4090822530_0.png resize: (298, 371) 1402509922 -4.078365092655401 treat image : temp/1767604230_2856028_1402504674_caed35f5ed6908736f675a53335b4d53_rle_crop_4090822532_0.png resize: (266, 267) 1402509923 -5.42464294263418 treat image : temp/1767604230_2856028_1402504674_caed35f5ed6908736f675a53335b4d53_rle_crop_4090822533_0.png resize: (119, 151) 1402509924 -3.965447115376602 treat image : temp/1767604230_2856028_1402504666_e636df319ce29fbd439fe9f2796bc02a_rle_crop_4090822534_0.png resize: (112, 170) 1402509925 -3.6875914063373227 treat image : temp/1767604230_2856028_1402504666_e636df319ce29fbd439fe9f2796bc02a_rle_crop_4090822535_0.png resize: (263, 162) 1402509926 -4.471920460751665 treat image : temp/1767604230_2856028_1402504666_e636df319ce29fbd439fe9f2796bc02a_rle_crop_4090822536_0.png resize: (341, 454) 1402509927 -5.1855263556501265 treat image : temp/1767604230_2856028_1402504666_e636df319ce29fbd439fe9f2796bc02a_rle_crop_4090822539_0.png resize: (537, 597) 1402509928 -5.41649872622386 treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822543_0.png resize: (351, 382) 1402509929 -4.8557292208833855 treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822544_0.png resize: (132, 238) 1402509930 -5.430172116489229 treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822545_0.png resize: (334, 210) 1402509931 -2.973322579734975 treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822549_0.png resize: (179, 404) 1402509933 -4.754983355386905 treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822553_0.png resize: (292, 235) 1402509934 -4.774891398527336 treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822554_0.png resize: (268, 438) 1402509935 -5.813441746893681 treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822555_0.png resize: (524, 484) 1402509936 -4.738753605748632 treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822556_0.png resize: (274, 230) 1402509937 -5.204406567715827 treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822557_0.png resize: (218, 201) 1402509938 -2.212788950255087 treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822563_0.png resize: (245, 181) 1402509939 -3.6709821550021795 treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822566_0.png resize: (251, 106) 1402509940 -3.4198524951720852 treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822567_0.png resize: (112, 146) 1402509941 -4.368845423927191 treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822568_0.png resize: (175, 219) 1402509942 -3.701630140502727 treat image : temp/1767604230_2856028_1402504655_7533da09781f9782900fb4a6e2dcaad0_rle_crop_4090822570_0.png resize: (153, 209) 1402509943 -4.147254259252754 treat image : temp/1767604230_2856028_1402504655_7533da09781f9782900fb4a6e2dcaad0_rle_crop_4090822572_0.png resize: (204, 85) 1402509944 -3.8931676421531893 treat image : temp/1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a_rle_crop_4090822575_0.png resize: (175, 171) 1402509945 -3.251350661182779 treat image : temp/1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a_rle_crop_4090822577_0.png resize: (351, 514) 1402509946 -4.12722836944263 treat image : temp/1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a_rle_crop_4090822580_0.png resize: (237, 141) 1402509947 -2.706109467373853 treat image : temp/1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a_rle_crop_4090822581_0.png resize: (291, 263) 1402509949 -3.596549895947895 treat image : temp/1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822512_0.png resize: (656, 756) 1402509961 -2.4698422757479612 treat image : temp/1767604230_2856028_1402504666_e636df319ce29fbd439fe9f2796bc02a_rle_crop_4090822537_0.png resize: (325, 141) 1402509962 -3.1759343531805255 treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822540_0.png resize: (206, 174) 1402509963 -3.139547271934585 treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822548_0.png resize: (100, 214) 1402509964 -3.5680676665184055 treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822561_0.png resize: (96, 254) 1402509965 -3.2214111332145867 treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822562_0.png resize: (224, 192) 1402509966 -5.096453226808417 treat image : temp/1767604230_2856028_1402504655_7533da09781f9782900fb4a6e2dcaad0_rle_crop_4090822573_0.png resize: (313, 150) 1402509967 -4.226484585907373 treat image : temp/1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a_rle_crop_4090822576_0.png resize: (248, 414) 1402509968 -3.5542712754716734 treat image : temp/1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822507_0.png resize: (143, 117) 1402509970 -5.1641454338724175 treat image : temp/1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822520_0.png resize: (228, 178) 1402509971 -4.655538575757436 treat image : temp/1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822521_0.png resize: (345, 167) 1402509972 -4.220166474316974 treat image : temp/1767604230_2856028_1402504666_e636df319ce29fbd439fe9f2796bc02a_rle_crop_4090822538_0.png resize: (130, 139) 1402509973 -4.932805696174079 treat image : temp/1767604230_2856028_1402504655_7533da09781f9782900fb4a6e2dcaad0_rle_crop_4090822571_0.png resize: (144, 148) 1402509974 -5.114970950839774 treat image : temp/1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a_rle_crop_4090822579_0.png resize: (84, 144) 1402509975 -4.331985123033034 treat image : temp/1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822505_0.png resize: (415, 527) 1402510093 -4.011754458088403 treat image : temp/1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822508_0.png resize: (503, 301) 1402510094 -5.132870670078252 treat image : temp/1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822509_0.png resize: (215, 171) 1402510096 -4.85255321673972 treat image : temp/1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822511_0.png resize: (414, 429) 1402510098 -2.486202710295493 treat image : temp/1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822516_0.png resize: (466, 296) 1402510100 -5.797991679650395 treat image : temp/1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822517_0.png resize: (410, 372) 1402510102 -4.590326844436346 treat image : temp/1767604230_2856028_1402504679_855b3b9f28897492745f9b86d30ada50_rle_crop_4090822526_0.png resize: (230, 178) 1402510104 -5.095869744565302 treat image : temp/1767604230_2856028_1402504674_caed35f5ed6908736f675a53335b4d53_rle_crop_4090822528_0.png resize: (519, 661) 1402510106 -3.7586441277359497 treat image : temp/1767604230_2856028_1402504674_caed35f5ed6908736f675a53335b4d53_rle_crop_4090822531_0.png resize: (593, 294) 1402510108 -5.253157703913722 treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822541_0.png resize: (312, 522) 1402510110 -4.549323379821822 treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822542_0.png resize: (482, 521) 1402510112 -6.137752496775431 treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822546_0.png resize: (419, 389) 1402510114 -6.114888497612992 treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822547_0.png resize: (372, 401) 1402510116 -4.886393947735981 treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822550_0.png resize: (186, 316) 1402510118 -3.9323708682892655 treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822551_0.png resize: (349, 221) 1402510120 -5.333626849991824 treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822558_0.png resize: (229, 465) 1402510122 -5.198869064338045 treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822559_0.png resize: (270, 254) 1402510124 -5.327743375048661 treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822564_0.png resize: (375, 330) 1402510126 -5.191260614522898 treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822565_0.png resize: (517, 581) 1402510128 -4.8351653795233975 treat image : temp/1767604230_2856028_1402504655_7533da09781f9782900fb4a6e2dcaad0_rle_crop_4090822569_0.png resize: (376, 563) 1402510130 -3.910529470785125 treat image : temp/1767604230_2856028_1402504655_7533da09781f9782900fb4a6e2dcaad0_rle_crop_4090822574_0.png resize: (316, 474) 1402510132 -3.4465007246716817 treat image : temp/1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822506_0.png resize: (188, 196) 1402510196 -4.196335301003413 treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822552_0.png resize: (300, 405) 1402510198 -5.01998251823047 treat image : temp/1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a_rle_crop_4090822578_0.png resize: (280, 421) 1402510200 -5.265718550043055 treat image : temp/1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822510_0.png resize: (196, 201) 1402510247 -4.485249309328182 treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822560_0.png resize: (153, 245) 1402510249 -5.538438080817253 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 86 time used for this insertion : 0.017894983291625977 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 86 time used for this insertion : 0.01720404624938965 save missing photos in datou_result : time spend for datou_step_exec : 36.053009271621704 time spend to save output : 0.040930747985839844 total time spend for step 6 : 36.093940019607544 step7:brightness Mon Jan 5 10:14:32 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5.jpg treat image : temp/1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff.jpg treat image : temp/1767604230_2856028_1402504679_855b3b9f28897492745f9b86d30ada50.jpg treat image : temp/1767604230_2856028_1402504674_caed35f5ed6908736f675a53335b4d53.jpg treat image : temp/1767604230_2856028_1402504666_e636df319ce29fbd439fe9f2796bc02a.jpg treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489.jpg treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e.jpg treat image : temp/1767604230_2856028_1402504655_7533da09781f9782900fb4a6e2dcaad0.jpg treat image : temp/1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a.jpg treat image : temp/1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822513_0.png treat image : temp/1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822514_0.png treat image : temp/1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822515_0.png treat image : temp/1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822518_0.png treat image : temp/1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822519_0.png treat image : temp/1767604230_2856028_1402504679_855b3b9f28897492745f9b86d30ada50_rle_crop_4090822522_0.png treat image : temp/1767604230_2856028_1402504679_855b3b9f28897492745f9b86d30ada50_rle_crop_4090822523_0.png treat image : temp/1767604230_2856028_1402504679_855b3b9f28897492745f9b86d30ada50_rle_crop_4090822524_0.png treat image : temp/1767604230_2856028_1402504679_855b3b9f28897492745f9b86d30ada50_rle_crop_4090822525_0.png treat image : temp/1767604230_2856028_1402504679_855b3b9f28897492745f9b86d30ada50_rle_crop_4090822527_0.png treat image : temp/1767604230_2856028_1402504674_caed35f5ed6908736f675a53335b4d53_rle_crop_4090822529_0.png treat image : temp/1767604230_2856028_1402504674_caed35f5ed6908736f675a53335b4d53_rle_crop_4090822530_0.png treat image : temp/1767604230_2856028_1402504674_caed35f5ed6908736f675a53335b4d53_rle_crop_4090822532_0.png treat image : temp/1767604230_2856028_1402504674_caed35f5ed6908736f675a53335b4d53_rle_crop_4090822533_0.png treat image : temp/1767604230_2856028_1402504666_e636df319ce29fbd439fe9f2796bc02a_rle_crop_4090822534_0.png treat image : temp/1767604230_2856028_1402504666_e636df319ce29fbd439fe9f2796bc02a_rle_crop_4090822535_0.png treat image : temp/1767604230_2856028_1402504666_e636df319ce29fbd439fe9f2796bc02a_rle_crop_4090822536_0.png treat image : temp/1767604230_2856028_1402504666_e636df319ce29fbd439fe9f2796bc02a_rle_crop_4090822539_0.png treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822543_0.png treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822544_0.png treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822545_0.png treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822549_0.png treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822553_0.png treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822554_0.png treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822555_0.png treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822556_0.png treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822557_0.png treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822563_0.png treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822566_0.png treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822567_0.png treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822568_0.png treat image : temp/1767604230_2856028_1402504655_7533da09781f9782900fb4a6e2dcaad0_rle_crop_4090822570_0.png treat image : temp/1767604230_2856028_1402504655_7533da09781f9782900fb4a6e2dcaad0_rle_crop_4090822572_0.png treat image : temp/1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a_rle_crop_4090822575_0.png treat image : temp/1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a_rle_crop_4090822577_0.png treat image : temp/1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a_rle_crop_4090822580_0.png treat image : temp/1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a_rle_crop_4090822581_0.png treat image : temp/1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822512_0.png treat image : temp/1767604230_2856028_1402504666_e636df319ce29fbd439fe9f2796bc02a_rle_crop_4090822537_0.png treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822540_0.png treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822548_0.png treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822561_0.png treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822562_0.png treat image : temp/1767604230_2856028_1402504655_7533da09781f9782900fb4a6e2dcaad0_rle_crop_4090822573_0.png treat image : temp/1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a_rle_crop_4090822576_0.png treat image : temp/1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822507_0.png treat image : temp/1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822520_0.png treat image : temp/1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822521_0.png treat image : temp/1767604230_2856028_1402504666_e636df319ce29fbd439fe9f2796bc02a_rle_crop_4090822538_0.png treat image : temp/1767604230_2856028_1402504655_7533da09781f9782900fb4a6e2dcaad0_rle_crop_4090822571_0.png treat image : temp/1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a_rle_crop_4090822579_0.png treat image : temp/1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822505_0.png treat image : temp/1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822508_0.png treat image : temp/1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822509_0.png treat image : temp/1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822511_0.png treat image : temp/1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822516_0.png treat image : temp/1767604230_2856028_1402504723_9a9ec22405c509cd05cec2ad8f448fff_rle_crop_4090822517_0.png treat image : temp/1767604230_2856028_1402504679_855b3b9f28897492745f9b86d30ada50_rle_crop_4090822526_0.png treat image : temp/1767604230_2856028_1402504674_caed35f5ed6908736f675a53335b4d53_rle_crop_4090822528_0.png treat image : temp/1767604230_2856028_1402504674_caed35f5ed6908736f675a53335b4d53_rle_crop_4090822531_0.png treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822541_0.png treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822542_0.png treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822546_0.png treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822547_0.png treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822550_0.png treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822551_0.png treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822558_0.png treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822559_0.png treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822564_0.png treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822565_0.png treat image : temp/1767604230_2856028_1402504655_7533da09781f9782900fb4a6e2dcaad0_rle_crop_4090822569_0.png treat image : temp/1767604230_2856028_1402504655_7533da09781f9782900fb4a6e2dcaad0_rle_crop_4090822574_0.png treat image : temp/1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822506_0.png treat image : temp/1767604230_2856028_1402504661_5307e83c0b8f7f1c7add69c631979489_rle_crop_4090822552_0.png treat image : temp/1767604230_2856028_1402504605_ad720202acfb234202d15588603fe16a_rle_crop_4090822578_0.png treat image : temp/1767604230_2856028_1402504725_46c38860686fb9e337167145163938b5_rle_crop_4090822510_0.png treat image : temp/1767604230_2856028_1402504659_e16833903be40de3ad47bbfe403aa37e_rle_crop_4090822560_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 86 time used for this insertion : 0.020642995834350586 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 86 time used for this insertion : 0.018975496292114258 save missing photos in datou_result : time spend for datou_step_exec : 8.575055360794067 time spend to save output : 0.045972585678100586 total time spend for step 7 : 8.621027946472168 step8:velours_tree Mon Jan 5 10:14:40 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.1114351749420166 time spend to save output : 4.9114227294921875e-05 total time spend for step 8 : 0.11148428916931152 step9:send_mail_cod Mon Jan 5 10:14:40 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P29953694_05-01-2026_10_14_40.pdf 29954164 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette299541641767604480 29954165 imagette299541651767604482 29954166 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette299541661767604482 29954167 imagette299541671767604483 29954168 change filename to text .change filename to text .change filename to text .imagette299541681767604483 29954170 change filename to text .change filename to text .imagette299541701767604484 29954171 imagette299541711767604484 29954172 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette299541721767604484 29954173 imagette299541731767604486 29954174 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette299541741767604486 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=29953694 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/29954164,29954165,29954166,29954167,29954168,29954169,29954170,29954171,29954172,29954173,29954174?tags=pet_clair,background,carton,pehd,autre,environnement,pet_fonce,mal_croppe,papier,flou,metal your option no_mail is active, we will not send the real mail to your client args[1402504725] : ((1402504725, -6.28208614387206, 492609224), (1402504725, -0.48180691517285845, 501862349), '0.07113508980624142') We are sending mail with results at report@fotonower.com args[1402504723] : ((1402504723, -6.3999773702018885, 492609224), (1402504723, -0.20548982087965695, 496442774), '0.07113508980624142') We are sending mail with results at report@fotonower.com args[1402504679] : ((1402504679, -7.051856042999046, 492609224), (1402504679, -0.07367810472794886, 496442774), '0.07113508980624142') We are sending mail with results at report@fotonower.com args[1402504674] : ((1402504674, -7.141757548168626, 492609224), (1402504674, -0.03987035436831779, 2107752395), '0.07113508980624142') We are sending mail with results at report@fotonower.com args[1402504666] : ((1402504666, -6.886247149495311, 492609224), (1402504666, -0.2352656028253394, 496442774), '0.07113508980624142') We are sending mail with results at report@fotonower.com args[1402504661] : ((1402504661, -7.268935220163669, 492609224), (1402504661, -0.1994311859308897, 496442774), '0.07113508980624142') We are sending mail with results at report@fotonower.com args[1402504659] : ((1402504659, -7.0080866727654865, 492609224), (1402504659, -0.12233504875792316, 496442774), '0.07113508980624142') We are sending mail with results at report@fotonower.com args[1402504655] : ((1402504655, -7.154635819125109, 492609224), (1402504655, -0.15077471440337037, 496442774), '0.07113508980624142') We are sending mail with results at report@fotonower.com args[1402504605] : ((1402504605, -6.865929131209757, 492609224), (1402504605, -0.2827511222540007, 496442774), '0.07113508980624142') We are sending mail with results at report@fotonower.com refus_total : 0.07113508980624142 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=29953694 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29953694_05-01-2026_10_14_40.pdf results_Auto_P29953694_05-01-2026_10_14_40.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29953694_05-01-2026_10_14_40.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','29953694','results_Auto_P29953694_05-01-2026_10_14_40.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29953694_05-01-2026_10_14_40.pdf','pdf','','0.8','0.07113508980624142') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1402504725, 1402504723, 1402504679, 1402504674, 1402504666, 1402504661, 1402504659, 1402504655, 1402504605] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504725', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504723', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504679', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504674', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504666', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504661', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504659', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504655', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504605', None, None, None, None, None, '4311814') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.018230915069580078 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.088379383087158 time spend to save output : 0.018410205841064453 total time spend for step 9 : 8.106789588928223 step10:split_time_score Mon Jan 5 10:14:48 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('09', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 05012026 29953694 Nombre de photos uploadées : 9 / 23040 (0%) 05012026 29953694 Nombre de photos taguées (types de déchets): 0 / 9 (0%) 05012026 29953694 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 1.1920928955078125e-06 elapsed_time : order_list_meta_photo_and_scores 4.5299530029296875e-06 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.0004799365997314453 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.24231266975402832 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.07113508980624142 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29953694_05-01-2026_10_14_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29953694 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29953694 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'05012026': {'nb_upload': 9, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1402504725, 1402504723, 1402504679, 1402504674, 1402504666, 1402504661, 1402504659, 1402504655, 1402504605] Looping around the photos to save general results len do output : 1 /29953694Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504725', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504723', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504679', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504674', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504666', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504661', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504659', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504655', None, None, None, None, None, '4311814') ('3318', None, None, None, None, None, None, None, '4311814') ('3318', '29953694', '1402504605', None, None, None, None, None, '4311814') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.016510009765625 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.5337610244750977 time spend to save output : 0.01675701141357422 total time spend for step 10 : 0.5505180358886719 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 114.40user 115.04system 4:23.89elapsed 86%CPU (0avgtext+0avgdata 4416980maxresident)k 728144inputs+121736outputs (8923major+10381702minor)pagefaults 0swaps