python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1637598 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4295398'] with mtr_portfolio_ids : ['29855330'] and first list_photo_ids : [] new path : /proc/1637598/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 13 ; length of list_pids : 13 ; length of list_args : 13 time to download the photos : 2.807391405105591 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Dec 31 12:40:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10605 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-12-31 12:40:35.395689: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-12-31 12:40:35.426579: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-12-31 12:40:35.429184: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f8ae4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-12-31 12:40:35.429252: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-12-31 12:40:35.434918: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-12-31 12:40:35.700378: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2afcde00 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-12-31 12:40:35.700440: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-12-31 12:40:35.702419: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-31 12:40:35.703562: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-31 12:40:35.708503: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-31 12:40:35.728749: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-31 12:40:35.730909: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-31 12:40:35.765167: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-31 12:40:35.770371: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-31 12:40:35.826681: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-31 12:40:35.829146: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-31 12:40:35.829744: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-31 12:40:35.831358: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-31 12:40:35.831388: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-31 12:40:35.831402: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-31 12:40:35.834454: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9826 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-12-31 12:40:36.204268: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-31 12:40:36.204358: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-31 12:40:36.204379: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-31 12:40:36.204399: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-31 12:40:36.204417: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-31 12:40:36.204434: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-31 12:40:36.204452: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-31 12:40:36.204470: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-31 12:40:36.206037: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-31 12:40:36.207440: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-31 12:40:36.207483: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-31 12:40:36.207505: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-31 12:40:36.207525: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-31 12:40:36.207545: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-31 12:40:36.207564: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-31 12:40:36.207584: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-31 12:40:36.207603: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-31 12:40:36.209162: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-31 12:40:36.209193: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-31 12:40:36.209203: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-31 12:40:36.209213: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-31 12:40:36.210836: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9826 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-12-31 12:40:50.395775: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-31 12:40:50.705910: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 Detection mask done ! Trying to reset tf kernel 1638241 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 27 tf kernel not reseted sub process len(results) : 13 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 13 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5316 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [180, 2526, 324, 2766] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017244815826416016 nb_pixel_total : 13070 time to create 1 rle with old method : 0.017300128936767578 length of segment : 112 DEBUG bbox = [1824, 2010, 1902, 2142] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00032401084899902344 nb_pixel_total : 7049 time to create 1 rle with old method : 0.008110523223876953 length of segment : 66 DEBUG bbox = [1368, 1236, 1632, 1554] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001934051513671875 nb_pixel_total : 55500 time to create 1 rle with old method : 0.06399774551391602 length of segment : 253 DEBUG bbox = [48, 2982, 528, 3234] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017387866973876953 nb_pixel_total : 68712 time to create 1 rle with old method : 0.07626104354858398 length of segment : 465 DEBUG bbox = [1872, 2118, 2148, 2454] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014846324920654297 nb_pixel_total : 25074 time to create 1 rle with old method : 0.028795480728149414 length of segment : 387 DEBUG bbox = [42, 1206, 336, 1752] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0023262500762939453 nb_pixel_total : 94910 time to create 1 rle with old method : 0.11309623718261719 length of segment : 275 DEBUG bbox = [12, 2580, 354, 3072] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017809867858886719 nb_pixel_total : 98218 time to create 1 rle with old method : 0.10719871520996094 length of segment : 318 DEBUG bbox = [378, 1578, 684, 1782] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006906986236572266 nb_pixel_total : 36847 time to create 1 rle with old method : 0.043749332427978516 length of segment : 293 DEBUG bbox = [96, 2766, 732, 3234] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002400636672973633 nb_pixel_total : 104213 time to create 1 rle with old method : 0.11480307579040527 length of segment : 866 DEBUG bbox = [1446, 2322, 1680, 2460] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005564689636230469 nb_pixel_total : 19199 time to create 1 rle with old method : 0.02419567108154297 length of segment : 208 DEBUG bbox = [696, 1464, 1152, 1944] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0028536319732666016 nb_pixel_total : 144450 time to create 1 rle with old method : 0.15996241569519043 length of segment : 467 DEBUG bbox = [444, 2058, 666, 2232] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004947185516357422 nb_pixel_total : 21044 time to create 1 rle with old method : 0.024209260940551758 length of segment : 181 DEBUG bbox = [1164, 720, 1542, 1038] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012927055358886719 nb_pixel_total : 66600 time to create 1 rle with old method : 0.07605171203613281 length of segment : 347 DEBUG bbox = [84, 1380, 774, 1938] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.006442070007324219 nb_pixel_total : 186598 time to create 1 rle with new method : 0.018472909927368164 length of segment : 576 DEBUG bbox = [660, 1596, 798, 1746] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00034928321838378906 nb_pixel_total : 12630 time to create 1 rle with old method : 0.013843297958374023 length of segment : 126 DEBUG bbox = [108, 2946, 462, 3186] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008885860443115234 nb_pixel_total : 34750 time to create 1 rle with old method : 0.037932634353637695 length of segment : 325 DEBUG bbox = [168, 942, 432, 1398] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010924339294433594 nb_pixel_total : 47108 time to create 1 rle with old method : 0.05222272872924805 length of segment : 245 DEBUG bbox = [426, 2820, 738, 3132] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001153707504272461 nb_pixel_total : 74705 time to create 1 rle with old method : 0.0873103141784668 length of segment : 318 DEBUG bbox = [780, 684, 996, 822] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007717609405517578 nb_pixel_total : 21850 time to create 1 rle with old method : 0.02359485626220703 length of segment : 215 DEBUG bbox = [2046, 2208, 2160, 2352] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00022554397583007812 nb_pixel_total : 11651 time to create 1 rle with old method : 0.01281595230102539 length of segment : 102 DEBUG bbox = [1134, 1014, 1512, 1464] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0031647682189941406 nb_pixel_total : 88943 time to create 1 rle with old method : 0.09236454963684082 length of segment : 381 DEBUG bbox = [90, 1608, 312, 1938] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001489400863647461 nb_pixel_total : 45434 time to create 1 rle with old method : 0.04793119430541992 length of segment : 180 DEBUG bbox = [1776, 2340, 2034, 2664] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016489028930664062 nb_pixel_total : 43703 time to create 1 rle with old method : 0.04621291160583496 length of segment : 243 DEBUG bbox = [1842, 1734, 2112, 1968] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014045238494873047 nb_pixel_total : 38265 time to create 1 rle with old method : 0.0397181510925293 length of segment : 250 DEBUG bbox = [762, 336, 960, 498] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008397102355957031 nb_pixel_total : 22448 time to create 1 rle with old method : 0.023709535598754883 length of segment : 187 DEBUG bbox = [582, 1302, 1152, 1686] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003920793533325195 nb_pixel_total : 128029 time to create 1 rle with old method : 0.13788652420043945 length of segment : 550 DEBUG bbox = [1704, 1590, 2148, 2022] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002915620803833008 nb_pixel_total : 109875 time to create 1 rle with old method : 0.11793255805969238 length of segment : 405 DEBUG bbox = [1608, 1092, 2070, 1446] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0028543472290039062 nb_pixel_total : 94374 time to create 1 rle with old method : 0.1088266372680664 length of segment : 400 DEBUG bbox = [1224, 2088, 1446, 2202] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007412433624267578 nb_pixel_total : 10005 time to create 1 rle with old method : 0.011533260345458984 length of segment : 177 DEBUG bbox = [792, 1818, 1092, 2298] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002449512481689453 nb_pixel_total : 90832 time to create 1 rle with old method : 0.10741162300109863 length of segment : 248 DEBUG bbox = [492, 2910, 708, 3192] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011043548583984375 nb_pixel_total : 43655 time to create 1 rle with old method : 0.05366921424865723 length of segment : 302 DEBUG bbox = [1602, 702, 2052, 1134] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0024030208587646484 nb_pixel_total : 126069 time to create 1 rle with old method : 0.14088153839111328 length of segment : 422 DEBUG bbox = [756, 2184, 1620, 2898] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.019032955169677734 nb_pixel_total : 319420 time to create 1 rle with new method : 0.03197360038757324 length of segment : 741 DEBUG bbox = [768, 1416, 1104, 1884] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003343343734741211 nb_pixel_total : 88323 time to create 1 rle with old method : 0.09957337379455566 length of segment : 309 DEBUG bbox = [18, 1542, 222, 1746] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001046895980834961 nb_pixel_total : 19010 time to create 1 rle with old method : 0.021624326705932617 length of segment : 252 DEBUG bbox = [390, 2562, 618, 2778] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012483596801757812 nb_pixel_total : 33916 time to create 1 rle with old method : 0.040196895599365234 length of segment : 231 DEBUG bbox = [444, 3006, 870, 3396] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003435850143432617 nb_pixel_total : 101728 time to create 1 rle with old method : 0.11143803596496582 length of segment : 391 DEBUG bbox = [522, 2460, 774, 2688] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012309551239013672 nb_pixel_total : 37680 time to create 1 rle with old method : 0.05697941780090332 length of segment : 231 DEBUG bbox = [1902, 456, 2148, 762] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016603469848632812 nb_pixel_total : 49219 time to create 1 rle with old method : 0.05329561233520508 length of segment : 245 DEBUG bbox = [318, 1656, 780, 1800] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018095970153808594 nb_pixel_total : 36730 time to create 1 rle with old method : 0.04088711738586426 length of segment : 398 DEBUG bbox = [774, 2388, 1050, 2718] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0021691322326660156 nb_pixel_total : 59586 time to create 1 rle with old method : 0.06598114967346191 length of segment : 242 DEBUG bbox = [1350, 414, 1596, 600] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011544227600097656 nb_pixel_total : 32114 time to create 1 rle with old method : 0.035153865814208984 length of segment : 227 DEBUG bbox = [420, 2502, 990, 3342] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00954294204711914 nb_pixel_total : 181512 time to create 1 rle with new method : 0.020165681838989258 length of segment : 486 DEBUG bbox = [12, 2268, 384, 2754] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0032863616943359375 nb_pixel_total : 58680 time to create 1 rle with old method : 0.06985616683959961 length of segment : 374 DEBUG bbox = [1194, 1086, 1488, 1608] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002936124801635742 nb_pixel_total : 41482 time to create 1 rle with old method : 0.04847979545593262 length of segment : 314 DEBUG bbox = [1026, 2772, 1242, 2982] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012164115905761719 nb_pixel_total : 29044 time to create 1 rle with old method : 0.03373885154724121 length of segment : 196 DEBUG bbox = [246, 384, 540, 492] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011432170867919922 nb_pixel_total : 15720 time to create 1 rle with old method : 0.01839900016784668 length of segment : 300 DEBUG bbox = [300, 522, 528, 810] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014801025390625 nb_pixel_total : 31733 time to create 1 rle with old method : 0.0378422737121582 length of segment : 289 DEBUG bbox = [300, 162, 846, 486] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0038712024688720703 nb_pixel_total : 88444 time to create 1 rle with old method : 0.1005563735961914 length of segment : 513 DEBUG bbox = [264, 3132, 786, 3372] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0031015872955322266 nb_pixel_total : 83274 time to create 1 rle with old method : 0.09267091751098633 length of segment : 504 DEBUG bbox = [1284, 1110, 1494, 1332] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012102127075195312 nb_pixel_total : 24296 time to create 1 rle with old method : 0.028102874755859375 length of segment : 192 DEBUG bbox = [1524, 1614, 1818, 1968] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0021059513092041016 nb_pixel_total : 49243 time to create 1 rle with old method : 0.06164908409118652 length of segment : 268 DEBUG bbox = [1758, 876, 2148, 1584] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004012584686279297 nb_pixel_total : 104226 time to create 1 rle with old method : 0.11540985107421875 length of segment : 561 DEBUG bbox = [0, 660, 168, 774] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005419254302978516 nb_pixel_total : 15153 time to create 1 rle with old method : 0.017133712768554688 length of segment : 158 DEBUG bbox = [216, 1626, 468, 1932] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001394033432006836 nb_pixel_total : 34758 time to create 1 rle with old method : 0.03947734832763672 length of segment : 211 DEBUG bbox = [18, 258, 222, 450] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008351802825927734 nb_pixel_total : 20682 time to create 1 rle with old method : 0.030843734741210938 length of segment : 197 DEBUG bbox = [324, 6, 2154, 546] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0458071231842041 nb_pixel_total : 387605 time to create 1 rle with new method : 0.05404782295227051 length of segment : 1629 DEBUG bbox = [600, 2958, 840, 3066] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006177425384521484 nb_pixel_total : 19618 time to create 1 rle with old method : 0.021433353424072266 length of segment : 238 DEBUG bbox = [1950, 576, 2154, 858] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009148120880126953 nb_pixel_total : 42665 time to create 1 rle with old method : 0.04819154739379883 length of segment : 198 DEBUG bbox = [606, 1962, 918, 2208] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010297298431396484 nb_pixel_total : 30650 time to create 1 rle with old method : 0.034035444259643555 length of segment : 291 DEBUG bbox = [1962, 2520, 2148, 2922] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009632110595703125 nb_pixel_total : 34885 time to create 1 rle with old method : 0.040732383728027344 length of segment : 177 DEBUG bbox = [150, 618, 372, 792] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006692409515380859 nb_pixel_total : 22633 time to create 1 rle with old method : 0.02575826644897461 length of segment : 220 DEBUG bbox = [2076, 1194, 2154, 1386] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00027441978454589844 nb_pixel_total : 10452 time to create 1 rle with old method : 0.011858940124511719 length of segment : 75 DEBUG bbox = [132, 696, 354, 1206] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014600753784179688 nb_pixel_total : 53638 time to create 1 rle with old method : 0.06116437911987305 length of segment : 181 DEBUG bbox = [138, 3198, 402, 3474] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011513233184814453 nb_pixel_total : 46256 time to create 1 rle with old method : 0.04998636245727539 length of segment : 257 DEBUG bbox = [1992, 1410, 2142, 1584] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004813671112060547 nb_pixel_total : 16517 time to create 1 rle with old method : 0.019362211227416992 length of segment : 145 DEBUG bbox = [6, 402, 90, 522] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00025725364685058594 nb_pixel_total : 6336 time to create 1 rle with old method : 0.007355690002441406 length of segment : 77 DEBUG bbox = [198, 54, 834, 504] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004114627838134766 nb_pixel_total : 176263 time to create 1 rle with new method : 0.006134033203125 length of segment : 607 DEBUG bbox = [432, 1302, 738, 1572] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013828277587890625 nb_pixel_total : 50018 time to create 1 rle with old method : 0.05557990074157715 length of segment : 292 DEBUG bbox = [180, 2142, 450, 2514] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014927387237548828 nb_pixel_total : 61458 time to create 1 rle with old method : 0.06810641288757324 length of segment : 237 DEBUG bbox = [252, 1734, 510, 1980] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009508132934570312 nb_pixel_total : 31633 time to create 1 rle with old method : 0.035176992416381836 length of segment : 219 DEBUG bbox = [1044, 2496, 1230, 2718] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007240772247314453 nb_pixel_total : 19667 time to create 1 rle with old method : 0.022586822509765625 length of segment : 184 DEBUG bbox = [156, 3180, 444, 3330] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009944438934326172 nb_pixel_total : 30944 time to create 1 rle with old method : 0.03407430648803711 length of segment : 259 DEBUG bbox = [564, 2388, 1122, 3036] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.005050182342529297 nb_pixel_total : 197661 time to create 1 rle with new method : 0.008926630020141602 length of segment : 524 DEBUG bbox = [1962, 630, 2142, 840] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008080005645751953 nb_pixel_total : 30378 time to create 1 rle with old method : 0.03385114669799805 length of segment : 176 DEBUG bbox = [198, 2670, 414, 2982] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011909008026123047 nb_pixel_total : 41858 time to create 1 rle with old method : 0.0483250617980957 length of segment : 190 DEBUG bbox = [1746, 2562, 1878, 2694] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00041031837463378906 nb_pixel_total : 10718 time to create 1 rle with old method : 0.012083768844604492 length of segment : 126 DEBUG bbox = [1770, 1842, 2028, 1944] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006988048553466797 nb_pixel_total : 16456 time to create 1 rle with old method : 0.018175840377807617 length of segment : 256 DEBUG bbox = [198, 2214, 468, 2430] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010628700256347656 nb_pixel_total : 39569 time to create 1 rle with old method : 0.043886661529541016 length of segment : 258 DEBUG bbox = [12, 1644, 120, 1800] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00041294097900390625 nb_pixel_total : 12492 time to create 1 rle with old method : 0.014174461364746094 length of segment : 99 DEBUG bbox = [1908, 1650, 2100, 1752] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005295276641845703 nb_pixel_total : 12946 time to create 1 rle with old method : 0.014189481735229492 length of segment : 184 DEBUG bbox = [642, 1566, 828, 1800] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008795261383056641 nb_pixel_total : 23933 time to create 1 rle with old method : 0.027350902557373047 length of segment : 184 DEBUG bbox = [1866, 1164, 2154, 1578] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0019698143005371094 nb_pixel_total : 74528 time to create 1 rle with old method : 0.08103752136230469 length of segment : 324 DEBUG bbox = [282, 2424, 720, 2814] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002944469451904297 nb_pixel_total : 108599 time to create 1 rle with old method : 0.1180870532989502 length of segment : 408 DEBUG bbox = [1530, 2706, 1824, 3030] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00183868408203125 nb_pixel_total : 53785 time to create 1 rle with old method : 0.06069016456604004 length of segment : 272 DEBUG bbox = [972, 1560, 1230, 2076] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018734931945800781 nb_pixel_total : 77896 time to create 1 rle with old method : 0.08977174758911133 length of segment : 285 DEBUG bbox = [396, 666, 546, 810] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00045752525329589844 nb_pixel_total : 15415 time to create 1 rle with old method : 0.017581701278686523 length of segment : 140 DEBUG bbox = [60, 192, 486, 474] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018677711486816406 nb_pixel_total : 94238 time to create 1 rle with old method : 0.10621356964111328 length of segment : 401 DEBUG bbox = [522, 2994, 708, 3126] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005433559417724609 nb_pixel_total : 19653 time to create 1 rle with old method : 0.022374868392944336 length of segment : 187 DEBUG bbox = [6, 1680, 84, 1812] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002532005310058594 nb_pixel_total : 7575 time to create 1 rle with old method : 0.009879112243652344 length of segment : 75 DEBUG bbox = [312, 186, 726, 522] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015652179718017578 nb_pixel_total : 87079 time to create 1 rle with old method : 0.0991203784942627 length of segment : 385 time spent for convertir_results : 9.731160163879395 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 91 chid ids of type : 3594 Number RLEs to save : 27480 save missing photos in datou_result : time spend for datou_step_exec : 84.1962878704071 time spend to save output : 1.8386306762695312 total time spend for step 1 : 86.03491854667664 step2:crop_condition Wed Dec 31 12:41:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 13 ! batch 1 Loaded 91 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 39 About to insert : list_path_to_insert length 39 new photo from crops ! About to upload 39 photos upload in portfolio : 3736932 init cache_photo without model_param we have 39 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767181331_1637598 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853862_bca224d85cdaedfc975f2aa8d76cd316_rle_crop_4086881296_0.png', 0, 121, 65, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853862_bca224d85cdaedfc975f2aa8d76cd316_rle_crop_4086881299_0.png', 0, 329, 231, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853860_3d172cbec8b0e5f6fb44ba6b86f87f35_rle_crop_4086881302_0.png', 0, 194, 293, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853857_ac022c42a17c171bfa6115e956a4d04c_rle_crop_4086881304_0.png', 0, 130, 207, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853857_ac022c42a17c171bfa6115e956a4d04c_rle_crop_4086881306_0.png', 0, 172, 217, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853857_ac022c42a17c171bfa6115e956a4d04c_rle_crop_4086881307_0.png', 0, 303, 319, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881309_0.png', 0, 139, 126, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881314_0.png', 0, 142, 102, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881317_0.png', 0, 315, 226, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881318_0.png', 0, 231, 250, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881320_0.png', 0, 368, 547, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b_rle_crop_4086881323_0.png', 0, 88, 177, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b_rle_crop_4086881327_0.png', 0, 692, 741, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881330_0.png', 0, 212, 227, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881331_0.png', 0, 376, 391, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881333_0.png', 0, 290, 242, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881334_0.png', 0, 141, 397, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853828_a660c3d19a3de3cbe7862726451770af_rle_crop_4086881338_0.png', 0, 454, 294, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853828_a660c3d19a3de3cbe7862726451770af_rle_crop_4086881339_0.png', 0, 485, 271, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853828_a660c3d19a3de3cbe7862726451770af_rle_crop_4086881340_0.png', 0, 194, 191, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853828_a660c3d19a3de3cbe7862726451770af_rle_crop_4086881341_0.png', 0, 94, 273, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853828_a660c3d19a3de3cbe7862726451770af_rle_crop_4086881342_0.png', 0, 286, 221, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881343_0.png', 0, 301, 501, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881345_0.png', 0, 217, 188, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881346_0.png', 0, 330, 265, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881351_0.png', 0, 514, 1599, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853821_b17d02186f779504189d67d5020ce5f0_rle_crop_4086881353_0.png', 0, 269, 198, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853821_b17d02186f779504189d67d5020ce5f0_rle_crop_4086881354_0.png', 0, 216, 291, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853821_b17d02186f779504189d67d5020ce5f0_rle_crop_4086881355_0.png', 0, 375, 174, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853821_b17d02186f779504189d67d5020ce5f0_rle_crop_4086881356_0.png', 0, 170, 220, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853821_b17d02186f779504189d67d5020ce5f0_rle_crop_4086881357_0.png', 0, 185, 75, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881360_0.png', 0, 157, 143, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881362_0.png', 0, 430, 605, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881366_0.png', 0, 206, 184, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881368_0.png', 0, 601, 524, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881369_0.png', 0, 207, 170, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881372_0.png', 0, 96, 237, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853740_c09a9a971912f50aae2eb85c3af3f534_rle_crop_4086881375_0.png', 0, 87, 184, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181338), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853738_bd7c153c2c01e75b579ad6f25febf3f5_rle_crop_4086881380_0.png', 0, 500, 238, 0, 1767181338,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 39 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.29762601852417 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 17 About to insert : list_path_to_insert length 17 new photo from crops ! About to upload 17 photos upload in portfolio : 3736932 init cache_photo without model_param we have 17 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767181346_1637598 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181349), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853862_bca224d85cdaedfc975f2aa8d76cd316_rle_crop_4086881295_0.png', 0, 175, 112, 0, 1767181349,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181349), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853860_3d172cbec8b0e5f6fb44ba6b86f87f35_rle_crop_4086881301_0.png', 0, 455, 312, 0, 1767181349,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181349), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853860_3d172cbec8b0e5f6fb44ba6b86f87f35_rle_crop_4086881303_0.png', 0, 332, 576, 0, 1767181349,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181349), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881310_0.png', 0, 221, 323, 0, 1767181349,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181349), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881311_0.png', 0, 418, 220, 0, 1767181349,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181349), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881313_0.png', 0, 129, 215, 0, 1767181349,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181349), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881319_0.png', 0, 155, 186, 0, 1767181349,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181349), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881332_0.png', 0, 224, 231, 0, 1767181349,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181349), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881350_0.png', 0, 176, 197, 0, 1767181349,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181349), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853821_b17d02186f779504189d67d5020ce5f0_rle_crop_4086881352_0.png', 0, 107, 238, 0, 1767181349,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181349), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881367_0.png', 0, 144, 259, 0, 1767181349,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181349), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881370_0.png', 0, 287, 189, 0, 1767181349,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181349), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881373_0.png', 0, 190, 258, 0, 1767181349,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181349), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853740_c09a9a971912f50aae2eb85c3af3f534_rle_crop_4086881376_0.png', 0, 215, 183, 0, 1767181349,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181349), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853740_c09a9a971912f50aae2eb85c3af3f534_rle_crop_4086881378_0.png', 0, 343, 388, 0, 1767181349,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181349), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853738_bd7c153c2c01e75b579ad6f25febf3f5_rle_crop_4086881381_0.png', 0, 131, 140, 0, 1767181349,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181349), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853738_bd7c153c2c01e75b579ad6f25febf3f5_rle_crop_4086881383_0.png', 0, 123, 185, 0, 1767181349,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 17 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.1382975578308105 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767181353_1637598 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181354), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853862_bca224d85cdaedfc975f2aa8d76cd316_rle_crop_4086881297_0.png', 0, 302, 251, 0, 1767181354,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181354), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b_rle_crop_4086881325_0.png', 0, 278, 210, 0, 1767181354,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181354), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881336_0.png', 0, 174, 225, 0, 1767181354,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1592180728912354 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 29 About to insert : list_path_to_insert length 29 new photo from crops ! About to upload 29 photos upload in portfolio : 3736932 init cache_photo without model_param we have 29 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767181366_1637598 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853862_bca224d85cdaedfc975f2aa8d76cd316_rle_crop_4086881298_0.png', 0, 226, 461, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853860_3d172cbec8b0e5f6fb44ba6b86f87f35_rle_crop_4086881300_0.png', 0, 462, 254, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853857_ac022c42a17c171bfa6115e956a4d04c_rle_crop_4086881305_0.png', 0, 452, 421, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853857_ac022c42a17c171bfa6115e956a4d04c_rle_crop_4086881308_0.png', 0, 522, 572, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881312_0.png', 0, 304, 305, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881315_0.png', 0, 376, 358, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881316_0.png', 0, 318, 175, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b_rle_crop_4086881321_0.png', 0, 374, 399, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b_rle_crop_4086881322_0.png', 0, 308, 397, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b_rle_crop_4086881324_0.png', 0, 476, 221, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b_rle_crop_4086881326_0.png', 0, 375, 422, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881328_0.png', 0, 443, 279, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881329_0.png', 0, 193, 185, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881335_0.png', 0, 287, 242, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881344_0.png', 0, 235, 452, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881347_0.png', 0, 612, 344, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881348_0.png', 0, 112, 158, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881349_0.png', 0, 240, 211, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881358_0.png', 0, 454, 163, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881359_0.png', 0, 262, 257, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881361_0.png', 0, 113, 73, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881363_0.png', 0, 248, 292, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881364_0.png', 0, 341, 237, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881365_0.png', 0, 221, 194, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881374_0.png', 0, 156, 99, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853740_c09a9a971912f50aae2eb85c3af3f534_rle_crop_4086881377_0.png', 0, 384, 274, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853738_bd7c153c2c01e75b579ad6f25febf3f5_rle_crop_4086881382_0.png', 0, 277, 399, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853738_bd7c153c2c01e75b579ad6f25febf3f5_rle_crop_4086881384_0.png', 0, 129, 74, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181371), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853738_bd7c153c2c01e75b579ad6f25febf3f5_rle_crop_4086881385_0.png', 0, 311, 379, 0, 1767181371,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 29 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.240661382675171 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767181375_1637598 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181375), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881371_0.png', 0, 108, 125, 0, 1767181375,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181375), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853740_c09a9a971912f50aae2eb85c3af3f534_rle_crop_4086881379_0.png', 0, 301, 254, 0, 1767181375,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.964693546295166 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767181378_1637598 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767181379), 0.0, 0.0, 14, '', 0, 0, '1767181228_1637598_1401853828_a660c3d19a3de3cbe7862726451770af_rle_crop_4086881337_0.png', 0, 685, 468, 0, 1767181379,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6052119731903076 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1401853862, 1401853860, 1401853857, 1401853836, 1401853832, 1401853830, 1401853828, 1401853825, 1401853821, 1401853758, 1401853752, 1401853740, 1401853738] Looping around the photos to save general results len do output : 91 /1401882327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401882442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853862', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853860', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853857', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853836', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853832', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853830', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853828', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853825', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853821', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853758', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853752', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853740', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853738', None, None, None, None, None, '4295398') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 286 time used for this insertion : 0.04719877243041992 save_final save missing photos in datou_result : time spend for datou_step_exec : 61.649821043014526 time spend to save output : 0.05085325241088867 total time spend for step 2 : 61.700674295425415 step3:rle_unique_nms_with_priority Wed Dec 31 12:42:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 91 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 5 nb_hashtags : 4 time to prepare the origin masks : 3.8804898262023926 time for calcul the mask position with numpy : 1.2144029140472412 nb_pixel_total : 8124995 time to create 1 rle with new method : 1.0308244228363037 time for calcul the mask position with numpy : 0.03082871437072754 nb_pixel_total : 25074 time to create 1 rle with old method : 0.027272939682006836 time for calcul the mask position with numpy : 0.025594234466552734 nb_pixel_total : 68712 time to create 1 rle with old method : 0.07600116729736328 time for calcul the mask position with numpy : 0.028630733489990234 nb_pixel_total : 55500 time to create 1 rle with old method : 0.05898475646972656 time for calcul the mask position with numpy : 0.025961637496948242 nb_pixel_total : 7049 time to create 1 rle with old method : 0.007741689682006836 time for calcul the mask position with numpy : 0.024702072143554688 nb_pixel_total : 13070 time to create 1 rle with old method : 0.014312505722045898 create new chi : 2.6066410541534424 time to delete rle : 0.021440505981445312 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 4726 TO DO : save crop sub photo not yet done ! save time : 0.35036182403564453 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 3.189455270767212 time for calcul the mask position with numpy : 0.6433827877044678 nb_pixel_total : 7968187 time to create 1 rle with new method : 0.5984899997711182 time for calcul the mask position with numpy : 0.032473087310791016 nb_pixel_total : 96238 time to create 1 rle with old method : 0.1080477237701416 time for calcul the mask position with numpy : 0.026699542999267578 nb_pixel_total : 36847 time to create 1 rle with old method : 0.04207491874694824 time for calcul the mask position with numpy : 0.026454925537109375 nb_pixel_total : 98218 time to create 1 rle with old method : 0.10920310020446777 time for calcul the mask position with numpy : 0.026735305786132812 nb_pixel_total : 94910 time to create 1 rle with old method : 0.10605764389038086 create new chi : 1.7701153755187988 time to delete rle : 0.000865936279296875 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 5386 TO DO : save crop sub photo not yet done ! save time : 0.38289427757263184 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 3.9903767108917236 time for calcul the mask position with numpy : 0.4534032344818115 nb_pixel_total : 7856509 time to create 1 rle with new method : 0.45060086250305176 time for calcul the mask position with numpy : 0.027946949005126953 nb_pixel_total : 186598 time to create 1 rle with new method : 0.6176207065582275 time for calcul the mask position with numpy : 0.02752518653869629 nb_pixel_total : 66600 time to create 1 rle with old method : 0.07445788383483887 time for calcul the mask position with numpy : 0.029291868209838867 nb_pixel_total : 21044 time to create 1 rle with old method : 0.023374557495117188 time for calcul the mask position with numpy : 0.027261734008789062 nb_pixel_total : 144450 time to create 1 rle with old method : 0.1568899154663086 time for calcul the mask position with numpy : 0.024944782257080078 nb_pixel_total : 19199 time to create 1 rle with old method : 0.020809412002563477 create new chi : 2.015471935272217 time to delete rle : 0.0008893013000488281 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 5718 TO DO : save crop sub photo not yet done ! save time : 0.4211568832397461 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 7.605201959609985 time for calcul the mask position with numpy : 0.7148969173431396 nb_pixel_total : 7724884 time to create 1 rle with new method : 1.1716439723968506 time for calcul the mask position with numpy : 0.03201723098754883 nb_pixel_total : 128029 time to create 1 rle with old method : 0.1410517692565918 time for calcul the mask position with numpy : 0.02588057518005371 nb_pixel_total : 22448 time to create 1 rle with old method : 0.02544999122619629 time for calcul the mask position with numpy : 0.02700495719909668 nb_pixel_total : 38265 time to create 1 rle with old method : 0.06168484687805176 time for calcul the mask position with numpy : 0.028493642807006836 nb_pixel_total : 43703 time to create 1 rle with old method : 0.04786252975463867 time for calcul the mask position with numpy : 0.027594804763793945 nb_pixel_total : 45434 time to create 1 rle with old method : 0.05076766014099121 time for calcul the mask position with numpy : 0.029181957244873047 nb_pixel_total : 88943 time to create 1 rle with old method : 0.1085505485534668 time for calcul the mask position with numpy : 0.028634309768676758 nb_pixel_total : 11651 time to create 1 rle with old method : 0.013025760650634766 time for calcul the mask position with numpy : 0.02962207794189453 nb_pixel_total : 21850 time to create 1 rle with old method : 0.024562597274780273 time for calcul the mask position with numpy : 0.027623891830444336 nb_pixel_total : 74705 time to create 1 rle with old method : 0.08371472358703613 time for calcul the mask position with numpy : 0.028124570846557617 nb_pixel_total : 47108 time to create 1 rle with old method : 0.054144859313964844 time for calcul the mask position with numpy : 0.02537083625793457 nb_pixel_total : 34750 time to create 1 rle with old method : 0.03768301010131836 time for calcul the mask position with numpy : 0.026070117950439453 nb_pixel_total : 12630 time to create 1 rle with old method : 0.014164924621582031 create new chi : 2.9332408905029297 time to delete rle : 0.001293182373046875 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++Number RLEs to save : 8404 TO DO : save crop sub photo not yet done ! save time : 0.569751501083374 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 3.5308523178100586 time for calcul the mask position with numpy : 1.0031442642211914 nb_pixel_total : 7500170 time to create 1 rle with new method : 1.2464871406555176 time for calcul the mask position with numpy : 0.025821208953857422 nb_pixel_total : 319420 time to create 1 rle with new method : 0.7675745487213135 time for calcul the mask position with numpy : 0.02522587776184082 nb_pixel_total : 126069 time to create 1 rle with old method : 0.1345963478088379 time for calcul the mask position with numpy : 0.02670598030090332 nb_pixel_total : 43655 time to create 1 rle with old method : 0.0470271110534668 time for calcul the mask position with numpy : 0.025444507598876953 nb_pixel_total : 90832 time to create 1 rle with old method : 0.09829473495483398 time for calcul the mask position with numpy : 0.02489495277404785 nb_pixel_total : 10005 time to create 1 rle with old method : 0.010432958602905273 time for calcul the mask position with numpy : 0.024984359741210938 nb_pixel_total : 94374 time to create 1 rle with old method : 0.09903216361999512 time for calcul the mask position with numpy : 0.026039838790893555 nb_pixel_total : 109875 time to create 1 rle with old method : 0.11792898178100586 create new chi : 3.7748494148254395 time to delete rle : 0.0010302066802978516 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 7550 TO DO : save crop sub photo not yet done ! save time : 0.5374245643615723 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 5.95607328414917 time for calcul the mask position with numpy : 0.6919903755187988 nb_pixel_total : 7836094 time to create 1 rle with new method : 1.517695665359497 time for calcul the mask position with numpy : 0.028107881546020508 nb_pixel_total : 32114 time to create 1 rle with old method : 0.03571176528930664 time for calcul the mask position with numpy : 0.023744821548461914 nb_pixel_total : 59586 time to create 1 rle with old method : 0.06815123558044434 time for calcul the mask position with numpy : 0.027009010314941406 nb_pixel_total : 36730 time to create 1 rle with old method : 0.053214073181152344 time for calcul the mask position with numpy : 0.04501485824584961 nb_pixel_total : 49219 time to create 1 rle with old method : 0.05957150459289551 time for calcul the mask position with numpy : 0.02826547622680664 nb_pixel_total : 37680 time to create 1 rle with old method : 0.042017459869384766 time for calcul the mask position with numpy : 0.02496790885925293 nb_pixel_total : 101728 time to create 1 rle with old method : 0.11528229713439941 time for calcul the mask position with numpy : 0.030260324478149414 nb_pixel_total : 33916 time to create 1 rle with old method : 0.04267573356628418 time for calcul the mask position with numpy : 0.028604745864868164 nb_pixel_total : 19010 time to create 1 rle with old method : 0.021381378173828125 time for calcul the mask position with numpy : 0.02710580825805664 nb_pixel_total : 88323 time to create 1 rle with old method : 0.0985264778137207 create new chi : 3.057706832885742 time to delete rle : 0.0011050701141357422 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++Number RLEs to save : 7212 TO DO : save crop sub photo not yet done ! save time : 0.5065038204193115 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 3.89599871635437 time for calcul the mask position with numpy : 0.8135275840759277 nb_pixel_total : 7936229 time to create 1 rle with new method : 0.9896321296691895 time for calcul the mask position with numpy : 0.025499343872070312 nb_pixel_total : 31733 time to create 1 rle with old method : 0.03589797019958496 time for calcul the mask position with numpy : 0.02492213249206543 nb_pixel_total : 15720 time to create 1 rle with old method : 0.017610788345336914 time for calcul the mask position with numpy : 0.024941682815551758 nb_pixel_total : 29044 time to create 1 rle with old method : 0.03240156173706055 time for calcul the mask position with numpy : 0.02935028076171875 nb_pixel_total : 41482 time to create 1 rle with old method : 0.04688620567321777 time for calcul the mask position with numpy : 0.02651190757751465 nb_pixel_total : 58680 time to create 1 rle with old method : 0.06683516502380371 time for calcul the mask position with numpy : 0.027054309844970703 nb_pixel_total : 181512 time to create 1 rle with new method : 0.7303552627563477 create new chi : 2.970533609390259 time to delete rle : 0.0009286403656005859 batch 1 Loaded 13 chid ids of type : 3594 ++++++++++Number RLEs to save : 6078 TO DO : save crop sub photo not yet done ! save time : 0.446582555770874 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 4.628386974334717 time for calcul the mask position with numpy : 0.6723568439483643 nb_pixel_total : 7486719 time to create 1 rle with new method : 0.8476047515869141 time for calcul the mask position with numpy : 0.02835369110107422 nb_pixel_total : 387605 time to create 1 rle with new method : 1.205063819885254 time for calcul the mask position with numpy : 0.029667377471923828 nb_pixel_total : 20682 time to create 1 rle with old method : 0.02321791648864746 time for calcul the mask position with numpy : 0.026953935623168945 nb_pixel_total : 34758 time to create 1 rle with old method : 0.05555081367492676 time for calcul the mask position with numpy : 0.026912927627563477 nb_pixel_total : 15153 time to create 1 rle with old method : 0.017121076583862305 time for calcul the mask position with numpy : 0.02906036376953125 nb_pixel_total : 104226 time to create 1 rle with old method : 0.1152346134185791 time for calcul the mask position with numpy : 0.02599954605102539 nb_pixel_total : 49243 time to create 1 rle with old method : 0.0545344352722168 time for calcul the mask position with numpy : 0.025952577590942383 nb_pixel_total : 24296 time to create 1 rle with old method : 0.026915311813354492 time for calcul the mask position with numpy : 0.026918888092041016 nb_pixel_total : 83274 time to create 1 rle with old method : 0.09203791618347168 time for calcul the mask position with numpy : 0.026108980178833008 nb_pixel_total : 88444 time to create 1 rle with old method : 0.09762692451477051 create new chi : 3.529428005218506 time to delete rle : 0.0016481876373291016 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++++Number RLEs to save : 10626 TO DO : save crop sub photo not yet done ! save time : 0.7294068336486816 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 3.6829304695129395 time for calcul the mask position with numpy : 0.6159954071044922 nb_pixel_total : 8133497 time to create 1 rle with new method : 0.6174767017364502 time for calcul the mask position with numpy : 0.026767730712890625 nb_pixel_total : 10452 time to create 1 rle with old method : 0.01190185546875 time for calcul the mask position with numpy : 0.026220321655273438 nb_pixel_total : 22633 time to create 1 rle with old method : 0.02519369125366211 time for calcul the mask position with numpy : 0.026021957397460938 nb_pixel_total : 34885 time to create 1 rle with old method : 0.04906868934631348 time for calcul the mask position with numpy : 0.030557632446289062 nb_pixel_total : 30650 time to create 1 rle with old method : 0.045185089111328125 time for calcul the mask position with numpy : 0.026090383529663086 nb_pixel_total : 42665 time to create 1 rle with old method : 0.053769826889038086 time for calcul the mask position with numpy : 0.036940813064575195 nb_pixel_total : 19618 time to create 1 rle with old method : 0.029764175415039062 create new chi : 1.6721582412719727 time to delete rle : 0.0009484291076660156 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 4558 TO DO : save crop sub photo not yet done ! save time : 0.36107444763183594 nb_obj : 9 nb_hashtags : 2 time to prepare the origin masks : 4.1678466796875 time for calcul the mask position with numpy : 0.5990383625030518 nb_pixel_total : 7832614 time to create 1 rle with new method : 1.8952789306640625 time for calcul the mask position with numpy : 0.026369810104370117 nb_pixel_total : 19667 time to create 1 rle with old method : 0.025418519973754883 time for calcul the mask position with numpy : 0.026984453201293945 nb_pixel_total : 31633 time to create 1 rle with old method : 0.03585529327392578 time for calcul the mask position with numpy : 0.02547311782836914 nb_pixel_total : 61458 time to create 1 rle with old method : 0.07038164138793945 time for calcul the mask position with numpy : 0.03456735610961914 nb_pixel_total : 50018 time to create 1 rle with old method : 0.05587482452392578 time for calcul the mask position with numpy : 0.04336380958557129 nb_pixel_total : 176263 time to create 1 rle with new method : 0.6612567901611328 time for calcul the mask position with numpy : 0.04030299186706543 nb_pixel_total : 6336 time to create 1 rle with old method : 0.007180929183959961 time for calcul the mask position with numpy : 0.04127192497253418 nb_pixel_total : 16517 time to create 1 rle with old method : 0.019041776657104492 time for calcul the mask position with numpy : 0.043511152267456055 nb_pixel_total : 46256 time to create 1 rle with old method : 0.054825782775878906 time for calcul the mask position with numpy : 0.04073667526245117 nb_pixel_total : 53638 time to create 1 rle with old method : 0.05977272987365723 create new chi : 3.9071693420410156 time to delete rle : 0.0012121200561523438 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 6558 TO DO : save crop sub photo not yet done ! save time : 0.4546546936035156 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 4.581357717514038 time for calcul the mask position with numpy : 0.6425979137420654 nb_pixel_total : 7914324 time to create 1 rle with new method : 0.9148132801055908 time for calcul the mask position with numpy : 0.03207993507385254 nb_pixel_total : 12492 time to create 1 rle with old method : 0.013645410537719727 time for calcul the mask position with numpy : 0.041765689849853516 nb_pixel_total : 39569 time to create 1 rle with old method : 0.050507545471191406 time for calcul the mask position with numpy : 0.04099464416503906 nb_pixel_total : 16456 time to create 1 rle with old method : 0.01839590072631836 time for calcul the mask position with numpy : 0.042197465896606445 nb_pixel_total : 10718 time to create 1 rle with old method : 0.012177467346191406 time for calcul the mask position with numpy : 0.03804278373718262 nb_pixel_total : 41858 time to create 1 rle with old method : 0.04681229591369629 time for calcul the mask position with numpy : 0.024553298950195312 nb_pixel_total : 30378 time to create 1 rle with old method : 0.03370547294616699 time for calcul the mask position with numpy : 0.027861356735229492 nb_pixel_total : 197661 time to create 1 rle with new method : 0.7404744625091553 time for calcul the mask position with numpy : 0.02564859390258789 nb_pixel_total : 30944 time to create 1 rle with old method : 0.03470969200134277 create new chi : 2.851492166519165 time to delete rle : 0.0010483264923095703 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 5936 TO DO : save crop sub photo not yet done ! save time : 0.41193461418151855 nb_obj : 5 nb_hashtags : 4 time to prepare the origin masks : 4.168375253677368 time for calcul the mask position with numpy : 0.6985909938812256 nb_pixel_total : 8020609 time to create 1 rle with new method : 0.7624866962432861 time for calcul the mask position with numpy : 0.04256916046142578 nb_pixel_total : 53785 time to create 1 rle with old method : 0.06022357940673828 time for calcul the mask position with numpy : 0.041590213775634766 nb_pixel_total : 108599 time to create 1 rle with old method : 0.12119626998901367 time for calcul the mask position with numpy : 0.04071235656738281 nb_pixel_total : 74528 time to create 1 rle with old method : 0.08231902122497559 time for calcul the mask position with numpy : 0.03489041328430176 nb_pixel_total : 23933 time to create 1 rle with old method : 0.026729106903076172 time for calcul the mask position with numpy : 0.024339914321899414 nb_pixel_total : 12946 time to create 1 rle with old method : 0.014586687088012695 create new chi : 2.0031661987304688 time to delete rle : 0.0007810592651367188 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 4904 TO DO : save crop sub photo not yet done ! save time : 0.3743772506713867 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 3.962630271911621 time for calcul the mask position with numpy : 0.6658408641815186 nb_pixel_total : 7995646 time to create 1 rle with new method : 0.5649373531341553 time for calcul the mask position with numpy : 0.02472662925720215 nb_pixel_total : 83977 time to create 1 rle with old method : 0.09310698509216309 time for calcul the mask position with numpy : 0.0263824462890625 nb_pixel_total : 7575 time to create 1 rle with old method : 0.008509635925292969 time for calcul the mask position with numpy : 0.02454662322998047 nb_pixel_total : 19653 time to create 1 rle with old method : 0.022191524505615234 time for calcul the mask position with numpy : 0.02569103240966797 nb_pixel_total : 94238 time to create 1 rle with old method : 0.10510921478271484 time for calcul the mask position with numpy : 0.027735471725463867 nb_pixel_total : 15415 time to create 1 rle with old method : 0.024892807006835938 time for calcul the mask position with numpy : 0.02639150619506836 nb_pixel_total : 77896 time to create 1 rle with old method : 0.08833694458007812 create new chi : 1.7747228145599365 time to delete rle : 0.0010676383972167969 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5035 TO DO : save crop sub photo not yet done ! save time : 0.36300063133239746 map_output_result : {1401853862: (0.0, 'Should be the crop_list due to order', 0), 1401853860: (0.0, 'Should be the crop_list due to order', 0), 1401853857: (0.0, 'Should be the crop_list due to order', 0), 1401853836: (0.0, 'Should be the crop_list due to order', 0), 1401853832: (0.0, 'Should be the crop_list due to order', 0), 1401853830: (0.0, 'Should be the crop_list due to order', 0), 1401853828: (0.0, 'Should be the crop_list due to order', 0), 1401853825: (0.0, 'Should be the crop_list due to order', 0), 1401853821: (0.0, 'Should be the crop_list due to order', 0), 1401853758: (0.0, 'Should be the crop_list due to order', 0), 1401853752: (0.0, 'Should be the crop_list due to order', 0), 1401853740: (0.0, 'Should be the crop_list due to order', 0), 1401853738: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1401853862, 1401853860, 1401853857, 1401853836, 1401853832, 1401853830, 1401853828, 1401853825, 1401853821, 1401853758, 1401853752, 1401853740, 1401853738] Looping around the photos to save general results len do output : 13 /1401853862.Didn't retrieve data . /1401853860.Didn't retrieve data . /1401853857.Didn't retrieve data . /1401853836.Didn't retrieve data . /1401853832.Didn't retrieve data . /1401853830.Didn't retrieve data . /1401853828.Didn't retrieve data . /1401853825.Didn't retrieve data . /1401853821.Didn't retrieve data . /1401853758.Didn't retrieve data . /1401853752.Didn't retrieve data . /1401853740.Didn't retrieve data . /1401853738.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853862', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853860', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853857', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853836', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853832', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853830', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853828', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853825', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853821', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853758', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853752', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853740', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853738', None, None, None, None, None, '4295398') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.017573118209838867 save_final save missing photos in datou_result : time spend for datou_step_exec : 99.90518999099731 time spend to save output : 0.019248008728027344 total time spend for step 3 : 99.92443799972534 step4:ventilate_hashtags_in_portfolio Wed Dec 31 12:44:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 29855330 get user id for portfolio 29855330 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29855330 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','pet_clair','mal_croppe','flou','background','autre','papier','metal','environnement','carton','pehd')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29855330 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','pet_clair','mal_croppe','flou','background','autre','papier','metal','environnement','carton','pehd')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29855330 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','pet_clair','mal_croppe','flou','background','autre','papier','metal','environnement','carton','pehd')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/29855509,29855510,29855511,29855512,29855513,29855514,29855515,29855516,29855517,29855518,29855519?tags=pet_fonce,pet_clair,mal_croppe,flou,background,autre,papier,metal,environnement,carton,pehd Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1401853862, 1401853860, 1401853857, 1401853836, 1401853832, 1401853830, 1401853828, 1401853825, 1401853821, 1401853758, 1401853752, 1401853740, 1401853738] Looping around the photos to save general results len do output : 1 /29855330. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853862', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853860', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853857', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853836', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853832', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853830', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853828', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853825', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853821', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853758', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853752', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853740', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853738', None, None, None, None, None, '4295398') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.01831841468811035 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.0142924785614014 time spend to save output : 0.01888871192932129 total time spend for step 4 : 2.0331811904907227 step5:final Wed Dec 31 12:44:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1401853862: ('0.050977146768162396',), 1401853860: ('0.050977146768162396',), 1401853857: ('0.050977146768162396',), 1401853836: ('0.050977146768162396',), 1401853832: ('0.050977146768162396',), 1401853830: ('0.050977146768162396',), 1401853828: ('0.050977146768162396',), 1401853825: ('0.050977146768162396',), 1401853821: ('0.050977146768162396',), 1401853758: ('0.050977146768162396',), 1401853752: ('0.050977146768162396',), 1401853740: ('0.050977146768162396',), 1401853738: ('0.050977146768162396',)} new output for save of step final : {1401853862: ('0.050977146768162396',), 1401853860: ('0.050977146768162396',), 1401853857: ('0.050977146768162396',), 1401853836: ('0.050977146768162396',), 1401853832: ('0.050977146768162396',), 1401853830: ('0.050977146768162396',), 1401853828: ('0.050977146768162396',), 1401853825: ('0.050977146768162396',), 1401853821: ('0.050977146768162396',), 1401853758: ('0.050977146768162396',), 1401853752: ('0.050977146768162396',), 1401853740: ('0.050977146768162396',), 1401853738: ('0.050977146768162396',)} [1401853862, 1401853860, 1401853857, 1401853836, 1401853832, 1401853830, 1401853828, 1401853825, 1401853821, 1401853758, 1401853752, 1401853740, 1401853738] Looping around the photos to save general results len do output : 13 /1401853862.Didn't retrieve data . /1401853860.Didn't retrieve data . /1401853857.Didn't retrieve data . /1401853836.Didn't retrieve data . /1401853832.Didn't retrieve data . /1401853830.Didn't retrieve data . /1401853828.Didn't retrieve data . /1401853825.Didn't retrieve data . /1401853821.Didn't retrieve data . /1401853758.Didn't retrieve data . /1401853752.Didn't retrieve data . /1401853740.Didn't retrieve data . /1401853738.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853862', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853860', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853857', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853836', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853832', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853830', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853828', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853825', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853821', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853758', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853752', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853740', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853738', None, None, None, None, None, '4295398') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.01761484146118164 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.16897106170654297 time spend to save output : 0.018227338790893555 total time spend for step 5 : 0.18719840049743652 step6:blur_detection Wed Dec 31 12:44:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1767181228_1637598_1401853862_bca224d85cdaedfc975f2aa8d76cd316.jpg resize: (2160, 3840) 1401853862 -6.084780738674143 treat image : temp/1767181228_1637598_1401853860_3d172cbec8b0e5f6fb44ba6b86f87f35.jpg resize: (2160, 3840) 1401853860 -6.413827431916833 treat image : temp/1767181228_1637598_1401853857_ac022c42a17c171bfa6115e956a4d04c.jpg resize: (2160, 3840) 1401853857 -6.9496365484172555 treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055.jpg resize: (2160, 3840) 1401853836 -6.573291965025022 treat image : temp/1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b.jpg resize: (2160, 3840) 1401853832 -7.0445896327384565 treat image : temp/1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd.jpg resize: (2160, 3840) 1401853830 -6.9816050470567275 treat image : temp/1767181228_1637598_1401853828_a660c3d19a3de3cbe7862726451770af.jpg resize: (2160, 3840) 1401853828 -7.047776976565662 treat image : temp/1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f.jpg resize: (2160, 3840) 1401853825 -7.080209420995286 treat image : temp/1767181228_1637598_1401853821_b17d02186f779504189d67d5020ce5f0.jpg resize: (2160, 3840) 1401853821 -6.931298914294319 treat image : temp/1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73.jpg resize: (2160, 3840) 1401853758 -7.071650202391701 treat image : temp/1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d.jpg resize: (2160, 3840) 1401853752 -7.043306247236764 treat image : temp/1767181228_1637598_1401853740_c09a9a971912f50aae2eb85c3af3f534.jpg resize: (2160, 3840) 1401853740 -6.959314686504226 treat image : temp/1767181228_1637598_1401853738_bd7c153c2c01e75b579ad6f25febf3f5.jpg resize: (2160, 3840) 1401853738 -7.04548728996043 treat image : temp/1767181228_1637598_1401853862_bca224d85cdaedfc975f2aa8d76cd316_rle_crop_4086881296_0.png resize: (65, 121) 1401882327 -4.456925144663609 treat image : temp/1767181228_1637598_1401853862_bca224d85cdaedfc975f2aa8d76cd316_rle_crop_4086881299_0.png resize: (231, 329) 1401882328 -4.005673855879485 treat image : temp/1767181228_1637598_1401853860_3d172cbec8b0e5f6fb44ba6b86f87f35_rle_crop_4086881302_0.png resize: (293, 194) 1401882329 -3.7468988323368255 treat image : temp/1767181228_1637598_1401853857_ac022c42a17c171bfa6115e956a4d04c_rle_crop_4086881304_0.png resize: (207, 130) 1401882330 -4.460526418512521 treat image : temp/1767181228_1637598_1401853857_ac022c42a17c171bfa6115e956a4d04c_rle_crop_4086881306_0.png resize: (217, 172) 1401882331 -3.896204589486211 treat image : temp/1767181228_1637598_1401853857_ac022c42a17c171bfa6115e956a4d04c_rle_crop_4086881307_0.png resize: (319, 303) 1401882332 -4.736300194786229 treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881309_0.png resize: (126, 139) 1401882333 -3.73045416946543 treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881314_0.png resize: (102, 142) 1401882334 -5.105352854714136 treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881317_0.png resize: (226, 315) 1401882335 -4.776547796722848 treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881318_0.png resize: (250, 231) 1401882336 -4.538492368298897 treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881320_0.png resize: (547, 368) 1401882337 -3.234357513030847 treat image : temp/1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b_rle_crop_4086881323_0.png resize: (177, 88) 1401882338 -4.090460365836195 treat image : temp/1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b_rle_crop_4086881327_0.png resize: (741, 692) 1401882339 -5.254877274486311 treat image : temp/1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881330_0.png resize: (227, 212) 1401882340 -4.065511657618696 treat image : temp/1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881331_0.png resize: (391, 376) 1401882341 -4.932591577852548 treat image : temp/1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881333_0.png resize: (242, 290) 1401882342 -5.042156033228184 treat image : temp/1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881334_0.png resize: (397, 141) 1401882343 -4.177284720490764 treat image : temp/1767181228_1637598_1401853828_a660c3d19a3de3cbe7862726451770af_rle_crop_4086881338_0.png resize: (294, 454) 1401882344 -2.587578452644573 treat image : temp/1767181228_1637598_1401853828_a660c3d19a3de3cbe7862726451770af_rle_crop_4086881339_0.png resize: (271, 485) 1401882345 -4.569901878190949 treat image : temp/1767181228_1637598_1401853828_a660c3d19a3de3cbe7862726451770af_rle_crop_4086881340_0.png resize: (191, 194) 1401882346 -4.120550639819635 treat image : temp/1767181228_1637598_1401853828_a660c3d19a3de3cbe7862726451770af_rle_crop_4086881341_0.png resize: (273, 94) 1401882347 -3.5563524248252603 treat image : temp/1767181228_1637598_1401853828_a660c3d19a3de3cbe7862726451770af_rle_crop_4086881342_0.png resize: (221, 286) 1401882348 -3.644447819022197 treat image : temp/1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881343_0.png resize: (501, 301) 1401882349 -5.577014435958639 treat image : temp/1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881345_0.png resize: (188, 217) 1401882350 -4.6893853450773255 treat image : temp/1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881346_0.png resize: (265, 330) 1401882351 -4.4874830409713296 treat image : temp/1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881351_0.png resize: (1599, 514) 1401882352 -2.6058131124411306 treat image : temp/1767181228_1637598_1401853821_b17d02186f779504189d67d5020ce5f0_rle_crop_4086881353_0.png resize: (198, 269) 1401882353 -5.358925444085418 treat image : temp/1767181228_1637598_1401853821_b17d02186f779504189d67d5020ce5f0_rle_crop_4086881354_0.png resize: (291, 216) 1401882354 -4.432263696735164 treat image : temp/1767181228_1637598_1401853821_b17d02186f779504189d67d5020ce5f0_rle_crop_4086881355_0.png resize: (174, 375) 1401882355 -3.158948961002675 treat image : temp/1767181228_1637598_1401853821_b17d02186f779504189d67d5020ce5f0_rle_crop_4086881356_0.png resize: (220, 170) 1401882356 -3.60989263042516 treat image : temp/1767181228_1637598_1401853821_b17d02186f779504189d67d5020ce5f0_rle_crop_4086881357_0.png resize: (75, 185) 1401882357 -3.895768199359404 treat image : temp/1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881360_0.png resize: (143, 157) 1401882358 -4.84741218843694 treat image : temp/1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881362_0.png resize: (605, 430) 1401882359 -5.573303805832504 treat image : temp/1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881366_0.png resize: (184, 206) 1401882360 -3.8960605461649984 treat image : temp/1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881368_0.png resize: (524, 601) 1401882361 -4.301839111342778 treat image : temp/1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881369_0.png resize: (170, 207) 1401882362 -5.033011238001047 treat image : temp/1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881372_0.png resize: (237, 96) 1401882363 -4.884100209682845 treat image : temp/1767181228_1637598_1401853740_c09a9a971912f50aae2eb85c3af3f534_rle_crop_4086881375_0.png resize: (184, 87) 1401882364 -4.086799488953076 treat image : temp/1767181228_1637598_1401853738_bd7c153c2c01e75b579ad6f25febf3f5_rle_crop_4086881380_0.png resize: (238, 500) 1401882365 -5.129015890293663 treat image : temp/1767181228_1637598_1401853862_bca224d85cdaedfc975f2aa8d76cd316_rle_crop_4086881295_0.png resize: (112, 175) 1401882370 -2.160503741077959 treat image : temp/1767181228_1637598_1401853860_3d172cbec8b0e5f6fb44ba6b86f87f35_rle_crop_4086881301_0.png resize: (312, 455) 1401882371 -2.085897714370262 treat image : temp/1767181228_1637598_1401853860_3d172cbec8b0e5f6fb44ba6b86f87f35_rle_crop_4086881303_0.png resize: (576, 332) 1401882372 -4.323449247495899 treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881310_0.png resize: (323, 221) 1401882373 -3.5752584288483056 treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881311_0.png resize: (220, 418) 1401882374 -3.43378430145801 treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881313_0.png resize: (215, 129) 1401882375 -3.2551970043939757 treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881319_0.png resize: (186, 155) 1401882376 -4.013280765154666 treat image : temp/1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881332_0.png resize: (231, 224) 1401882377 -1.965730461199216 treat image : temp/1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881350_0.png resize: (197, 176) 1401882378 -3.38868793000288 treat image : temp/1767181228_1637598_1401853821_b17d02186f779504189d67d5020ce5f0_rle_crop_4086881352_0.png resize: (238, 107) 1401882379 -3.824910739940119 treat image : temp/1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881367_0.png resize: (259, 144) 1401882380 -3.60181580100418 treat image : temp/1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881370_0.png resize: (189, 287) 1401882381 -3.4732858233860786 treat image : temp/1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881373_0.png resize: (258, 190) 1401882382 -3.7668304529749808 treat image : temp/1767181228_1637598_1401853740_c09a9a971912f50aae2eb85c3af3f534_rle_crop_4086881376_0.png resize: (183, 215) 1401882383 -2.534681051413304 treat image : temp/1767181228_1637598_1401853740_c09a9a971912f50aae2eb85c3af3f534_rle_crop_4086881378_0.png resize: (388, 343) 1401882384 -4.338434252945063 treat image : temp/1767181228_1637598_1401853738_bd7c153c2c01e75b579ad6f25febf3f5_rle_crop_4086881381_0.png resize: (140, 131) 1401882385 -2.8704270501364757 treat image : temp/1767181228_1637598_1401853738_bd7c153c2c01e75b579ad6f25febf3f5_rle_crop_4086881383_0.png resize: (185, 123) 1401882386 -3.9151967852002505 treat image : temp/1767181228_1637598_1401853862_bca224d85cdaedfc975f2aa8d76cd316_rle_crop_4086881297_0.png resize: (251, 302) 1401882389 -5.279129406121409 treat image : temp/1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b_rle_crop_4086881325_0.png resize: (210, 278) 1401882390 -4.295137250470632 treat image : temp/1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881336_0.png resize: (225, 174) 1401882391 -4.951998336055284 treat image : temp/1767181228_1637598_1401853862_bca224d85cdaedfc975f2aa8d76cd316_rle_crop_4086881298_0.png resize: (461, 226) 1401882410 -4.555383953849092 treat image : temp/1767181228_1637598_1401853860_3d172cbec8b0e5f6fb44ba6b86f87f35_rle_crop_4086881300_0.png resize: (254, 462) 1401882411 -4.270113540367814 treat image : temp/1767181228_1637598_1401853857_ac022c42a17c171bfa6115e956a4d04c_rle_crop_4086881305_0.png resize: (421, 452) 1401882412 -5.302268864635122 treat image : temp/1767181228_1637598_1401853857_ac022c42a17c171bfa6115e956a4d04c_rle_crop_4086881308_0.png resize: (572, 522) 1401882413 -3.1426797079448145 treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881312_0.png resize: (305, 304) 1401882414 -4.893052763121072 treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881315_0.png resize: (358, 376) 1401882415 -4.9714317514084865 treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881316_0.png resize: (175, 318) 1401882416 -4.014016289308514 treat image : temp/1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b_rle_crop_4086881321_0.png resize: (399, 374) 1401882417 -6.032979807263227 treat image : temp/1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b_rle_crop_4086881322_0.png resize: (397, 308) 1401882418 -4.151475768046166 treat image : temp/1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b_rle_crop_4086881324_0.png resize: (221, 476) 1401882419 -5.943546901471215 treat image : temp/1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b_rle_crop_4086881326_0.png resize: (422, 375) 1401882420 -4.929697158051126 treat image : temp/1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881328_0.png resize: (279, 443) 1401882421 -5.252121681707331 treat image : temp/1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881329_0.png resize: (185, 193) 1401882422 -3.9371701406951796 treat image : temp/1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881335_0.png resize: (242, 287) 1401882423 -5.102746762367768 treat image : temp/1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881344_0.png resize: (452, 235) 1401882424 -4.511970257965752 treat image : temp/1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881347_0.png resize: (344, 612) 1401882425 -2.8322743792915555 treat image : temp/1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881348_0.png resize: (158, 112) 1401882426 -3.370511037231268 treat image : temp/1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881349_0.png resize: (211, 240) 1401882427 -3.2467111143717906 treat image : temp/1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881358_0.png resize: (163, 454) 1401882428 -4.54734885768387 treat image : temp/1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881359_0.png resize: (257, 262) 1401882429 -4.045780913563717 treat image : temp/1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881361_0.png resize: (73, 113) 1401882430 -3.973459146011653 treat image : temp/1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881363_0.png resize: (292, 248) 1401882431 -4.4867435739875825 treat image : temp/1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881364_0.png resize: (237, 341) 1401882432 -5.065434739221374 treat image : temp/1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881365_0.png resize: (194, 221) 1401882433 -4.2389445029836725 treat image : temp/1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881374_0.png resize: (99, 156) 1401882434 -3.897795192570662 treat image : temp/1767181228_1637598_1401853740_c09a9a971912f50aae2eb85c3af3f534_rle_crop_4086881377_0.png resize: (274, 384) 1401882435 -5.434920101000556 treat image : temp/1767181228_1637598_1401853738_bd7c153c2c01e75b579ad6f25febf3f5_rle_crop_4086881382_0.png resize: (399, 277) 1401882436 -5.66918059415892 treat image : temp/1767181228_1637598_1401853738_bd7c153c2c01e75b579ad6f25febf3f5_rle_crop_4086881384_0.png resize: (74, 129) 1401882437 -4.247927880214043 treat image : temp/1767181228_1637598_1401853738_bd7c153c2c01e75b579ad6f25febf3f5_rle_crop_4086881385_0.png resize: (379, 311) 1401882438 -4.871093797374498 treat image : temp/1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881371_0.png resize: (125, 108) 1401882439 -4.734132414975943 treat image : temp/1767181228_1637598_1401853740_c09a9a971912f50aae2eb85c3af3f534_rle_crop_4086881379_0.png resize: (254, 301) 1401882440 -5.976929446180216 treat image : temp/1767181228_1637598_1401853828_a660c3d19a3de3cbe7862726451770af_rle_crop_4086881337_0.png resize: (468, 685) 1401882442 -4.9041517752868975 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 104 time used for this insertion : 0.019425153732299805 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 104 time used for this insertion : 0.03516364097595215 save missing photos in datou_result : time spend for datou_step_exec : 58.24190354347229 time spend to save output : 0.06103801727294922 total time spend for step 6 : 58.30294156074524 step7:brightness Wed Dec 31 12:45:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1767181228_1637598_1401853862_bca224d85cdaedfc975f2aa8d76cd316.jpg treat image : temp/1767181228_1637598_1401853860_3d172cbec8b0e5f6fb44ba6b86f87f35.jpg treat image : temp/1767181228_1637598_1401853857_ac022c42a17c171bfa6115e956a4d04c.jpg treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055.jpg treat image : temp/1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b.jpg treat image : temp/1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd.jpg treat image : temp/1767181228_1637598_1401853828_a660c3d19a3de3cbe7862726451770af.jpg treat image : temp/1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f.jpg treat image : temp/1767181228_1637598_1401853821_b17d02186f779504189d67d5020ce5f0.jpg treat image : temp/1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73.jpg treat image : temp/1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d.jpg treat image : temp/1767181228_1637598_1401853740_c09a9a971912f50aae2eb85c3af3f534.jpg treat image : temp/1767181228_1637598_1401853738_bd7c153c2c01e75b579ad6f25febf3f5.jpg treat image : temp/1767181228_1637598_1401853862_bca224d85cdaedfc975f2aa8d76cd316_rle_crop_4086881296_0.png treat image : temp/1767181228_1637598_1401853862_bca224d85cdaedfc975f2aa8d76cd316_rle_crop_4086881299_0.png treat image : temp/1767181228_1637598_1401853860_3d172cbec8b0e5f6fb44ba6b86f87f35_rle_crop_4086881302_0.png treat image : temp/1767181228_1637598_1401853857_ac022c42a17c171bfa6115e956a4d04c_rle_crop_4086881304_0.png treat image : temp/1767181228_1637598_1401853857_ac022c42a17c171bfa6115e956a4d04c_rle_crop_4086881306_0.png treat image : temp/1767181228_1637598_1401853857_ac022c42a17c171bfa6115e956a4d04c_rle_crop_4086881307_0.png treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881309_0.png treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881314_0.png treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881317_0.png treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881318_0.png treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881320_0.png treat image : temp/1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b_rle_crop_4086881323_0.png treat image : temp/1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b_rle_crop_4086881327_0.png treat image : temp/1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881330_0.png treat image : temp/1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881331_0.png treat image : temp/1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881333_0.png treat image : temp/1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881334_0.png treat image : temp/1767181228_1637598_1401853828_a660c3d19a3de3cbe7862726451770af_rle_crop_4086881338_0.png treat image : temp/1767181228_1637598_1401853828_a660c3d19a3de3cbe7862726451770af_rle_crop_4086881339_0.png treat image : temp/1767181228_1637598_1401853828_a660c3d19a3de3cbe7862726451770af_rle_crop_4086881340_0.png treat image : temp/1767181228_1637598_1401853828_a660c3d19a3de3cbe7862726451770af_rle_crop_4086881341_0.png treat image : temp/1767181228_1637598_1401853828_a660c3d19a3de3cbe7862726451770af_rle_crop_4086881342_0.png treat image : temp/1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881343_0.png treat image : temp/1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881345_0.png treat image : temp/1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881346_0.png treat image : temp/1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881351_0.png treat image : temp/1767181228_1637598_1401853821_b17d02186f779504189d67d5020ce5f0_rle_crop_4086881353_0.png treat image : temp/1767181228_1637598_1401853821_b17d02186f779504189d67d5020ce5f0_rle_crop_4086881354_0.png treat image : temp/1767181228_1637598_1401853821_b17d02186f779504189d67d5020ce5f0_rle_crop_4086881355_0.png treat image : temp/1767181228_1637598_1401853821_b17d02186f779504189d67d5020ce5f0_rle_crop_4086881356_0.png treat image : temp/1767181228_1637598_1401853821_b17d02186f779504189d67d5020ce5f0_rle_crop_4086881357_0.png treat image : temp/1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881360_0.png treat image : temp/1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881362_0.png treat image : temp/1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881366_0.png treat image : temp/1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881368_0.png treat image : temp/1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881369_0.png treat image : temp/1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881372_0.png treat image : temp/1767181228_1637598_1401853740_c09a9a971912f50aae2eb85c3af3f534_rle_crop_4086881375_0.png treat image : temp/1767181228_1637598_1401853738_bd7c153c2c01e75b579ad6f25febf3f5_rle_crop_4086881380_0.png treat image : temp/1767181228_1637598_1401853862_bca224d85cdaedfc975f2aa8d76cd316_rle_crop_4086881295_0.png treat image : temp/1767181228_1637598_1401853860_3d172cbec8b0e5f6fb44ba6b86f87f35_rle_crop_4086881301_0.png treat image : temp/1767181228_1637598_1401853860_3d172cbec8b0e5f6fb44ba6b86f87f35_rle_crop_4086881303_0.png treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881310_0.png treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881311_0.png treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881313_0.png treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881319_0.png treat image : temp/1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881332_0.png treat image : temp/1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881350_0.png treat image : temp/1767181228_1637598_1401853821_b17d02186f779504189d67d5020ce5f0_rle_crop_4086881352_0.png treat image : temp/1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881367_0.png treat image : temp/1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881370_0.png treat image : temp/1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881373_0.png treat image : temp/1767181228_1637598_1401853740_c09a9a971912f50aae2eb85c3af3f534_rle_crop_4086881376_0.png treat image : temp/1767181228_1637598_1401853740_c09a9a971912f50aae2eb85c3af3f534_rle_crop_4086881378_0.png treat image : temp/1767181228_1637598_1401853738_bd7c153c2c01e75b579ad6f25febf3f5_rle_crop_4086881381_0.png treat image : temp/1767181228_1637598_1401853738_bd7c153c2c01e75b579ad6f25febf3f5_rle_crop_4086881383_0.png treat image : temp/1767181228_1637598_1401853862_bca224d85cdaedfc975f2aa8d76cd316_rle_crop_4086881297_0.png treat image : temp/1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b_rle_crop_4086881325_0.png treat image : temp/1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881336_0.png treat image : temp/1767181228_1637598_1401853862_bca224d85cdaedfc975f2aa8d76cd316_rle_crop_4086881298_0.png treat image : temp/1767181228_1637598_1401853860_3d172cbec8b0e5f6fb44ba6b86f87f35_rle_crop_4086881300_0.png treat image : temp/1767181228_1637598_1401853857_ac022c42a17c171bfa6115e956a4d04c_rle_crop_4086881305_0.png treat image : temp/1767181228_1637598_1401853857_ac022c42a17c171bfa6115e956a4d04c_rle_crop_4086881308_0.png treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881312_0.png treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881315_0.png treat image : temp/1767181228_1637598_1401853836_c77e25ea2035ad216e18f2dd78cd0055_rle_crop_4086881316_0.png treat image : temp/1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b_rle_crop_4086881321_0.png treat image : temp/1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b_rle_crop_4086881322_0.png treat image : temp/1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b_rle_crop_4086881324_0.png treat image : temp/1767181228_1637598_1401853832_4c0fa3bf9ce7ada398fdce24968f0e3b_rle_crop_4086881326_0.png treat image : temp/1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881328_0.png treat image : temp/1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881329_0.png treat image : temp/1767181228_1637598_1401853830_57819b6bcd135446d5e9382ab60c11cd_rle_crop_4086881335_0.png treat image : temp/1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881344_0.png treat image : temp/1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881347_0.png treat image : temp/1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881348_0.png treat image : temp/1767181228_1637598_1401853825_4d3c5c1e44e49ad47f4b158140196d0f_rle_crop_4086881349_0.png treat image : temp/1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881358_0.png treat image : temp/1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881359_0.png treat image : temp/1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881361_0.png treat image : temp/1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881363_0.png treat image : temp/1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881364_0.png treat image : temp/1767181228_1637598_1401853758_07f1ac72f366711420d81acc78be5c73_rle_crop_4086881365_0.png treat image : temp/1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881374_0.png treat image : temp/1767181228_1637598_1401853740_c09a9a971912f50aae2eb85c3af3f534_rle_crop_4086881377_0.png treat image : temp/1767181228_1637598_1401853738_bd7c153c2c01e75b579ad6f25febf3f5_rle_crop_4086881382_0.png treat image : temp/1767181228_1637598_1401853738_bd7c153c2c01e75b579ad6f25febf3f5_rle_crop_4086881384_0.png treat image : temp/1767181228_1637598_1401853738_bd7c153c2c01e75b579ad6f25febf3f5_rle_crop_4086881385_0.png treat image : temp/1767181228_1637598_1401853752_1a213ba5ae8ad737d31c9504cec66c9d_rle_crop_4086881371_0.png treat image : temp/1767181228_1637598_1401853740_c09a9a971912f50aae2eb85c3af3f534_rle_crop_4086881379_0.png treat image : temp/1767181228_1637598_1401853828_a660c3d19a3de3cbe7862726451770af_rle_crop_4086881337_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 104 time used for this insertion : 0.020151615142822266 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 104 time used for this insertion : 0.03793978691101074 save missing photos in datou_result : time spend for datou_step_exec : 16.498472929000854 time spend to save output : 0.06424331665039062 total time spend for step 7 : 16.562716245651245 step8:velours_tree Wed Dec 31 12:45:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.3431847095489502 time spend to save output : 6.29425048828125e-05 total time spend for step 8 : 0.343247652053833 step9:send_mail_cod Wed Dec 31 12:45:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P29855330_31-12-2025_12_45_56.pdf 29855509 change filename to text .imagette298555091767181556 29855510 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette298555101767181556 29855511 imagette298555111767181558 29855512 imagette298555121767181558 29855513 imagette298555131767181558 29855514 change filename to text .change filename to text .imagette298555141767181558 29855515 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette298555151767181558 29855516 change filename to text .change filename to text .change filename to text .imagette298555161767181560 29855518 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette298555181767181561 29855519 imagette298555191767181562 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=29855330 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/29855509,29855510,29855511,29855512,29855513,29855514,29855515,29855516,29855517,29855518,29855519?tags=pet_fonce,pet_clair,mal_croppe,flou,background,autre,papier,metal,environnement,carton,pehd your option no_mail is active, we will not send the real mail to your client args[1401853862] : ((1401853862, -6.084780738674143, 492609224), (1401853862, -0.5343692926227993, 501862349), '0.050977146768162396') We are sending mail with results at report@fotonower.com args[1401853860] : ((1401853860, -6.413827431916833, 492609224), (1401853860, -0.3232881423646408, 496442774), '0.050977146768162396') We are sending mail with results at report@fotonower.com args[1401853857] : ((1401853857, -6.9496365484172555, 492609224), (1401853857, -0.17981127324100643, 496442774), '0.050977146768162396') We are sending mail with results at report@fotonower.com args[1401853836] : ((1401853836, -6.573291965025022, 492609224), (1401853836, -0.31714134704209807, 496442774), '0.050977146768162396') We are sending mail with results at report@fotonower.com args[1401853832] : ((1401853832, -7.0445896327384565, 492609224), (1401853832, -0.1331052276840362, 496442774), '0.050977146768162396') We are sending mail with results at report@fotonower.com args[1401853830] : ((1401853830, -6.9816050470567275, 492609224), (1401853830, -0.16748967031523598, 496442774), '0.050977146768162396') We are sending mail with results at report@fotonower.com args[1401853828] : ((1401853828, -7.047776976565662, 492609224), (1401853828, -0.15466745716899805, 496442774), '0.050977146768162396') We are sending mail with results at report@fotonower.com args[1401853825] : ((1401853825, -7.080209420995286, 492609224), (1401853825, -0.22282022105264407, 496442774), '0.050977146768162396') We are sending mail with results at report@fotonower.com args[1401853821] : ((1401853821, -6.931298914294319, 492609224), (1401853821, -0.26997775707748467, 496442774), '0.050977146768162396') We are sending mail with results at report@fotonower.com args[1401853758] : ((1401853758, -7.071650202391701, 492609224), (1401853758, -0.2726143835496682, 496442774), '0.050977146768162396') We are sending mail with results at report@fotonower.com args[1401853752] : ((1401853752, -7.043306247236764, 492609224), (1401853752, -0.12596044632452622, 496442774), '0.050977146768162396') We are sending mail with results at report@fotonower.com args[1401853740] : ((1401853740, -6.959314686504226, 492609224), (1401853740, -0.3040012317489078, 496442774), '0.050977146768162396') We are sending mail with results at report@fotonower.com args[1401853738] : ((1401853738, -7.04548728996043, 492609224), (1401853738, -0.13532643774128256, 496442774), '0.050977146768162396') We are sending mail with results at report@fotonower.com refus_total : 0.050977146768162396 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=29855330 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29855330_31-12-2025_12_45_56.pdf results_Auto_P29855330_31-12-2025_12_45_56.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29855330_31-12-2025_12_45_56.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','29855330','results_Auto_P29855330_31-12-2025_12_45_56.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29855330_31-12-2025_12_45_56.pdf','pdf','','0.86','0.050977146768162396') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1401853862, 1401853860, 1401853857, 1401853836, 1401853832, 1401853830, 1401853828, 1401853825, 1401853821, 1401853758, 1401853752, 1401853740, 1401853738] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853862', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853860', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853857', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853836', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853832', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853830', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853828', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853825', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853821', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853758', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853752', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853740', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853738', None, None, None, None, None, '4295398') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.018849849700927734 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.389643669128418 time spend to save output : 0.01918792724609375 total time spend for step 9 : 9.408831596374512 step10:split_time_score Wed Dec 31 12:46:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('08', 13),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 31122025 29855330 Nombre de photos uploadées : 13 / 23040 (0%) 31122025 29855330 Nombre de photos taguées (types de déchets): 0 / 13 (0%) 31122025 29855330 Nombre de photos taguées (volume) : 0 / 13 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 6.9141387939453125e-06 ????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0006952285766601562 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.23526811599731445 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.032081109386441146 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29845502_31-12-2025_08_11_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29845502 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29845502 AND mptpi.`type`=3726 To do Qualite : 0.050977146768162396 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29855330_31-12-2025_12_45_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29855330 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29855330 AND mptpi.`type`=3594 To do Qualite : 0.019439177891425116 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29851835_31-12-2025_11_11_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29851835 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29851835 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'31122025': {'nb_upload': 13, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1401853862, 1401853860, 1401853857, 1401853836, 1401853832, 1401853830, 1401853828, 1401853825, 1401853821, 1401853758, 1401853752, 1401853740, 1401853738] Looping around the photos to save general results len do output : 1 /29855330Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853862', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853860', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853857', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853836', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853832', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853830', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853828', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853825', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853821', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853758', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853752', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853740', None, None, None, None, None, '4295398') ('3318', None, None, None, None, None, None, None, '4295398') ('3318', '29855330', '1401853738', None, None, None, None, None, '4295398') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.017670631408691406 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.6680912971496582 time spend to save output : 0.018006324768066406 total time spend for step 10 : 0.6860976219177246 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 13 set_done_treatment 142.80user 160.72system 5:42.29elapsed 88%CPU (0avgtext+0avgdata 5157408maxresident)k 2554536inputs+131616outputs (23241major+13522262minor)pagefaults 0swaps