python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 ~/workarea/git/Velours/python/prod/datou.py -j batch_current -C 2503008' -s traitement_3459 -M 0 -S 0 -U 100,80,95 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/home/admin/workarea/git/apy', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3633234 load datou : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 0 init_dummy_multi_datou is not linked in the step_by_step architecture ! WARNING : step 1294 init_dummy_multi_datou is not linked in the step_by_step architecture ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : (photo_id, hashtag_id, score_max) was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3459, datou_cur_ids : ['2503008'] with mtr_portfolio_ids : ['19821680'] and first list_photo_ids : [] new path : /proc/3633234/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, thcl, merge_mask_thcl_custom, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 20 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 18 ; length of list_pids : 18 ; length of list_args : 18 time to download the photos : 3.3173441886901855 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Thu Feb 6 17:08:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10288 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-06 17:08:17.902701: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-06 17:08:17.910519: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-06 17:08:17.912035: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fae40000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-06 17:08:17.912100: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-06 17:08:17.915239: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-06 17:08:18.027984: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x221fab40 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-06 17:08:18.028032: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-06 17:08:18.029525: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-06 17:08:18.029945: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-06 17:08:18.033080: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-06 17:08:18.036128: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-06 17:08:18.036648: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-06 17:08:18.039939: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-06 17:08:18.040935: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-06 17:08:18.045397: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-06 17:08:18.046835: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-06 17:08:18.046921: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-06 17:08:18.047673: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-06 17:08:18.047688: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-06 17:08:18.047697: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-06 17:08:18.049005: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-06 17:08:18.311159: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-06 17:08:18.311335: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-06 17:08:18.311365: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-06 17:08:18.311390: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-06 17:08:18.311415: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-06 17:08:18.311440: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-06 17:08:18.311464: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-06 17:08:18.311489: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-06 17:08:18.312838: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-06 17:08:18.314105: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-06 17:08:18.314144: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-06 17:08:18.314160: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-06 17:08:18.314174: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-06 17:08:18.314188: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-06 17:08:18.314202: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-06 17:08:18.314215: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-06 17:08:18.314229: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-06 17:08:18.315498: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-06 17:08:18.315541: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-06 17:08:18.315550: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-06 17:08:18.315557: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-06 17:08:18.316885: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2896 thcls : [{'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5309 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5309, 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 16384, 25088, 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 5, 10, 19, 20, 46), datetime.datetime(2021, 5, 10, 19, 20, 46)) {'thcl': {'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'carton_brun', 'carton_gris', 'cartonnette', 'kraft', 'autre_refus', 'metal', 'plastique', 'teint_dans_la_masse', 'environnement'], 'list_hashtags_csv': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'svm_hashtag_type_desc': 5309, 'photo_desc_type': 5309, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'carton_brun', 'carton_gris', 'cartonnette', 'kraft', 'autre_refus', 'metal', 'plastique', 'teint_dans_la_masse', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_convoyeur_qualipapia_nantes_poly_100521_1 NUM_CLASSES 10 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_convoyeur_qualipapia_nantes_poly_100521_1 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-06 17:08:27.462911: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-06 17:08:27.633104: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_convoyeur_qualipapia_nantes_poly_100521_1 /data/models_weight/learn_convoyeur_qualipapia_nantes_poly_100521_1/mask_model.h5 size_local : 256031040 size in s3 : 256031040 create time local : 2021-08-09 05:45:48 create time in s3 : 2021-08-06 18:59:51 mask_model.h5 already exist and didn't need to update list_images length : 18 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 16 Detection mask done ! Trying to reset tf kernel 3633557 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5485 tf kernel not reseted sub process len(results) : 18 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 18 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9520 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2896 Catched exception ! Connect or reconnect ! thcls : [{'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5309 ['background', 'carton_brun', 'carton_gris', 'cartonnette', 'kraft', 'autre_refus', 'metal', 'plastique', 'teint_dans_la_masse', 'environnement'] time for calcul the mask position with numpy : 0.0001571178436279297 nb_pixel_total : 1738 time to create 1 rle with old method : 0.0021479129791259766 length of segment : 64 time for calcul the mask position with numpy : 0.0004355907440185547 nb_pixel_total : 12580 time to create 1 rle with old method : 0.015319347381591797 length of segment : 229 time for calcul the mask position with numpy : 0.00012493133544921875 nb_pixel_total : 934 time to create 1 rle with old method : 0.0014660358428955078 length of segment : 62 time for calcul the mask position with numpy : 0.0013155937194824219 nb_pixel_total : 42766 time to create 1 rle with old method : 0.0496060848236084 length of segment : 343 time for calcul the mask position with numpy : 0.00012540817260742188 nb_pixel_total : 1969 time to create 1 rle with old method : 0.0024809837341308594 length of segment : 54 time for calcul the mask position with numpy : 0.00015997886657714844 nb_pixel_total : 3220 time to create 1 rle with old method : 0.004393339157104492 length of segment : 64 time for calcul the mask position with numpy : 0.00023603439331054688 nb_pixel_total : 4752 time to create 1 rle with old method : 0.006024360656738281 length of segment : 105 time for calcul the mask position with numpy : 0.0003554821014404297 nb_pixel_total : 13245 time to create 1 rle with old method : 0.01617264747619629 length of segment : 130 time for calcul the mask position with numpy : 0.0002219676971435547 nb_pixel_total : 4772 time to create 1 rle with old method : 0.005649089813232422 length of segment : 88 time for calcul the mask position with numpy : 0.0006895065307617188 nb_pixel_total : 19873 time to create 1 rle with old method : 0.02290511131286621 length of segment : 234 time for calcul the mask position with numpy : 0.00026726722717285156 nb_pixel_total : 3180 time to create 1 rle with old method : 0.0038328170776367188 length of segment : 79 time for calcul the mask position with numpy : 0.002469778060913086 nb_pixel_total : 95268 time to create 1 rle with old method : 0.10538864135742188 length of segment : 326 time for calcul the mask position with numpy : 0.0031647682189941406 nb_pixel_total : 133827 time to create 1 rle with old method : 0.1437995433807373 length of segment : 568 time for calcul the mask position with numpy : 0.000232696533203125 nb_pixel_total : 5464 time to create 1 rle with old method : 0.008800983428955078 length of segment : 111 time for calcul the mask position with numpy : 0.000705718994140625 nb_pixel_total : 26306 time to create 1 rle with old method : 0.04435396194458008 length of segment : 241 time for calcul the mask position with numpy : 0.0005981922149658203 nb_pixel_total : 17416 time to create 1 rle with old method : 0.027223825454711914 length of segment : 173 time for calcul the mask position with numpy : 0.0006086826324462891 nb_pixel_total : 24682 time to create 1 rle with old method : 0.03133726119995117 length of segment : 238 time for calcul the mask position with numpy : 0.0010762214660644531 nb_pixel_total : 50200 time to create 1 rle with old method : 0.05887317657470703 length of segment : 334 time for calcul the mask position with numpy : 0.0026564598083496094 nb_pixel_total : 117152 time to create 1 rle with old method : 0.13514232635498047 length of segment : 523 time for calcul the mask position with numpy : 0.00014400482177734375 nb_pixel_total : 2464 time to create 1 rle with old method : 0.0033788681030273438 length of segment : 54 time for calcul the mask position with numpy : 0.0002193450927734375 nb_pixel_total : 11900 time to create 1 rle with old method : 0.0136871337890625 length of segment : 141 time for calcul the mask position with numpy : 0.04321908950805664 nb_pixel_total : 1571751 time to create 1 rle with new method : 0.10602545738220215 length of segment : 2347 time for calcul the mask position with numpy : 0.00015401840209960938 nb_pixel_total : 1661 time to create 1 rle with old method : 0.0022232532501220703 length of segment : 54 time for calcul the mask position with numpy : 0.003932952880859375 nb_pixel_total : 193766 time to create 1 rle with new method : 0.013797998428344727 length of segment : 1263 time for calcul the mask position with numpy : 0.00443720817565918 nb_pixel_total : 282747 time to create 1 rle with new method : 0.013419866561889648 length of segment : 626 time for calcul the mask position with numpy : 0.00010275840759277344 nb_pixel_total : 1891 time to create 1 rle with old method : 0.0024399757385253906 length of segment : 47 time for calcul the mask position with numpy : 0.021217823028564453 nb_pixel_total : 730797 time to create 1 rle with new method : 0.05421018600463867 length of segment : 1527 time for calcul the mask position with numpy : 0.0027632713317871094 nb_pixel_total : 98606 time to create 1 rle with old method : 0.11473464965820312 length of segment : 554 time for calcul the mask position with numpy : 0.0031709671020507812 nb_pixel_total : 74198 time to create 1 rle with old method : 0.08523964881896973 length of segment : 434 time for calcul the mask position with numpy : 0.0006597042083740234 nb_pixel_total : 13608 time to create 1 rle with old method : 0.016124963760375977 length of segment : 153 time for calcul the mask position with numpy : 0.00017189979553222656 nb_pixel_total : 2622 time to create 1 rle with old method : 0.003330230712890625 length of segment : 42 time for calcul the mask position with numpy : 0.00035953521728515625 nb_pixel_total : 2699 time to create 1 rle with old method : 0.003553628921508789 length of segment : 103 time for calcul the mask position with numpy : 0.0008792877197265625 nb_pixel_total : 20693 time to create 1 rle with old method : 0.02320551872253418 length of segment : 278 time for calcul the mask position with numpy : 0.007990837097167969 nb_pixel_total : 308199 time to create 1 rle with new method : 0.014184713363647461 length of segment : 775 time for calcul the mask position with numpy : 0.0010821819305419922 nb_pixel_total : 24798 time to create 1 rle with old method : 0.02931046485900879 length of segment : 261 time for calcul the mask position with numpy : 0.0033006668090820312 nb_pixel_total : 114486 time to create 1 rle with old method : 0.12783360481262207 length of segment : 392 time for calcul the mask position with numpy : 0.00016117095947265625 nb_pixel_total : 1536 time to create 1 rle with old method : 0.0019576549530029297 length of segment : 42 time for calcul the mask position with numpy : 0.00016069412231445312 nb_pixel_total : 2182 time to create 1 rle with old method : 0.0029325485229492188 length of segment : 43 time for calcul the mask position with numpy : 0.004804849624633789 nb_pixel_total : 170849 time to create 1 rle with new method : 0.008259773254394531 length of segment : 887 time for calcul the mask position with numpy : 0.0005700588226318359 nb_pixel_total : 5653 time to create 1 rle with old method : 0.007010936737060547 length of segment : 116 time for calcul the mask position with numpy : 0.0023124217987060547 nb_pixel_total : 78530 time to create 1 rle with old method : 0.08449435234069824 length of segment : 463 time for calcul the mask position with numpy : 0.0007815361022949219 nb_pixel_total : 14896 time to create 1 rle with old method : 0.01671457290649414 length of segment : 237 time for calcul the mask position with numpy : 0.000774383544921875 nb_pixel_total : 21920 time to create 1 rle with old method : 0.024021148681640625 length of segment : 147 time for calcul the mask position with numpy : 0.0010287761688232422 nb_pixel_total : 18881 time to create 1 rle with old method : 0.022011756896972656 length of segment : 413 time for calcul the mask position with numpy : 0.0019779205322265625 nb_pixel_total : 71702 time to create 1 rle with old method : 0.0757901668548584 length of segment : 428 time for calcul the mask position with numpy : 0.0001881122589111328 nb_pixel_total : 2907 time to create 1 rle with old method : 0.003573894500732422 length of segment : 66 time for calcul the mask position with numpy : 0.0031058788299560547 nb_pixel_total : 69222 time to create 1 rle with old method : 0.07520341873168945 length of segment : 397 time for calcul the mask position with numpy : 0.00036644935607910156 nb_pixel_total : 2244 time to create 1 rle with old method : 0.0029256343841552734 length of segment : 91 time for calcul the mask position with numpy : 0.0003712177276611328 nb_pixel_total : 8967 time to create 1 rle with old method : 0.010734796524047852 length of segment : 288 time for calcul the mask position with numpy : 0.0028514862060546875 nb_pixel_total : 104406 time to create 1 rle with old method : 0.11254072189331055 length of segment : 283 time for calcul the mask position with numpy : 0.0018947124481201172 nb_pixel_total : 72000 time to create 1 rle with old method : 0.07906627655029297 length of segment : 389 time for calcul the mask position with numpy : 0.0069882869720458984 nb_pixel_total : 113055 time to create 1 rle with old method : 0.12334060668945312 length of segment : 1002 time for calcul the mask position with numpy : 0.001039266586303711 nb_pixel_total : 47764 time to create 1 rle with old method : 0.0541534423828125 length of segment : 403 time for calcul the mask position with numpy : 0.004199504852294922 nb_pixel_total : 119984 time to create 1 rle with old method : 0.13192033767700195 length of segment : 407 time for calcul the mask position with numpy : 0.003404855728149414 nb_pixel_total : 38827 time to create 1 rle with old method : 0.06356358528137207 length of segment : 265 time for calcul the mask position with numpy : 0.003484964370727539 nb_pixel_total : 80939 time to create 1 rle with old method : 0.0909581184387207 length of segment : 303 time for calcul the mask position with numpy : 0.001802206039428711 nb_pixel_total : 64706 time to create 1 rle with old method : 0.07623744010925293 length of segment : 338 time for calcul the mask position with numpy : 0.013930559158325195 nb_pixel_total : 449562 time to create 1 rle with new method : 0.025743722915649414 length of segment : 1008 time for calcul the mask position with numpy : 0.005331516265869141 nb_pixel_total : 2020 time to create 1 rle with old method : 0.004301548004150391 length of segment : 90 time for calcul the mask position with numpy : 0.00806427001953125 nb_pixel_total : 419983 time to create 1 rle with new method : 0.018567562103271484 length of segment : 1009 time for calcul the mask position with numpy : 0.001537322998046875 nb_pixel_total : 81521 time to create 1 rle with old method : 0.08764100074768066 length of segment : 318 time for calcul the mask position with numpy : 0.0005617141723632812 nb_pixel_total : 16562 time to create 1 rle with old method : 0.018216371536254883 length of segment : 108 time for calcul the mask position with numpy : 0.00039386749267578125 nb_pixel_total : 7035 time to create 1 rle with old method : 0.008399724960327148 length of segment : 196 time for calcul the mask position with numpy : 0.006792545318603516 nb_pixel_total : 271645 time to create 1 rle with new method : 0.012264728546142578 length of segment : 851 time for calcul the mask position with numpy : 0.0019390583038330078 nb_pixel_total : 107442 time to create 1 rle with old method : 0.12461400032043457 length of segment : 371 time for calcul the mask position with numpy : 0.004014730453491211 nb_pixel_total : 185058 time to create 1 rle with new method : 0.011505365371704102 length of segment : 880 time for calcul the mask position with numpy : 0.0022749900817871094 nb_pixel_total : 19482 time to create 1 rle with old method : 0.022176265716552734 length of segment : 283 time for calcul the mask position with numpy : 0.0037894248962402344 nb_pixel_total : 16932 time to create 1 rle with old method : 0.019662857055664062 length of segment : 355 time for calcul the mask position with numpy : 0.0003414154052734375 nb_pixel_total : 994 time to create 1 rle with old method : 0.0014011859893798828 length of segment : 68 time for calcul the mask position with numpy : 0.002855539321899414 nb_pixel_total : 45218 time to create 1 rle with old method : 0.051126718521118164 length of segment : 916 time for calcul the mask position with numpy : 0.0010340213775634766 nb_pixel_total : 18156 time to create 1 rle with old method : 0.02141737937927246 length of segment : 365 time for calcul the mask position with numpy : 0.0010905265808105469 nb_pixel_total : 21846 time to create 1 rle with old method : 0.02569866180419922 length of segment : 295 time for calcul the mask position with numpy : 0.0010745525360107422 nb_pixel_total : 11414 time to create 1 rle with old method : 0.01333761215209961 length of segment : 178 time for calcul the mask position with numpy : 0.008102655410766602 nb_pixel_total : 248261 time to create 1 rle with new method : 0.015710115432739258 length of segment : 900 time for calcul the mask position with numpy : 0.0024747848510742188 nb_pixel_total : 106762 time to create 1 rle with old method : 0.11454534530639648 length of segment : 404 time for calcul the mask position with numpy : 0.0063323974609375 nb_pixel_total : 226496 time to create 1 rle with new method : 0.017391443252563477 length of segment : 679 time for calcul the mask position with numpy : 0.0011425018310546875 nb_pixel_total : 22177 time to create 1 rle with old method : 0.024719953536987305 length of segment : 450 time for calcul the mask position with numpy : 0.005950450897216797 nb_pixel_total : 217618 time to create 1 rle with new method : 0.009796857833862305 length of segment : 903 time for calcul the mask position with numpy : 0.0002524852752685547 nb_pixel_total : 4074 time to create 1 rle with old method : 0.006623506546020508 length of segment : 86 time for calcul the mask position with numpy : 0.017187118530273438 nb_pixel_total : 399540 time to create 1 rle with new method : 0.01738739013671875 length of segment : 917 time for calcul the mask position with numpy : 0.00025153160095214844 nb_pixel_total : 2201 time to create 1 rle with old method : 0.0027861595153808594 length of segment : 62 time for calcul the mask position with numpy : 0.003904104232788086 nb_pixel_total : 157327 time to create 1 rle with new method : 0.0047419071197509766 length of segment : 533 time for calcul the mask position with numpy : 0.000202178955078125 nb_pixel_total : 2463 time to create 1 rle with old method : 0.003016233444213867 length of segment : 52 time for calcul the mask position with numpy : 0.001566171646118164 nb_pixel_total : 72017 time to create 1 rle with old method : 0.08837246894836426 length of segment : 343 time for calcul the mask position with numpy : 0.0005631446838378906 nb_pixel_total : 11937 time to create 1 rle with old method : 0.01337432861328125 length of segment : 171 time for calcul the mask position with numpy : 0.0033032894134521484 nb_pixel_total : 96376 time to create 1 rle with old method : 0.11480474472045898 length of segment : 285 time for calcul the mask position with numpy : 0.0006337165832519531 nb_pixel_total : 6077 time to create 1 rle with old method : 0.007360935211181641 length of segment : 212 time for calcul the mask position with numpy : 0.009034156799316406 nb_pixel_total : 413358 time to create 1 rle with new method : 0.01986241340637207 length of segment : 859 time for calcul the mask position with numpy : 0.0018417835235595703 nb_pixel_total : 45401 time to create 1 rle with old method : 0.05757641792297363 length of segment : 468 time for calcul the mask position with numpy : 0.0013124942779541016 nb_pixel_total : 20508 time to create 1 rle with old method : 0.0348050594329834 length of segment : 148 time for calcul the mask position with numpy : 0.005156040191650391 nb_pixel_total : 138617 time to create 1 rle with old method : 0.15358424186706543 length of segment : 492 time for calcul the mask position with numpy : 0.006933450698852539 nb_pixel_total : 247385 time to create 1 rle with new method : 0.01145482063293457 length of segment : 756 time for calcul the mask position with numpy : 0.0016570091247558594 nb_pixel_total : 82746 time to create 1 rle with old method : 0.0922079086303711 length of segment : 319 time for calcul the mask position with numpy : 0.00012111663818359375 nb_pixel_total : 2304 time to create 1 rle with old method : 0.0028629302978515625 length of segment : 44 time for calcul the mask position with numpy : 0.00034928321838378906 nb_pixel_total : 3529 time to create 1 rle with old method : 0.004192352294921875 length of segment : 112 time for calcul the mask position with numpy : 0.0009686946868896484 nb_pixel_total : 21743 time to create 1 rle with old method : 0.02589893341064453 length of segment : 194 time for calcul the mask position with numpy : 0.0055081844329833984 nb_pixel_total : 139558 time to create 1 rle with old method : 0.15458393096923828 length of segment : 501 time for calcul the mask position with numpy : 0.0011281967163085938 nb_pixel_total : 21728 time to create 1 rle with old method : 0.024703025817871094 length of segment : 438 time for calcul the mask position with numpy : 0.0005402565002441406 nb_pixel_total : 8735 time to create 1 rle with old method : 0.011111259460449219 length of segment : 188 time for calcul the mask position with numpy : 0.0051784515380859375 nb_pixel_total : 162523 time to create 1 rle with new method : 0.00957036018371582 length of segment : 808 time for calcul the mask position with numpy : 0.0002446174621582031 nb_pixel_total : 2665 time to create 1 rle with old method : 0.004499197006225586 length of segment : 53 time for calcul the mask position with numpy : 0.014187335968017578 nb_pixel_total : 406153 time to create 1 rle with new method : 0.018479347229003906 length of segment : 816 time for calcul the mask position with numpy : 0.002872467041015625 nb_pixel_total : 50616 time to create 1 rle with old method : 0.07849407196044922 length of segment : 484 time for calcul the mask position with numpy : 0.0005156993865966797 nb_pixel_total : 4821 time to create 1 rle with old method : 0.005824089050292969 length of segment : 112 time for calcul the mask position with numpy : 0.0008559226989746094 nb_pixel_total : 19949 time to create 1 rle with old method : 0.023231029510498047 length of segment : 144 time for calcul the mask position with numpy : 0.009845495223999023 nb_pixel_total : 374493 time to create 1 rle with new method : 0.019666194915771484 length of segment : 761 time for calcul the mask position with numpy : 0.004044294357299805 nb_pixel_total : 155740 time to create 1 rle with new method : 0.006150722503662109 length of segment : 553 time for calcul the mask position with numpy : 0.0017116069793701172 nb_pixel_total : 70083 time to create 1 rle with old method : 0.08011460304260254 length of segment : 326 time for calcul the mask position with numpy : 0.003099679946899414 nb_pixel_total : 98270 time to create 1 rle with old method : 0.1362760066986084 length of segment : 304 time for calcul the mask position with numpy : 0.0008618831634521484 nb_pixel_total : 20822 time to create 1 rle with old method : 0.0307769775390625 length of segment : 180 time for calcul the mask position with numpy : 0.00020694732666015625 nb_pixel_total : 3376 time to create 1 rle with old method : 0.005852460861206055 length of segment : 60 time for calcul the mask position with numpy : 0.00018668174743652344 nb_pixel_total : 2791 time to create 1 rle with old method : 0.004927873611450195 length of segment : 70 time for calcul the mask position with numpy : 0.004481315612792969 nb_pixel_total : 248535 time to create 1 rle with new method : 0.009517192840576172 length of segment : 726 time for calcul the mask position with numpy : 0.00191497802734375 nb_pixel_total : 98178 time to create 1 rle with old method : 0.12861037254333496 length of segment : 351 time for calcul the mask position with numpy : 0.00029730796813964844 nb_pixel_total : 6177 time to create 1 rle with old method : 0.008232355117797852 length of segment : 215 time for calcul the mask position with numpy : 0.0042531490325927734 nb_pixel_total : 126861 time to create 1 rle with old method : 0.14090681076049805 length of segment : 442 time for calcul the mask position with numpy : 0.0005331039428710938 nb_pixel_total : 8496 time to create 1 rle with old method : 0.010324239730834961 length of segment : 181 time for calcul the mask position with numpy : 0.0012273788452148438 nb_pixel_total : 26693 time to create 1 rle with old method : 0.030025959014892578 length of segment : 316 time for calcul the mask position with numpy : 0.0013659000396728516 nb_pixel_total : 16945 time to create 1 rle with old method : 0.01892399787902832 length of segment : 330 time for calcul the mask position with numpy : 0.0008552074432373047 nb_pixel_total : 17832 time to create 1 rle with old method : 0.019605159759521484 length of segment : 320 time for calcul the mask position with numpy : 0.0004744529724121094 nb_pixel_total : 11639 time to create 1 rle with old method : 0.014054298400878906 length of segment : 208 time for calcul the mask position with numpy : 0.0018970966339111328 nb_pixel_total : 45499 time to create 1 rle with old method : 0.05266857147216797 length of segment : 479 time for calcul the mask position with numpy : 0.00022339820861816406 nb_pixel_total : 2167 time to create 1 rle with old method : 0.0028231143951416016 length of segment : 62 time for calcul the mask position with numpy : 0.010428905487060547 nb_pixel_total : 446922 time to create 1 rle with new method : 0.01309967041015625 length of segment : 709 time for calcul the mask position with numpy : 0.0006363391876220703 nb_pixel_total : 18847 time to create 1 rle with old method : 0.02130746841430664 length of segment : 156 time for calcul the mask position with numpy : 0.00030541419982910156 nb_pixel_total : 3437 time to create 1 rle with old method : 0.004518747329711914 length of segment : 82 time for calcul the mask position with numpy : 0.0006663799285888672 nb_pixel_total : 10687 time to create 1 rle with old method : 0.013670682907104492 length of segment : 84 time for calcul the mask position with numpy : 0.0006449222564697266 nb_pixel_total : 20415 time to create 1 rle with old method : 0.024387121200561523 length of segment : 160 time for calcul the mask position with numpy : 0.00013589859008789062 nb_pixel_total : 1694 time to create 1 rle with old method : 0.0022029876708984375 length of segment : 52 time for calcul the mask position with numpy : 0.0005588531494140625 nb_pixel_total : 24098 time to create 1 rle with old method : 0.028707265853881836 length of segment : 172 time for calcul the mask position with numpy : 0.00022411346435546875 nb_pixel_total : 7986 time to create 1 rle with old method : 0.009425640106201172 length of segment : 88 time for calcul the mask position with numpy : 0.0022809505462646484 nb_pixel_total : 56388 time to create 1 rle with old method : 0.06312346458435059 length of segment : 472 time for calcul the mask position with numpy : 0.00021266937255859375 nb_pixel_total : 4247 time to create 1 rle with old method : 0.005487918853759766 length of segment : 66 time for calcul the mask position with numpy : 0.002025604248046875 nb_pixel_total : 81873 time to create 1 rle with old method : 0.08852458000183105 length of segment : 397 time for calcul the mask position with numpy : 0.002374410629272461 nb_pixel_total : 96753 time to create 1 rle with old method : 0.10963821411132812 length of segment : 430 time for calcul the mask position with numpy : 0.0007700920104980469 nb_pixel_total : 20292 time to create 1 rle with old method : 0.023864030838012695 length of segment : 197 time for calcul the mask position with numpy : 0.0004715919494628906 nb_pixel_total : 9448 time to create 1 rle with old method : 0.011012077331542969 length of segment : 118 time for calcul the mask position with numpy : 0.0021474361419677734 nb_pixel_total : 68110 time to create 1 rle with old method : 0.07768774032592773 length of segment : 403 time for calcul the mask position with numpy : 0.0003077983856201172 nb_pixel_total : 10788 time to create 1 rle with old method : 0.011857986450195312 length of segment : 201 time for calcul the mask position with numpy : 0.0006935596466064453 nb_pixel_total : 26337 time to create 1 rle with old method : 0.03157544136047363 length of segment : 185 time for calcul the mask position with numpy : 0.006485700607299805 nb_pixel_total : 346972 time to create 1 rle with new method : 0.009080171585083008 length of segment : 485 time for calcul the mask position with numpy : 0.00014710426330566406 nb_pixel_total : 2182 time to create 1 rle with old method : 0.0025496482849121094 length of segment : 64 time for calcul the mask position with numpy : 0.0026581287384033203 nb_pixel_total : 100397 time to create 1 rle with old method : 0.10673928260803223 length of segment : 578 time for calcul the mask position with numpy : 0.0003437995910644531 nb_pixel_total : 12421 time to create 1 rle with old method : 0.014397621154785156 length of segment : 178 time for calcul the mask position with numpy : 0.007487058639526367 nb_pixel_total : 307759 time to create 1 rle with new method : 0.01670098304748535 length of segment : 942 time for calcul the mask position with numpy : 0.0015511512756347656 nb_pixel_total : 41108 time to create 1 rle with old method : 0.04817843437194824 length of segment : 361 time for calcul the mask position with numpy : 0.00015974044799804688 nb_pixel_total : 1771 time to create 1 rle with old method : 0.002305269241333008 length of segment : 41 time for calcul the mask position with numpy : 0.005306243896484375 nb_pixel_total : 163247 time to create 1 rle with new method : 0.008147001266479492 length of segment : 512 time for calcul the mask position with numpy : 0.0017209053039550781 nb_pixel_total : 33696 time to create 1 rle with old method : 0.03772783279418945 length of segment : 284 time for calcul the mask position with numpy : 0.00035119056701660156 nb_pixel_total : 10550 time to create 1 rle with old method : 0.012778043746948242 length of segment : 100 time for calcul the mask position with numpy : 0.00030350685119628906 nb_pixel_total : 8210 time to create 1 rle with old method : 0.009562492370605469 length of segment : 102 time for calcul the mask position with numpy : 0.0002968311309814453 nb_pixel_total : 7883 time to create 1 rle with old method : 0.009117364883422852 length of segment : 112 time for calcul the mask position with numpy : 0.0016360282897949219 nb_pixel_total : 50845 time to create 1 rle with old method : 0.05662131309509277 length of segment : 577 time for calcul the mask position with numpy : 0.00016951560974121094 nb_pixel_total : 2161 time to create 1 rle with old method : 0.0027718544006347656 length of segment : 75 time for calcul the mask position with numpy : 0.0018470287322998047 nb_pixel_total : 68171 time to create 1 rle with old method : 0.07503867149353027 length of segment : 445 time for calcul the mask position with numpy : 0.00030541419982910156 nb_pixel_total : 5275 time to create 1 rle with old method : 0.006765127182006836 length of segment : 95 time for calcul the mask position with numpy : 0.0002608299255371094 nb_pixel_total : 5248 time to create 1 rle with old method : 0.0065081119537353516 length of segment : 83 time for calcul the mask position with numpy : 0.0037338733673095703 nb_pixel_total : 160436 time to create 1 rle with new method : 0.004889488220214844 length of segment : 635 time for calcul the mask position with numpy : 0.0031499862670898438 nb_pixel_total : 109639 time to create 1 rle with old method : 0.11943840980529785 length of segment : 434 time for calcul the mask position with numpy : 0.0016918182373046875 nb_pixel_total : 41718 time to create 1 rle with old method : 0.04862713813781738 length of segment : 351 time for calcul the mask position with numpy : 0.0008654594421386719 nb_pixel_total : 32733 time to create 1 rle with old method : 0.038053274154663086 length of segment : 224 time for calcul the mask position with numpy : 0.003149271011352539 nb_pixel_total : 161710 time to create 1 rle with new method : 0.00546717643737793 length of segment : 429 time for calcul the mask position with numpy : 0.0005197525024414062 nb_pixel_total : 14943 time to create 1 rle with old method : 0.01889204978942871 length of segment : 149 time for calcul the mask position with numpy : 0.0005893707275390625 nb_pixel_total : 11256 time to create 1 rle with old method : 0.018543243408203125 length of segment : 199 time for calcul the mask position with numpy : 0.0021893978118896484 nb_pixel_total : 53259 time to create 1 rle with old method : 0.06585288047790527 length of segment : 475 time for calcul the mask position with numpy : 0.0050220489501953125 nb_pixel_total : 201012 time to create 1 rle with new method : 0.007376194000244141 length of segment : 498 time for calcul the mask position with numpy : 0.0006678104400634766 nb_pixel_total : 13603 time to create 1 rle with old method : 0.01584148406982422 length of segment : 164 time for calcul the mask position with numpy : 0.001577615737915039 nb_pixel_total : 30269 time to create 1 rle with old method : 0.03508257865905762 length of segment : 239 time for calcul the mask position with numpy : 0.0024728775024414062 nb_pixel_total : 81358 time to create 1 rle with old method : 0.09352779388427734 length of segment : 410 time for calcul the mask position with numpy : 0.0019464492797851562 nb_pixel_total : 83610 time to create 1 rle with old method : 0.08942770957946777 length of segment : 562 time for calcul the mask position with numpy : 0.0019626617431640625 nb_pixel_total : 55857 time to create 1 rle with old method : 0.06137847900390625 length of segment : 439 time for calcul the mask position with numpy : 0.006700277328491211 nb_pixel_total : 274150 time to create 1 rle with new method : 0.011677026748657227 length of segment : 1085 time for calcul the mask position with numpy : 0.0007545948028564453 nb_pixel_total : 18775 time to create 1 rle with old method : 0.02129364013671875 length of segment : 232 time for calcul the mask position with numpy : 0.0012314319610595703 nb_pixel_total : 42305 time to create 1 rle with old method : 0.06158447265625 length of segment : 371 time for calcul the mask position with numpy : 0.00012421607971191406 nb_pixel_total : 1081 time to create 1 rle with old method : 0.0011858940124511719 length of segment : 51 time for calcul the mask position with numpy : 0.0014190673828125 nb_pixel_total : 29674 time to create 1 rle with old method : 0.0325162410736084 length of segment : 293 time for calcul the mask position with numpy : 0.0018138885498046875 nb_pixel_total : 36315 time to create 1 rle with old method : 0.04036736488342285 length of segment : 663 time for calcul the mask position with numpy : 0.0004291534423828125 nb_pixel_total : 5640 time to create 1 rle with old method : 0.006912946701049805 length of segment : 102 time for calcul the mask position with numpy : 0.0024802684783935547 nb_pixel_total : 109201 time to create 1 rle with old method : 0.13754725456237793 length of segment : 468 time for calcul the mask position with numpy : 0.0015215873718261719 nb_pixel_total : 61356 time to create 1 rle with old method : 0.07025766372680664 length of segment : 253 time for calcul the mask position with numpy : 0.0001552104949951172 nb_pixel_total : 1871 time to create 1 rle with old method : 0.0024271011352539062 length of segment : 50 time for calcul the mask position with numpy : 0.025454044342041016 nb_pixel_total : 924311 time to create 1 rle with new method : 0.058003902435302734 length of segment : 1986 time for calcul the mask position with numpy : 0.0037059783935546875 nb_pixel_total : 149540 time to create 1 rle with old method : 0.15841078758239746 length of segment : 706 time for calcul the mask position with numpy : 0.03854060173034668 nb_pixel_total : 1815092 time to create 1 rle with new method : 0.0871281623840332 length of segment : 3637 time for calcul the mask position with numpy : 0.0001220703125 nb_pixel_total : 3011 time to create 1 rle with old method : 0.003894329071044922 length of segment : 75 time for calcul the mask position with numpy : 0.0076982975006103516 nb_pixel_total : 438643 time to create 1 rle with new method : 0.016831159591674805 length of segment : 1177 time for calcul the mask position with numpy : 0.0064923763275146484 nb_pixel_total : 416743 time to create 1 rle with new method : 0.015083789825439453 length of segment : 1251 time for calcul the mask position with numpy : 0.001283407211303711 nb_pixel_total : 80442 time to create 1 rle with old method : 0.09062552452087402 length of segment : 184 time for calcul the mask position with numpy : 0.0010695457458496094 nb_pixel_total : 43813 time to create 1 rle with old method : 0.04967641830444336 length of segment : 270 time for calcul the mask position with numpy : 0.0009510517120361328 nb_pixel_total : 32295 time to create 1 rle with old method : 0.03550910949707031 length of segment : 297 time for calcul the mask position with numpy : 0.00015783309936523438 nb_pixel_total : 1834 time to create 1 rle with old method : 0.0024025440216064453 length of segment : 63 time for calcul the mask position with numpy : 0.04603743553161621 nb_pixel_total : 2826876 time to create 1 rle with new method : 0.10919713973999023 length of segment : 2609 time for calcul the mask position with numpy : 0.0002269744873046875 nb_pixel_total : 5745 time to create 1 rle with old method : 0.0064122676849365234 length of segment : 101 time for calcul the mask position with numpy : 0.012992620468139648 nb_pixel_total : 899356 time to create 1 rle with new method : 0.02813267707824707 length of segment : 1547 time for calcul the mask position with numpy : 0.006701946258544922 nb_pixel_total : 358275 time to create 1 rle with new method : 0.017103195190429688 length of segment : 1118 time for calcul the mask position with numpy : 0.00041937828063964844 nb_pixel_total : 8915 time to create 1 rle with old method : 0.01037907600402832 length of segment : 144 time for calcul the mask position with numpy : 0.043763160705566406 nb_pixel_total : 1828341 time to create 1 rle with new method : 0.10819745063781738 length of segment : 2804 time for calcul the mask position with numpy : 0.00014734268188476562 nb_pixel_total : 1284 time to create 1 rle with old method : 0.001504659652709961 length of segment : 54 time for calcul the mask position with numpy : 0.0012247562408447266 nb_pixel_total : 57830 time to create 1 rle with old method : 0.06261777877807617 length of segment : 349 time for calcul the mask position with numpy : 0.0002315044403076172 nb_pixel_total : 12374 time to create 1 rle with old method : 0.01400136947631836 length of segment : 155 time for calcul the mask position with numpy : 0.00023984909057617188 nb_pixel_total : 15263 time to create 1 rle with old method : 0.01639533042907715 length of segment : 168 time for calcul the mask position with numpy : 0.0011286735534667969 nb_pixel_total : 73335 time to create 1 rle with old method : 0.07969450950622559 length of segment : 327 time for calcul the mask position with numpy : 0.0032525062561035156 nb_pixel_total : 186230 time to create 1 rle with new method : 0.00665736198425293 length of segment : 691 time for calcul the mask position with numpy : 0.00027751922607421875 nb_pixel_total : 15367 time to create 1 rle with old method : 0.01847100257873535 length of segment : 165 time for calcul the mask position with numpy : 0.0025022029876708984 nb_pixel_total : 165740 time to create 1 rle with new method : 0.006430625915527344 length of segment : 564 time for calcul the mask position with numpy : 0.009953498840332031 nb_pixel_total : 551176 time to create 1 rle with new method : 0.02165842056274414 length of segment : 1124 time for calcul the mask position with numpy : 0.006237030029296875 nb_pixel_total : 192710 time to create 1 rle with new method : 0.01330113410949707 length of segment : 1160 time for calcul the mask position with numpy : 0.00038814544677734375 nb_pixel_total : 8797 time to create 1 rle with old method : 0.009846925735473633 length of segment : 226 time for calcul the mask position with numpy : 0.0021123886108398438 nb_pixel_total : 75624 time to create 1 rle with old method : 0.08118700981140137 length of segment : 404 time for calcul the mask position with numpy : 0.0011589527130126953 nb_pixel_total : 31856 time to create 1 rle with old method : 0.0353093147277832 length of segment : 387 time for calcul the mask position with numpy : 0.0002980232238769531 nb_pixel_total : 7494 time to create 1 rle with old method : 0.008555412292480469 length of segment : 90 time for calcul the mask position with numpy : 0.043961286544799805 nb_pixel_total : 1941590 time to create 1 rle with new method : 0.09196949005126953 length of segment : 3133 time for calcul the mask position with numpy : 0.0018124580383300781 nb_pixel_total : 57246 time to create 1 rle with old method : 0.059736013412475586 length of segment : 660 time for calcul the mask position with numpy : 0.00015401840209960938 nb_pixel_total : 2540 time to create 1 rle with old method : 0.003303050994873047 length of segment : 36 time for calcul the mask position with numpy : 0.016149520874023438 nb_pixel_total : 1017623 time to create 1 rle with new method : 0.03817176818847656 length of segment : 1541 time for calcul the mask position with numpy : 0.000457763671875 nb_pixel_total : 16942 time to create 1 rle with old method : 0.018855571746826172 length of segment : 148 time for calcul the mask position with numpy : 0.0003180503845214844 nb_pixel_total : 5815 time to create 1 rle with old method : 0.0066835880279541016 length of segment : 129 time for calcul the mask position with numpy : 0.007031679153442383 nb_pixel_total : 367600 time to create 1 rle with new method : 0.018937349319458008 length of segment : 1320 time for calcul the mask position with numpy : 0.0007462501525878906 nb_pixel_total : 16966 time to create 1 rle with old method : 0.020218849182128906 length of segment : 171 time for calcul the mask position with numpy : 0.0001747608184814453 nb_pixel_total : 1941 time to create 1 rle with old method : 0.002527475357055664 length of segment : 59 time for calcul the mask position with numpy : 0.00033211708068847656 nb_pixel_total : 3901 time to create 1 rle with old method : 0.004687309265136719 length of segment : 145 time for calcul the mask position with numpy : 0.0009715557098388672 nb_pixel_total : 25240 time to create 1 rle with old method : 0.029242277145385742 length of segment : 219 time for calcul the mask position with numpy : 0.0009677410125732422 nb_pixel_total : 31856 time to create 1 rle with old method : 0.03732776641845703 length of segment : 187 time for calcul the mask position with numpy : 0.008431673049926758 nb_pixel_total : 239821 time to create 1 rle with new method : 0.012520551681518555 length of segment : 934 time for calcul the mask position with numpy : 0.0007119178771972656 nb_pixel_total : 16800 time to create 1 rle with old method : 0.01860976219177246 length of segment : 178 time for calcul the mask position with numpy : 0.010617256164550781 nb_pixel_total : 312677 time to create 1 rle with new method : 0.014240026473999023 length of segment : 492 time for calcul the mask position with numpy : 0.00019097328186035156 nb_pixel_total : 878 time to create 1 rle with old method : 0.0013539791107177734 length of segment : 50 time for calcul the mask position with numpy : 0.0002942085266113281 nb_pixel_total : 4999 time to create 1 rle with old method : 0.006203174591064453 length of segment : 91 time for calcul the mask position with numpy : 0.0017085075378417969 nb_pixel_total : 54676 time to create 1 rle with old method : 0.05873751640319824 length of segment : 587 time for calcul the mask position with numpy : 0.0024421215057373047 nb_pixel_total : 89654 time to create 1 rle with old method : 0.0950937271118164 length of segment : 453 time for calcul the mask position with numpy : 0.004431962966918945 nb_pixel_total : 177119 time to create 1 rle with new method : 0.006909847259521484 length of segment : 491 time for calcul the mask position with numpy : 0.00025081634521484375 nb_pixel_total : 2389 time to create 1 rle with old method : 0.0031969547271728516 length of segment : 75 time for calcul the mask position with numpy : 0.0009813308715820312 nb_pixel_total : 26321 time to create 1 rle with old method : 0.02912592887878418 length of segment : 174 time for calcul the mask position with numpy : 0.00030112266540527344 nb_pixel_total : 11989 time to create 1 rle with old method : 0.013161897659301758 length of segment : 124 time for calcul the mask position with numpy : 0.0001666545867919922 nb_pixel_total : 1667 time to create 1 rle with old method : 0.0020699501037597656 length of segment : 64 time for calcul the mask position with numpy : 0.0046770572662353516 nb_pixel_total : 158994 time to create 1 rle with new method : 0.006666898727416992 length of segment : 435 time for calcul the mask position with numpy : 0.0004665851593017578 nb_pixel_total : 14594 time to create 1 rle with old method : 0.016643524169921875 length of segment : 145 time for calcul the mask position with numpy : 0.004556894302368164 nb_pixel_total : 311666 time to create 1 rle with new method : 0.009782552719116211 length of segment : 617 time for calcul the mask position with numpy : 0.0044476985931396484 nb_pixel_total : 137027 time to create 1 rle with old method : 0.14854001998901367 length of segment : 765 time for calcul the mask position with numpy : 0.00341796875 nb_pixel_total : 143207 time to create 1 rle with old method : 0.15501856803894043 length of segment : 469 time for calcul the mask position with numpy : 0.000919342041015625 nb_pixel_total : 15116 time to create 1 rle with old method : 0.018363475799560547 length of segment : 296 time for calcul the mask position with numpy : 0.0004458427429199219 nb_pixel_total : 14985 time to create 1 rle with old method : 0.017670631408691406 length of segment : 140 time for calcul the mask position with numpy : 0.002908468246459961 nb_pixel_total : 55205 time to create 1 rle with old method : 0.062210798263549805 length of segment : 239 time for calcul the mask position with numpy : 0.00024890899658203125 nb_pixel_total : 11171 time to create 1 rle with old method : 0.014800071716308594 length of segment : 76 time for calcul the mask position with numpy : 0.00031304359436035156 nb_pixel_total : 6636 time to create 1 rle with old method : 0.00820779800415039 length of segment : 109 time for calcul the mask position with numpy : 0.0003829002380371094 nb_pixel_total : 6503 time to create 1 rle with old method : 0.007826805114746094 length of segment : 163 time for calcul the mask position with numpy : 0.0006356239318847656 nb_pixel_total : 9730 time to create 1 rle with old method : 0.01186823844909668 length of segment : 122 time for calcul the mask position with numpy : 0.007204532623291016 nb_pixel_total : 357095 time to create 1 rle with new method : 0.010829687118530273 length of segment : 580 time for calcul the mask position with numpy : 0.0007839202880859375 nb_pixel_total : 16453 time to create 1 rle with old method : 0.0265655517578125 length of segment : 280 time for calcul the mask position with numpy : 0.0006000995635986328 nb_pixel_total : 14346 time to create 1 rle with old method : 0.016050338745117188 length of segment : 205 time for calcul the mask position with numpy : 0.00019478797912597656 nb_pixel_total : 3652 time to create 1 rle with old method : 0.004586219787597656 length of segment : 66 time for calcul the mask position with numpy : 0.0003762245178222656 nb_pixel_total : 5751 time to create 1 rle with old method : 0.006844758987426758 length of segment : 132 time for calcul the mask position with numpy : 0.000461578369140625 nb_pixel_total : 13697 time to create 1 rle with old method : 0.015648603439331055 length of segment : 178 time for calcul the mask position with numpy : 0.004134654998779297 nb_pixel_total : 113033 time to create 1 rle with old method : 0.12490034103393555 length of segment : 523 time for calcul the mask position with numpy : 0.001729726791381836 nb_pixel_total : 52636 time to create 1 rle with old method : 0.06087779998779297 length of segment : 313 time for calcul the mask position with numpy : 0.0017392635345458984 nb_pixel_total : 47920 time to create 1 rle with old method : 0.05490565299987793 length of segment : 361 time for calcul the mask position with numpy : 0.0027124881744384766 nb_pixel_total : 98517 time to create 1 rle with old method : 0.10939908027648926 length of segment : 479 time for calcul the mask position with numpy : 0.0008265972137451172 nb_pixel_total : 40908 time to create 1 rle with old method : 0.056725502014160156 length of segment : 265 time for calcul the mask position with numpy : 0.0016603469848632812 nb_pixel_total : 36957 time to create 1 rle with old method : 0.05198311805725098 length of segment : 409 time for calcul the mask position with numpy : 0.0021944046020507812 nb_pixel_total : 61146 time to create 1 rle with old method : 0.06762218475341797 length of segment : 268 time for calcul the mask position with numpy : 0.0014798641204833984 nb_pixel_total : 25931 time to create 1 rle with old method : 0.030755996704101562 length of segment : 429 time for calcul the mask position with numpy : 0.0034749507904052734 nb_pixel_total : 133736 time to create 1 rle with old method : 0.1527879238128662 length of segment : 529 time for calcul the mask position with numpy : 0.005303382873535156 nb_pixel_total : 190694 time to create 1 rle with new method : 0.010409355163574219 length of segment : 485 time for calcul the mask position with numpy : 0.0005624294281005859 nb_pixel_total : 13355 time to create 1 rle with old method : 0.017694473266601562 length of segment : 176 time for calcul the mask position with numpy : 0.0016431808471679688 nb_pixel_total : 58915 time to create 1 rle with old method : 0.06580376625061035 length of segment : 176 time for calcul the mask position with numpy : 0.0007061958312988281 nb_pixel_total : 13295 time to create 1 rle with old method : 0.01602005958557129 length of segment : 189 time for calcul the mask position with numpy : 0.0048007965087890625 nb_pixel_total : 93199 time to create 1 rle with old method : 0.10315990447998047 length of segment : 1055 time for calcul the mask position with numpy : 0.002374887466430664 nb_pixel_total : 57077 time to create 1 rle with old method : 0.07286715507507324 length of segment : 375 time for calcul the mask position with numpy : 0.006484031677246094 nb_pixel_total : 204362 time to create 1 rle with new method : 0.009750604629516602 length of segment : 865 time for calcul the mask position with numpy : 0.0032584667205810547 nb_pixel_total : 136701 time to create 1 rle with old method : 0.15252351760864258 length of segment : 329 time for calcul the mask position with numpy : 0.0002155303955078125 nb_pixel_total : 1378 time to create 1 rle with old method : 0.0019507408142089844 length of segment : 55 time for calcul the mask position with numpy : 0.002230405807495117 nb_pixel_total : 94551 time to create 1 rle with old method : 0.10650372505187988 length of segment : 405 time for calcul the mask position with numpy : 0.000209808349609375 nb_pixel_total : 2079 time to create 1 rle with old method : 0.0024852752685546875 length of segment : 67 time for calcul the mask position with numpy : 0.0022857189178466797 nb_pixel_total : 45309 time to create 1 rle with old method : 0.05464529991149902 length of segment : 425 time for calcul the mask position with numpy : 0.0013370513916015625 nb_pixel_total : 41761 time to create 1 rle with old method : 0.04530739784240723 length of segment : 327 time for calcul the mask position with numpy : 0.00640869140625 nb_pixel_total : 203818 time to create 1 rle with new method : 0.013195276260375977 length of segment : 631 time for calcul the mask position with numpy : 0.005230426788330078 nb_pixel_total : 214270 time to create 1 rle with new method : 0.008031606674194336 length of segment : 566 time for calcul the mask position with numpy : 0.0015630722045898438 nb_pixel_total : 16131 time to create 1 rle with old method : 0.01948857307434082 length of segment : 402 time for calcul the mask position with numpy : 0.0011174678802490234 nb_pixel_total : 30807 time to create 1 rle with old method : 0.034110307693481445 length of segment : 357 time for calcul the mask position with numpy : 0.0007581710815429688 nb_pixel_total : 58945 time to create 1 rle with old method : 0.06423354148864746 length of segment : 348 time for calcul the mask position with numpy : 0.0008516311645507812 nb_pixel_total : 25860 time to create 1 rle with old method : 0.03985595703125 length of segment : 104 time for calcul the mask position with numpy : 0.00018334388732910156 nb_pixel_total : 1119 time to create 1 rle with old method : 0.001489400863647461 length of segment : 41 time spent for convertir_results : 29.67444109916687 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 321 chid ids of type : 3663 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 115180 save missing photos in datou_result : time spend for datou_step_exec : 91.2151870727539 time spend to save output : 7.6803083419799805 total time spend for step 1 : 98.89549541473389 step2:crop_condition Thu Feb 6 17:09:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3663 Loading chi in step crop for list_pids : 18 ! batch 1 Loaded 321 chid ids of type : 3663 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : teint_dans_la_masse param for this class : {'min_score': 0.7} filtre for class : teint_dans_la_masse hashtag_id of this class : 2107752385 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 31 About to insert : list_path_to_insert length 31 new photo from crops ! we have finished the crop for the class : teint_dans_la_masse begin to crop the class : autre_refus param for this class : {'min_score': 0.5} filtre for class : autre_refus hashtag_id of this class : 2107752406 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 19 About to insert : list_path_to_insert length 19 new photo from crops ! we have finished the crop for the class : autre_refus begin to crop the class : carton_gris param for this class : {'min_score': 0.5} filtre for class : carton_gris hashtag_id of this class : 2107753020 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! we have finished the crop for the class : carton_gris begin to crop the class : cartonnette param for this class : {'min_score': 0.5} filtre for class : cartonnette hashtag_id of this class : 702398920 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 76 About to insert : list_path_to_insert length 76 new photo from crops ! we have finished the crop for the class : cartonnette begin to crop the class : carton_brun param for this class : {'min_score': 0.7} filtre for class : carton_brun hashtag_id of this class : 2107753024 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! we have finished the crop for the class : carton_brun begin to crop the class : plastique param for this class : {'min_score': 0.5} filtre for class : plastique hashtag_id of this class : 492725882 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! we have finished the crop for the class : plastique begin to crop the class : kraft param for this class : {'min_score': 0.5} filtre for class : kraft hashtag_id of this class : 493202403 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! we have finished the crop for the class : kraft begin to crop the class : metal param for this class : {'min_score': 0.5} filtre for class : metal hashtag_id of this class : 492628673 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1330579442, 1330579438, 1330579432, 1330579401, 1330579193, 1330579061, 1330578845, 1330578824, 1330578718, 1330578675, 1330578670, 1330578664, 1330578544, 1330578270, 1330578009, 1330577743, 1330577657, 1330577525] Looping around the photos to save general results len do output : 155 /-3651681637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651747978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651747989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651747988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651747987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651747992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651747994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651747998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3657892388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651748073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3651681738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579442', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579438', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579432', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579401', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579193', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579061', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578845', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578824', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578718', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578675', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578670', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578664', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578544', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578270', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578009', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577743', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577657', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577525', None, None, None, None, None, '2503008') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 483 time used for this insertion : 0.05617666244506836 save_final save missing photos in datou_result : time spend for datou_step_exec : 80.52935147285461 time spend to save output : 0.06075239181518555 total time spend for step 2 : 80.5901038646698 step3:thcl Thu Feb 6 17:11:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! nombre de thcls : 2 we are using the classfication for multi_thcl [2456, 2868] time to import caffe and check if the image exist : 0.019425153732299805 time to convert the images to numpy array : 0.155853271484375 time to import caffe and check if the image exist : 0.014992952346801758 time to convert the images to numpy array : 0.19496941566467285 time to import caffe and check if the image exist : 0.024048805236816406 time to convert the images to numpy array : 0.21657872200012207 time to import caffe and check if the image exist : 0.019616127014160156 time to convert the images to numpy array : 0.22736263275146484 time to import caffe and check if the image exist : 0.00970458984375 time to convert the images to numpy array : 0.238663911819458 time to import caffe and check if the image exist : 0.01378488540649414 time to convert the images to numpy array : 0.2481846809387207 time to import caffe and check if the image exist : 0.01461172103881836 time to convert the images to numpy array : 0.2526414394378662 time to import caffe and check if the image exist : 0.017386674880981445 time to convert the images to numpy array : 0.2718970775604248 time to import caffe and check if the image exist : 0.017156362533569336 time to convert the images to numpy array : 0.2844533920288086 time to import caffe and check if the image exist : 0.012077808380126953 time to convert the images to numpy array : 0.2969086170196533 total time to convert the images to numpy array : 0.5070245265960693 list photo_ids error: [] list photo_ids correct : [-3651747978, -3657892389, -3651747989, -3651747988, -3651747987, -3651748021, -3651748040, -3651748049, -3651748048, -3651748046, -3651748039, -3651748059, -3651748057, -3651748074, -3651748078, -3651681640, -3651748042, -3651748047, -3651748066, -3651748069, -3651748071, -3651748068, -3651681666, -3657892370, -3657892362, -3651681712, -3651681727, -3651681786, -3657892393, -3651748043, -3651681631, -3651681635, -3651681731, -3651681730, -3651681735, -3651681754, -3651681746, -3651681744, -3651681747, -3651681742, -3651681741, -3651681740, -3651681752, -3651681763, -3651681760, -3651681768, -3651681784, -3651681781, -3651681658, -3651681664, -3651681672, -3651681673, -3651681665, -3651681659, -3651681670, -3651681667, -3651681662, -3651681657, -3657892383, -3657892376, -3657892367, -3657892363, -3657892364, -3657892380, -3657892361, -3657892384, -3651681766, -3651681777, -3651681794, -3651748004, -3651748003, -3657892396, -3651748032, -3651748033, -3651748037, -3651748036, -3651748060, -3651748053, -3651748058, -3651748061, -3651748077, -3651748067, -3651681674, -3651681719, -3651681771, -3651681770, -3651681789, -3651748015, -3651748075, -3651748079, -3651681639, -3651681633, -3651681641, -3651681642, -3651681627, -3651681648, -3657892365, -3657892378, -3657892374, -3657892382, -3657892375, -3651681711, -3651681704, -3651681718, -3651681700, -3651681706, -3651681708, -3651681714, -3651681725, -3651681729, -3651681732, -3651681722, -3651681637, -3651681638, -3651681668, -3651681652, -3657892373, -3657892369, -3657892368, -3651681702, -3651681707, -3657892386, -3651681721, -3651681743, -3651681750, -3651681757, -3651681756, -3651681791, -3651681775, -3657892387, -3651681782, -3651681792, -3651681793, -3657892390, -3651747992, -3651747994, -3651747998, -3651748001, -3651748008, -3651748035, -3651748024, -3651748030, -3651748025, -3651748029, -3657892366, -3651681710, -3657892385, -3657892388, -3651681788, -3651681800, -3651748009, -3651748038, -3651748076, -3651748073, -3651681738] number of photos to traite : 155 try to delete the photos incorrect in DB tagging for thcl : 2456 To do loadFromThcl(), then load ParamDescType : thcl2456 thcls : [{'id': 2456, 'mtr_user_id': 31, 'name': 'learn_qualipapia_papier_refus_from_vlg_data_aug', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'papier,refus', 'svm_portfolios_learning': '3028087,3028251', 'photo_hashtag_type': 3049, 'photo_desc_type': 4999, 'type_classification': 'caffe', 'hashtag_id_list': '492668766,538914404'}] thcl {'id': 2456, 'mtr_user_id': 31, 'name': 'learn_qualipapia_papier_refus_from_vlg_data_aug', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'papier,refus', 'svm_portfolios_learning': '3028087,3028251', 'photo_hashtag_type': 3049, 'photo_desc_type': 4999, 'type_classification': 'caffe', 'hashtag_id_list': '492668766,538914404'} Update svm_hashtag_type_desc : 4999 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (4999, 'learn_qualipapia_papier_refus_from_vlg_data_aug', 16384, 25088, 'learn_qualipapia_papier_refus_from_vlg_data_aug', 'res5b', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2020, 10, 23, 14, 27, 22), datetime.datetime(2020, 10, 23, 14, 27, 22)) To loadFromThcl() : net_4999 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (4999, 'learn_qualipapia_papier_refus_from_vlg_data_aug', 16384, 25088, 'learn_qualipapia_papier_refus_from_vlg_data_aug', 'res5b', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2020, 10, 23, 14, 27, 22), datetime.datetime(2020, 10, 23, 14, 27, 22)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_qualipapia_papier_refus_from_vlg_data_aug Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_qualipapia_papier_refus_from_vlg_data_aug model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/caffemodel size_local : 44972172 size in s3 : 44972172 create time local : 2021-08-09 05:55:48 create time in s3 : 2021-08-06 19:28:49 caffemodel already exist and didn't need to update /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/deploy.prototxt size_local : 17311 size in s3 : 17311 create time local : 2021-08-09 05:55:48 create time in s3 : 2021-08-06 19:28:49 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-08-09 05:55:48 create time in s3 : 2021-08-06 19:28:51 mean.npy already exist and didn't need to update /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/synset_words.txt size_local : 57 size in s3 : 57 create time local : 2021-08-09 05:55:48 create time in s3 : 2021-08-06 19:28:49 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/:/home/admin/workarea/git/apy/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/deploy.prototxt caffemodel_filename : /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10776 max_wait_temp : 1 max_wait : 0 dict_keys(['prob']) time used to do the prepocess of the images : 2.244976758956909 time used to do the prediction : 0.3079531192779541 we don't save the descriptors for this thcl 2456 tagging for thcl : 2868 To do loadFromThcl(), then load ParamDescType : thcl2868 thcls : [{'id': 2868, 'mtr_user_id': 31, 'name': 'learn_papier_nantes_300421', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,environnement,kraft,metal,papier,plastique', 'svm_portfolios_learning': '3752117,3752118,3752123,3752106,3752116,3752124,3752119,3581575,3486029,3752122', 'photo_hashtag_type': 3632, 'photo_desc_type': 5288, 'type_classification': 'caffe', 'hashtag_id_list': '2107753024,2107753020,2107752385,2107752406,702398920,493012381,493202403,492628673,492668766,492725882'}] thcl {'id': 2868, 'mtr_user_id': 31, 'name': 'learn_papier_nantes_300421', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,environnement,kraft,metal,papier,plastique', 'svm_portfolios_learning': '3752117,3752118,3752123,3752106,3752116,3752124,3752119,3581575,3486029,3752122', 'photo_hashtag_type': 3632, 'photo_desc_type': 5288, 'type_classification': 'caffe', 'hashtag_id_list': '2107753024,2107753020,2107752385,2107752406,702398920,493012381,493202403,492628673,492668766,492725882'} Update svm_hashtag_type_desc : 5288 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5288, 'learn_papier_nantes_300421', 512, 512, 'learn_papier_nantes_300421', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 30, 17, 9, 41), datetime.datetime(2021, 4, 30, 17, 9, 41)) To loadFromThcl() : net_5288 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5288, 'learn_papier_nantes_300421', 512, 512, 'learn_papier_nantes_300421', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 30, 17, 9, 41), datetime.datetime(2021, 4, 30, 17, 9, 41)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_papier_nantes_300421 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_papier_nantes_300421 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_papier_nantes_300421 /data/models_weight/learn_papier_nantes_300421/caffemodel size_local : 44791983 size in s3 : 44791983 create time local : 2021-08-09 05:55:59 create time in s3 : 2021-08-06 19:22:13 caffemodel already exist and didn't need to update /data/models_weight/learn_papier_nantes_300421/deploy.prototxt size_local : 17255 size in s3 : 17255 create time local : 2021-08-09 05:55:59 create time in s3 : 2021-08-06 19:22:12 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_papier_nantes_300421/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-08-09 05:55:59 create time in s3 : 2021-08-06 19:22:14 mean.npy already exist and didn't need to update /data/models_weight/learn_papier_nantes_300421/synset_words.txt size_local : 331 size in s3 : 331 create time local : 2021-08-09 05:56:00 create time in s3 : 2021-08-06 19:22:12 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/:/home/admin/workarea/git/apy/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_papier_nantes_300421/deploy.prototxt caffemodel_filename : /data/models_weight/learn_papier_nantes_300421/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 dict_keys(['prob']) time used to do the prepocess of the images : 2.128723621368408 time used to do the prediction : 0.26340198516845703 we don't save the descriptors for this thcl 2868 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos test new format of the output of the step_thcl begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 0 time used for this insertion : 5.7220458984375e-06 save missing photos in datou_result : time spend for datou_step_exec : 12.551591396331787 time spend to save output : 0.001079559326171875 total time spend for step 3 : 12.552670955657959 step4:merge_mask_thcl_custom Thu Feb 6 17:11:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step merge_mask_thcl_custom batch 1 Loaded 321 chid ids of type : 3663 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++As expected we have just one thcl present End of step merge_mask_thcl_custom Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : merge_mask_thcl_custom we use saveGeneral [1330579442, 1330579438, 1330579432, 1330579401, 1330579193, 1330579061, 1330578845, 1330578824, 1330578718, 1330578675, 1330578670, 1330578664, 1330578544, 1330578270, 1330578009, 1330577743, 1330577657, 1330577525] Looping around the photos to save general results len do output : 18 /1330579442Didn't retrieve data .Didn't retrieve data . /1330579438Didn't retrieve data .Didn't retrieve data . /1330579432Didn't retrieve data .Didn't retrieve data . /1330579401Didn't retrieve data .Didn't retrieve data . /1330579193Didn't retrieve data .Didn't retrieve data . /1330579061Didn't retrieve data .Didn't retrieve data . /1330578845Didn't retrieve data .Didn't retrieve data . /1330578824Didn't retrieve data .Didn't retrieve data . /1330578718Didn't retrieve data .Didn't retrieve data . /1330578675Didn't retrieve data .Didn't retrieve data . /1330578670Didn't retrieve data .Didn't retrieve data . /1330578664Didn't retrieve data .Didn't retrieve data . /1330578544Didn't retrieve data .Didn't retrieve data . /1330578270Didn't retrieve data .Didn't retrieve data . /1330578009Didn't retrieve data .Didn't retrieve data . /1330577743Didn't retrieve data .Didn't retrieve data . /1330577657Didn't retrieve data .Didn't retrieve data . /1330577525Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579442', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579438', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579432', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579401', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579193', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579061', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578845', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578824', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578718', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578675', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578670', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578664', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578544', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578270', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578009', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577743', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577657', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577525', None, None, None, None, None, '2503008') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 54 time used for this insertion : 0.020891904830932617 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.08173990249633789 time spend to save output : 0.02171945571899414 total time spend for step 4 : 0.10345935821533203 step5:rle_unique_nms_with_priority Thu Feb 6 17:11:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms nb_obj : 21 nb_hashtags : 5 time to prepare the origin masks : 11.478959560394287 time for calcul the mask position with numpy : 0.27602577209472656 nb_pixel_total : 6611094 time to create 1 rle with new method : 0.5410478115081787 time for calcul the mask position with numpy : 0.019800424575805664 nb_pixel_total : 13143 time to create 1 rle with old method : 0.01395726203918457 time for calcul the mask position with numpy : 0.020830869674682617 nb_pixel_total : 24314 time to create 1 rle with old method : 0.026510238647460938 time for calcul the mask position with numpy : 0.02187347412109375 nb_pixel_total : 2436 time to create 1 rle with old method : 0.0037674903869628906 time for calcul the mask position with numpy : 0.021076440811157227 nb_pixel_total : 19788 time to create 1 rle with old method : 0.021207094192504883 time for calcul the mask position with numpy : 0.02092123031616211 nb_pixel_total : 13 time to create 1 rle with old method : 5.316734313964844e-05 time for calcul the mask position with numpy : 0.022706985473632812 nb_pixel_total : 17393 time to create 1 rle with old method : 0.018084287643432617 time for calcul the mask position with numpy : 0.021302223205566406 nb_pixel_total : 50118 time to create 1 rle with old method : 0.05368161201477051 time for calcul the mask position with numpy : 0.02301335334777832 nb_pixel_total : 4017 time to create 1 rle with old method : 0.004389047622680664 time for calcul the mask position with numpy : 0.022446870803833008 nb_pixel_total : 95051 time to create 1 rle with old method : 0.10087442398071289 time for calcul the mask position with numpy : 0.021706819534301758 nb_pixel_total : 338 time to create 1 rle with old method : 0.0007543563842773438 time for calcul the mask position with numpy : 0.021292448043823242 nb_pixel_total : 19716 time to create 1 rle with old method : 0.022567033767700195 time for calcul the mask position with numpy : 0.020864248275756836 nb_pixel_total : 3140 time to create 1 rle with old method : 0.003497600555419922 time for calcul the mask position with numpy : 0.020525693893432617 nb_pixel_total : 4746 time to create 1 rle with old method : 0.004927158355712891 time for calcul the mask position with numpy : 0.021788358688354492 nb_pixel_total : 4724 time to create 1 rle with old method : 0.005054473876953125 time for calcul the mask position with numpy : 0.02191448211669922 nb_pixel_total : 116692 time to create 1 rle with old method : 0.12247681617736816 time for calcul the mask position with numpy : 0.021452665328979492 nb_pixel_total : 3200 time to create 1 rle with old method : 0.0035555362701416016 time for calcul the mask position with numpy : 0.02396249771118164 nb_pixel_total : 1962 time to create 1 rle with old method : 0.0023415088653564453 time for calcul the mask position with numpy : 0.021097898483276367 nb_pixel_total : 929 time to create 1 rle with old method : 0.0011074542999267578 time for calcul the mask position with numpy : 0.023324251174926758 nb_pixel_total : 43134 time to create 1 rle with old method : 0.04818606376647949 time for calcul the mask position with numpy : 0.024059295654296875 nb_pixel_total : 12562 time to create 1 rle with old method : 0.013702154159545898 time for calcul the mask position with numpy : 0.026868581771850586 nb_pixel_total : 1730 time to create 1 rle with old method : 0.0020596981048583984 create new chi : 1.7796874046325684 time to delete rle : 0.010799646377563477 batch 1 Loaded 22 chid ids of type : 3726 Number RLEs to save : 9429 TO DO : save crop sub photo not yet done ! save time : 0.5406754016876221 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 5.255953311920166 time for calcul the mask position with numpy : 0.27935791015625 nb_pixel_total : 4664643 time to create 1 rle with new method : 0.3932485580444336 time for calcul the mask position with numpy : 0.020525217056274414 nb_pixel_total : 12062 time to create 1 rle with old method : 0.013231754302978516 time for calcul the mask position with numpy : 0.030210256576538086 nb_pixel_total : 590380 time to create 1 rle with new method : 0.5928845405578613 time for calcul the mask position with numpy : 0.0356593132019043 nb_pixel_total : 1881 time to create 1 rle with old method : 0.002207517623901367 time for calcul the mask position with numpy : 0.037915945053100586 nb_pixel_total : 192722 time to create 1 rle with new method : 1.2447493076324463 time for calcul the mask position with numpy : 0.030582427978515625 nb_pixel_total : 1640 time to create 1 rle with old method : 0.0019145011901855469 time for calcul the mask position with numpy : 0.026906728744506836 nb_pixel_total : 5136 time to create 1 rle with old method : 0.007698535919189453 time for calcul the mask position with numpy : 0.046051025390625 nb_pixel_total : 1569956 time to create 1 rle with new method : 0.4446263313293457 time for calcul the mask position with numpy : 0.029883861541748047 nb_pixel_total : 11820 time to create 1 rle with old method : 0.013152360916137695 create new chi : 3.3679261207580566 time to delete rle : 0.0017054080963134766 batch 1 Loaded 9 chid ids of type : 3726 Number RLEs to save : 14446 TO DO : save crop sub photo not yet done ! save time : 0.8056447505950928 nb_obj : 24 nb_hashtags : 7 time to prepare the origin masks : 11.998893737792969 time for calcul the mask position with numpy : 0.36554408073425293 nb_pixel_total : 5974069 time to create 1 rle with new method : 0.954336404800415 time for calcul the mask position with numpy : 0.023641109466552734 nb_pixel_total : 307612 time to create 1 rle with new method : 0.6059958934783936 time for calcul the mask position with numpy : 0.021372079849243164 nb_pixel_total : 671 time to create 1 rle with old method : 0.0012350082397460938 time for calcul the mask position with numpy : 0.03175473213195801 nb_pixel_total : 71887 time to create 1 rle with old method : 0.08162188529968262 time for calcul the mask position with numpy : 0.036390066146850586 nb_pixel_total : 21839 time to create 1 rle with old method : 0.024109601974487305 time for calcul the mask position with numpy : 0.03865671157836914 nb_pixel_total : 24749 time to create 1 rle with old method : 0.02743816375732422 time for calcul the mask position with numpy : 0.034969329833984375 nb_pixel_total : 794 time to create 1 rle with old method : 0.0009765625 time for calcul the mask position with numpy : 0.03857779502868652 nb_pixel_total : 14864 time to create 1 rle with old method : 0.02023005485534668 time for calcul the mask position with numpy : 0.03595876693725586 nb_pixel_total : 114224 time to create 1 rle with old method : 0.12520527839660645 time for calcul the mask position with numpy : 0.03502011299133301 nb_pixel_total : 2884 time to create 1 rle with old method : 0.0032279491424560547 time for calcul the mask position with numpy : 0.03663229942321777 nb_pixel_total : 104020 time to create 1 rle with old method : 0.13508296012878418 time for calcul the mask position with numpy : 0.03532266616821289 nb_pixel_total : 70964 time to create 1 rle with old method : 0.0791013240814209 time for calcul the mask position with numpy : 0.036290645599365234 nb_pixel_total : 5628 time to create 1 rle with old method : 0.006565093994140625 time for calcul the mask position with numpy : 0.03441190719604492 nb_pixel_total : 6753 time to create 1 rle with old method : 0.007949352264404297 time for calcul the mask position with numpy : 0.03436565399169922 nb_pixel_total : 2167 time to create 1 rle with old method : 0.0024924278259277344 time for calcul the mask position with numpy : 0.03429913520812988 nb_pixel_total : 1516 time to create 1 rle with old method : 0.0016314983367919922 time for calcul the mask position with numpy : 0.034020185470581055 nb_pixel_total : 71704 time to create 1 rle with old method : 0.07532167434692383 time for calcul the mask position with numpy : 0.0352938175201416 nb_pixel_total : 112665 time to create 1 rle with old method : 0.12827587127685547 time for calcul the mask position with numpy : 0.03937125205993652 nb_pixel_total : 20608 time to create 1 rle with old method : 0.026764631271362305 time for calcul the mask position with numpy : 0.0337061882019043 nb_pixel_total : 2689 time to create 1 rle with old method : 0.002982616424560547 time for calcul the mask position with numpy : 0.03950047492980957 nb_pixel_total : 2602 time to create 1 rle with old method : 0.0031585693359375 time for calcul the mask position with numpy : 0.03498649597167969 nb_pixel_total : 73964 time to create 1 rle with old method : 0.08063292503356934 time for calcul the mask position with numpy : 0.034093618392944336 nb_pixel_total : 13534 time to create 1 rle with old method : 0.01554417610168457 time for calcul the mask position with numpy : 0.03431224822998047 nb_pixel_total : 18840 time to create 1 rle with old method : 0.020038127899169922 time for calcul the mask position with numpy : 0.03384685516357422 nb_pixel_total : 8993 time to create 1 rle with old method : 0.010321855545043945 create new chi : 3.6989078521728516 time to delete rle : 0.0018129348754882812 batch 1 Loaded 26 chid ids of type : 3726 Number RLEs to save : 16185 TO DO : save crop sub photo not yet done ! save time : 0.8986711502075195 nb_obj : 28 nb_hashtags : 5 time to prepare the origin masks : 11.114958763122559 time for calcul the mask position with numpy : 0.07509422302246094 nb_pixel_total : 5729835 time to create 1 rle with new method : 0.1376817226409912 time for calcul the mask position with numpy : 0.028673648834228516 nb_pixel_total : 79787 time to create 1 rle with old method : 0.08322334289550781 time for calcul the mask position with numpy : 0.02728748321533203 nb_pixel_total : 5051 time to create 1 rle with old method : 0.005789756774902344 time for calcul the mask position with numpy : 0.027623891830444336 nb_pixel_total : 27214 time to create 1 rle with old method : 0.04336905479431152 time for calcul the mask position with numpy : 0.0327610969543457 nb_pixel_total : 1987 time to create 1 rle with old method : 0.003041982650756836 time for calcul the mask position with numpy : 0.02777862548828125 nb_pixel_total : 16480 time to create 1 rle with old method : 0.01765727996826172 time for calcul the mask position with numpy : 0.029328346252441406 nb_pixel_total : 119903 time to create 1 rle with old method : 0.1252884864807129 time for calcul the mask position with numpy : 0.02791738510131836 nb_pixel_total : 2285 time to create 1 rle with old method : 0.0025360584259033203 time for calcul the mask position with numpy : 0.028714418411254883 nb_pixel_total : 64594 time to create 1 rle with old method : 0.06785225868225098 time for calcul the mask position with numpy : 0.028457164764404297 nb_pixel_total : 2425 time to create 1 rle with old method : 0.002649545669555664 time for calcul the mask position with numpy : 0.028120994567871094 nb_pixel_total : 3648 time to create 1 rle with old method : 0.00417327880859375 time for calcul the mask position with numpy : 0.028870582580566406 nb_pixel_total : 27372 time to create 1 rle with old method : 0.028326034545898438 time for calcul the mask position with numpy : 0.028046846389770508 nb_pixel_total : 19520 time to create 1 rle with old method : 0.02248835563659668 time for calcul the mask position with numpy : 0.03346896171569824 nb_pixel_total : 449084 time to create 1 rle with new method : 0.12919974327087402 time for calcul the mask position with numpy : 0.028786182403564453 nb_pixel_total : 4333 time to create 1 rle with old method : 0.005061149597167969 time for calcul the mask position with numpy : 0.027341127395629883 nb_pixel_total : 1391 time to create 1 rle with old method : 0.0017464160919189453 time for calcul the mask position with numpy : 0.028368234634399414 nb_pixel_total : 19618 time to create 1 rle with old method : 0.02059459686279297 time for calcul the mask position with numpy : 0.02777862548828125 nb_pixel_total : 2651 time to create 1 rle with old method : 0.003340005874633789 time for calcul the mask position with numpy : 0.027753829956054688 nb_pixel_total : 367 time to create 1 rle with old method : 0.0005333423614501953 time for calcul the mask position with numpy : 0.0279388427734375 nb_pixel_total : 246 time to create 1 rle with old method : 0.0003261566162109375 time for calcul the mask position with numpy : 0.02984929084777832 nb_pixel_total : 272970 time to create 1 rle with new method : 0.12597441673278809 time for calcul the mask position with numpy : 0.027435302734375 nb_pixel_total : 9478 time to create 1 rle with old method : 0.010801553726196289 time for calcul the mask position with numpy : 0.02771162986755371 nb_pixel_total : 16865 time to create 1 rle with old method : 0.01766204833984375 time for calcul the mask position with numpy : 0.028090715408325195 nb_pixel_total : 107413 time to create 1 rle with old method : 0.10994958877563477 time for calcul the mask position with numpy : 0.026955842971801758 nb_pixel_total : 6693 time to create 1 rle with old method : 0.007428884506225586 time for calcul the mask position with numpy : 0.030052661895751953 nb_pixel_total : 14320 time to create 1 rle with old method : 0.015027284622192383 time for calcul the mask position with numpy : 0.02721428871154785 nb_pixel_total : 6194 time to create 1 rle with old method : 0.006776332855224609 time for calcul the mask position with numpy : 0.027446985244750977 nb_pixel_total : 36215 time to create 1 rle with old method : 0.036969661712646484 time for calcul the mask position with numpy : 0.026788711547851562 nb_pixel_total : 2301 time to create 1 rle with old method : 0.0025224685668945312 create new chi : 1.9536867141723633 time to delete rle : 0.0018613338470458984 batch 1 Loaded 42 chid ids of type : 3726 Number RLEs to save : 16912 TO DO : save crop sub photo not yet done ! save time : 0.926905632019043 nb_obj : 19 nb_hashtags : 7 time to prepare the origin masks : 9.941255331039429 time for calcul the mask position with numpy : 0.3772470951080322 nb_pixel_total : 5623056 time to create 1 rle with new method : 0.7911224365234375 time for calcul the mask position with numpy : 0.020765304565429688 nb_pixel_total : 11910 time to create 1 rle with old method : 0.01533818244934082 time for calcul the mask position with numpy : 0.022694826126098633 nb_pixel_total : 247189 time to create 1 rle with new method : 0.5952908992767334 time for calcul the mask position with numpy : 0.021782398223876953 nb_pixel_total : 16464 time to create 1 rle with old method : 0.018507003784179688 time for calcul the mask position with numpy : 0.02507638931274414 nb_pixel_total : 3513 time to create 1 rle with old method : 0.004635334014892578 time for calcul the mask position with numpy : 0.030118465423583984 nb_pixel_total : 2300 time to create 1 rle with old method : 0.003018617630004883 time for calcul the mask position with numpy : 0.03749585151672363 nb_pixel_total : 96062 time to create 1 rle with old method : 0.10345983505249023 time for calcul the mask position with numpy : 0.038524627685546875 nb_pixel_total : 14612 time to create 1 rle with old method : 0.016427278518676758 time for calcul the mask position with numpy : 0.0352931022644043 nb_pixel_total : 20391 time to create 1 rle with old method : 0.02515125274658203 time for calcul the mask position with numpy : 0.037893056869506836 nb_pixel_total : 6022 time to create 1 rle with old method : 0.009772777557373047 time for calcul the mask position with numpy : 0.043833255767822266 nb_pixel_total : 217896 time to create 1 rle with new method : 0.6701116561889648 time for calcul the mask position with numpy : 0.036380767822265625 nb_pixel_total : 2445 time to create 1 rle with old method : 0.0029327869415283203 time for calcul the mask position with numpy : 0.03533649444580078 nb_pixel_total : 2189 time to create 1 rle with old method : 0.002406597137451172 time for calcul the mask position with numpy : 0.03423905372619629 nb_pixel_total : 19040 time to create 1 rle with old method : 0.020738601684570312 time for calcul the mask position with numpy : 0.03428506851196289 nb_pixel_total : 4043 time to create 1 rle with old method : 0.004584550857543945 time for calcul the mask position with numpy : 0.03496146202087402 nb_pixel_total : 22010 time to create 1 rle with old method : 0.02395033836364746 time for calcul the mask position with numpy : 0.037096261978149414 nb_pixel_total : 399483 time to create 1 rle with new method : 0.48401546478271484 time for calcul the mask position with numpy : 0.039307594299316406 nb_pixel_total : 139276 time to create 1 rle with old method : 0.15027403831481934 time for calcul the mask position with numpy : 0.03726601600646973 nb_pixel_total : 157016 time to create 1 rle with new method : 0.48885655403137207 time for calcul the mask position with numpy : 0.035964250564575195 nb_pixel_total : 45323 time to create 1 rle with old method : 0.05634188652038574 create new chi : 4.645160675048828 time to delete rle : 0.002729654312133789 batch 1 Loaded 20 chid ids of type : 3726 Number RLEs to save : 15234 TO DO : save crop sub photo not yet done ! save time : 0.833838701248169 nb_obj : 19 nb_hashtags : 7 time to prepare the origin masks : 11.186224699020386 time for calcul the mask position with numpy : 0.40009546279907227 nb_pixel_total : 5648931 time to create 1 rle with new method : 0.7673828601837158 time for calcul the mask position with numpy : 0.0331273078918457 nb_pixel_total : 1786 time to create 1 rle with old method : 0.0027239322662353516 time for calcul the mask position with numpy : 0.033082008361816406 nb_pixel_total : 98042 time to create 1 rle with old method : 0.10080528259277344 time for calcul the mask position with numpy : 0.03882312774658203 nb_pixel_total : 8524 time to create 1 rle with old method : 0.009701251983642578 time for calcul the mask position with numpy : 0.045575618743896484 nb_pixel_total : 1505 time to create 1 rle with old method : 0.001772165298461914 time for calcul the mask position with numpy : 0.045182228088378906 nb_pixel_total : 19858 time to create 1 rle with old method : 0.020775556564331055 time for calcul the mask position with numpy : 0.04272007942199707 nb_pixel_total : 2774 time to create 1 rle with old method : 0.0030829906463623047 time for calcul the mask position with numpy : 0.03826332092285156 nb_pixel_total : 157684 time to create 1 rle with new method : 0.45617127418518066 time for calcul the mask position with numpy : 0.03858828544616699 nb_pixel_total : 3358 time to create 1 rle with old method : 0.0036630630493164062 time for calcul the mask position with numpy : 0.04021954536437988 nb_pixel_total : 248271 time to create 1 rle with new method : 0.3938910961151123 time for calcul the mask position with numpy : 0.04098987579345703 nb_pixel_total : 20763 time to create 1 rle with old method : 0.02816152572631836 time for calcul the mask position with numpy : 0.040952205657958984 nb_pixel_total : 70037 time to create 1 rle with old method : 0.07393455505371094 time for calcul the mask position with numpy : 0.03566384315490723 nb_pixel_total : 50489 time to create 1 rle with old method : 0.05358242988586426 time for calcul the mask position with numpy : 0.03468036651611328 nb_pixel_total : 4812 time to create 1 rle with old method : 0.005235195159912109 time for calcul the mask position with numpy : 0.03467226028442383 nb_pixel_total : 2651 time to create 1 rle with old method : 0.003061056137084961 time for calcul the mask position with numpy : 0.035628318786621094 nb_pixel_total : 126536 time to create 1 rle with old method : 0.13979053497314453 time for calcul the mask position with numpy : 0.036627769470214844 nb_pixel_total : 927 time to create 1 rle with old method : 0.0015943050384521484 time for calcul the mask position with numpy : 0.04679536819458008 nb_pixel_total : 406132 time to create 1 rle with new method : 1.1819570064544678 time for calcul the mask position with numpy : 0.02508091926574707 nb_pixel_total : 155482 time to create 1 rle with new method : 0.38893914222717285 time for calcul the mask position with numpy : 0.02451944351196289 nb_pixel_total : 21678 time to create 1 rle with old method : 0.02294158935546875 create new chi : 4.920658349990845 time to delete rle : 0.0016775131225585938 batch 1 Loaded 22 chid ids of type : 3726 Number RLEs to save : 14008 TO DO : save crop sub photo not yet done ! save time : 0.7984638214111328 nb_obj : 16 nb_hashtags : 7 time to prepare the origin masks : 7.264245986938477 time for calcul the mask position with numpy : 0.25879573822021484 nb_pixel_total : 6357209 time to create 1 rle with new method : 0.4810359477996826 time for calcul the mask position with numpy : 0.020479202270507812 nb_pixel_total : 16897 time to create 1 rle with old method : 0.017608165740966797 time for calcul the mask position with numpy : 0.020592927932739258 nb_pixel_total : 26613 time to create 1 rle with old method : 0.02801060676574707 time for calcul the mask position with numpy : 0.02409982681274414 nb_pixel_total : 445812 time to create 1 rle with new method : 0.5215492248535156 time for calcul the mask position with numpy : 0.02144479751586914 nb_pixel_total : 18789 time to create 1 rle with old method : 0.020279645919799805 time for calcul the mask position with numpy : 0.02168869972229004 nb_pixel_total : 4162 time to create 1 rle with old method : 0.004849910736083984 time for calcul the mask position with numpy : 0.021561861038208008 nb_pixel_total : 7944 time to create 1 rle with old method : 0.009039640426635742 time for calcul the mask position with numpy : 0.022420406341552734 nb_pixel_total : 1686 time to create 1 rle with old method : 0.0020046234130859375 time for calcul the mask position with numpy : 0.022205829620361328 nb_pixel_total : 10595 time to create 1 rle with old method : 0.011891365051269531 time for calcul the mask position with numpy : 0.022928714752197266 nb_pixel_total : 3417 time to create 1 rle with old method : 0.003974199295043945 time for calcul the mask position with numpy : 0.029515981674194336 nb_pixel_total : 11626 time to create 1 rle with old method : 0.012777090072631836 time for calcul the mask position with numpy : 0.022526979446411133 nb_pixel_total : 1 time to create 1 rle with old method : 2.1219253540039062e-05 time for calcul the mask position with numpy : 0.02227044105529785 nb_pixel_total : 24022 time to create 1 rle with old method : 0.030198335647583008 time for calcul the mask position with numpy : 0.03549671173095703 nb_pixel_total : 2151 time to create 1 rle with old method : 0.0025169849395751953 time for calcul the mask position with numpy : 0.03559160232543945 nb_pixel_total : 17744 time to create 1 rle with old method : 0.019216060638427734 time for calcul the mask position with numpy : 0.0372776985168457 nb_pixel_total : 45152 time to create 1 rle with old method : 0.04879498481750488 time for calcul the mask position with numpy : 0.03306913375854492 nb_pixel_total : 56420 time to create 1 rle with old method : 0.061602115631103516 create new chi : 2.0198187828063965 time to delete rle : 0.0009937286376953125 batch 1 Loaded 17 chid ids of type : 3726 Number RLEs to save : 9368 TO DO : save crop sub photo not yet done ! save time : 0.5237836837768555 nb_obj : 11 nb_hashtags : 5 time to prepare the origin masks : 5.46034574508667 time for calcul the mask position with numpy : 0.3312234878540039 nb_pixel_total : 6335822 time to create 1 rle with new method : 0.7460274696350098 time for calcul the mask position with numpy : 0.02278304100036621 nb_pixel_total : 67891 time to create 1 rle with old method : 0.07406163215637207 time for calcul the mask position with numpy : 0.0206301212310791 nb_pixel_total : 12375 time to create 1 rle with old method : 0.01367640495300293 time for calcul the mask position with numpy : 0.021708250045776367 nb_pixel_total : 2177 time to create 1 rle with old method : 0.002368450164794922 time for calcul the mask position with numpy : 0.022538423538208008 nb_pixel_total : 346433 time to create 1 rle with new method : 0.7219278812408447 time for calcul the mask position with numpy : 0.02191638946533203 nb_pixel_total : 26133 time to create 1 rle with old method : 0.028733491897583008 time for calcul the mask position with numpy : 0.021220922470092773 nb_pixel_total : 41023 time to create 1 rle with old method : 0.04402971267700195 time for calcul the mask position with numpy : 0.021628379821777344 nb_pixel_total : 10784 time to create 1 rle with old method : 0.012162208557128906 time for calcul the mask position with numpy : 0.02212667465209961 nb_pixel_total : 96518 time to create 1 rle with old method : 0.10266685485839844 time for calcul the mask position with numpy : 0.02150750160217285 nb_pixel_total : 9346 time to create 1 rle with old method : 0.011308670043945312 time for calcul the mask position with numpy : 0.022312641143798828 nb_pixel_total : 20135 time to create 1 rle with old method : 0.022989511489868164 time for calcul the mask position with numpy : 0.022378206253051758 nb_pixel_total : 81603 time to create 1 rle with old method : 0.0871126651763916 create new chi : 2.512937068939209 time to delete rle : 0.000820159912109375 batch 1 Loaded 12 chid ids of type : 3726 Number RLEs to save : 8204 TO DO : save crop sub photo not yet done ! save time : 0.45075559616088867 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 8.096108675003052 time for calcul the mask position with numpy : 0.2840731143951416 nb_pixel_total : 6225604 time to create 1 rle with new method : 0.5374424457550049 time for calcul the mask position with numpy : 0.0212249755859375 nb_pixel_total : 50644 time to create 1 rle with old method : 0.055027008056640625 time for calcul the mask position with numpy : 0.026122093200683594 nb_pixel_total : 32747 time to create 1 rle with old method : 0.03531956672668457 time for calcul the mask position with numpy : 0.02239680290222168 nb_pixel_total : 67939 time to create 1 rle with old method : 0.07634496688842773 time for calcul the mask position with numpy : 0.024820804595947266 nb_pixel_total : 162878 time to create 1 rle with new method : 0.47382211685180664 time for calcul the mask position with numpy : 0.02179741859436035 nb_pixel_total : 161364 time to create 1 rle with new method : 0.7314479351043701 time for calcul the mask position with numpy : 0.025650978088378906 nb_pixel_total : 33539 time to create 1 rle with old method : 0.03698086738586426 time for calcul the mask position with numpy : 0.022709131240844727 nb_pixel_total : 4918 time to create 1 rle with old method : 0.007958650588989258 time for calcul the mask position with numpy : 0.023311614990234375 nb_pixel_total : 5212 time to create 1 rle with old method : 0.008399248123168945 time for calcul the mask position with numpy : 0.023806095123291016 nb_pixel_total : 109595 time to create 1 rle with old method : 0.14594578742980957 time for calcul the mask position with numpy : 0.023844242095947266 nb_pixel_total : 5217 time to create 1 rle with old method : 0.005646467208862305 time for calcul the mask position with numpy : 0.020627260208129883 nb_pixel_total : 2150 time to create 1 rle with old method : 0.0024900436401367188 time for calcul the mask position with numpy : 0.021390438079833984 nb_pixel_total : 7887 time to create 1 rle with old method : 0.008661031723022461 time for calcul the mask position with numpy : 0.026032209396362305 nb_pixel_total : 8186 time to create 1 rle with old method : 0.00926351547241211 time for calcul the mask position with numpy : 0.02448296546936035 nb_pixel_total : 10536 time to create 1 rle with old method : 0.011680126190185547 time for calcul the mask position with numpy : 0.021424531936645508 nb_pixel_total : 1765 time to create 1 rle with old method : 0.0020956993103027344 time for calcul the mask position with numpy : 0.03336691856384277 nb_pixel_total : 160059 time to create 1 rle with new method : 0.32817864418029785 create new chi : 3.254051446914673 time to delete rle : 0.0016264915466308594 batch 1 Loaded 18 chid ids of type : 3726 Number RLEs to save : 10542 TO DO : save crop sub photo not yet done ! save time : 0.6048858165740967 nb_obj : 14 nb_hashtags : 5 time to prepare the origin masks : 7.3104541301727295 time for calcul the mask position with numpy : 0.40143752098083496 nb_pixel_total : 6216321 time to create 1 rle with new method : 0.7924888134002686 time for calcul the mask position with numpy : 0.02119755744934082 nb_pixel_total : 30021 time to create 1 rle with old method : 0.03786468505859375 time for calcul the mask position with numpy : 0.02311253547668457 nb_pixel_total : 5536 time to create 1 rle with old method : 0.008363008499145508 time for calcul the mask position with numpy : 0.022783517837524414 nb_pixel_total : 14847 time to create 1 rle with old method : 0.021409988403320312 time for calcul the mask position with numpy : 0.021814346313476562 nb_pixel_total : 81169 time to create 1 rle with old method : 0.08646821975708008 time for calcul the mask position with numpy : 0.02228403091430664 nb_pixel_total : 1076 time to create 1 rle with old method : 0.001238107681274414 time for calcul the mask position with numpy : 0.02136850357055664 nb_pixel_total : 13510 time to create 1 rle with old method : 0.015100479125976562 time for calcul the mask position with numpy : 0.02144026756286621 nb_pixel_total : 15992 time to create 1 rle with old method : 0.025780200958251953 time for calcul the mask position with numpy : 0.024591445922851562 nb_pixel_total : 83023 time to create 1 rle with old method : 0.10163474082946777 time for calcul the mask position with numpy : 0.02163839340209961 nb_pixel_total : 13546 time to create 1 rle with old method : 0.016249418258666992 time for calcul the mask position with numpy : 0.022270679473876953 nb_pixel_total : 36329 time to create 1 rle with old method : 0.04023408889770508 time for calcul the mask position with numpy : 0.02228379249572754 nb_pixel_total : 11222 time to create 1 rle with old method : 0.011560678482055664 time for calcul the mask position with numpy : 0.022429466247558594 nb_pixel_total : 271339 time to create 1 rle with new method : 0.5797097682952881 time for calcul the mask position with numpy : 0.0225677490234375 nb_pixel_total : 55305 time to create 1 rle with old method : 0.0578923225402832 time for calcul the mask position with numpy : 0.022412776947021484 nb_pixel_total : 201004 time to create 1 rle with new method : 0.5779764652252197 create new chi : 3.173858404159546 time to delete rle : 0.001077413558959961 batch 1 Loaded 17 chid ids of type : 3726 Number RLEs to save : 12034 TO DO : save crop sub photo not yet done ! save time : 0.6730897426605225 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 5.051199913024902 time for calcul the mask position with numpy : 0.49625611305236816 nb_pixel_total : 3819615 time to create 1 rle with new method : 0.4231846332550049 time for calcul the mask position with numpy : 0.022348880767822266 nb_pixel_total : 45116 time to create 1 rle with old method : 0.07117152214050293 time for calcul the mask position with numpy : 0.02033209800720215 nb_pixel_total : 3000 time to create 1 rle with old method : 0.003419160842895508 time for calcul the mask position with numpy : 0.020951509475708008 nb_pixel_total : 109014 time to create 1 rle with old method : 0.12398481369018555 time for calcul the mask position with numpy : 0.025771141052246094 nb_pixel_total : 303421 time to create 1 rle with new method : 0.3924572467803955 time for calcul the mask position with numpy : 0.034032344818115234 nb_pixel_total : 1640407 time to create 1 rle with new method : 0.7421329021453857 time for calcul the mask position with numpy : 0.026874542236328125 nb_pixel_total : 149180 time to create 1 rle with old method : 0.15970468521118164 time for calcul the mask position with numpy : 0.02828240394592285 nb_pixel_total : 917574 time to create 1 rle with new method : 0.6886696815490723 time for calcul the mask position with numpy : 0.023997783660888672 nb_pixel_total : 61052 time to create 1 rle with old method : 0.06609535217285156 time for calcul the mask position with numpy : 0.025463104248046875 nb_pixel_total : 1861 time to create 1 rle with old method : 0.002195596694946289 create new chi : 3.5080387592315674 time to delete rle : 0.0014836788177490234 batch 1 Loaded 12 chid ids of type : 3726 Number RLEs to save : 17338 TO DO : save crop sub photo not yet done ! save time : 0.9361667633056641 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 5.127840518951416 time for calcul the mask position with numpy : 0.057353973388671875 nb_pixel_total : 3570185 time to create 1 rle with new method : 0.4155406951904297 time for calcul the mask position with numpy : 0.020370960235595703 nb_pixel_total : 5698 time to create 1 rle with old method : 0.006358146667480469 time for calcul the mask position with numpy : 0.021478891372680664 nb_pixel_total : 187116 time to create 1 rle with new method : 0.2718851566314697 time for calcul the mask position with numpy : 0.020221710205078125 nb_pixel_total : 3657 time to create 1 rle with old method : 0.0060558319091796875 time for calcul the mask position with numpy : 0.043634891510009766 nb_pixel_total : 2768183 time to create 1 rle with new method : 0.391848087310791 time for calcul the mask position with numpy : 0.02240467071533203 nb_pixel_total : 357181 time to create 1 rle with new method : 0.3832662105560303 time for calcul the mask position with numpy : 0.023026227951049805 nb_pixel_total : 32252 time to create 1 rle with old method : 0.035994768142700195 time for calcul the mask position with numpy : 0.022708892822265625 nb_pixel_total : 1821 time to create 1 rle with old method : 0.0019979476928710938 time for calcul the mask position with numpy : 0.02123880386352539 nb_pixel_total : 43694 time to create 1 rle with old method : 0.04615902900695801 time for calcul the mask position with numpy : 0.022724390029907227 nb_pixel_total : 80453 time to create 1 rle with old method : 0.08514761924743652 create new chi : 2.0051109790802 time to delete rle : 0.0012140274047851562 batch 1 Loaded 10 chid ids of type : 3726 Number RLEs to save : 13187 TO DO : save crop sub photo not yet done ! save time : 0.7645885944366455 nb_obj : 15 nb_hashtags : 4 time to prepare the origin masks : 7.300679683685303 time for calcul the mask position with numpy : 0.22577953338623047 nb_pixel_total : 4343532 time to create 1 rle with new method : 0.367603063583374 time for calcul the mask position with numpy : 0.02030801773071289 nb_pixel_total : 73163 time to create 1 rle with old method : 0.10224676132202148 time for calcul the mask position with numpy : 0.02010321617126465 nb_pixel_total : 8757 time to create 1 rle with old method : 0.009331226348876953 time for calcul the mask position with numpy : 0.019674062728881836 nb_pixel_total : 1619 time to create 1 rle with old method : 0.00214385986328125 time for calcul the mask position with numpy : 0.021118640899658203 nb_pixel_total : 191494 time to create 1 rle with new method : 0.5307161808013916 time for calcul the mask position with numpy : 0.02985405921936035 nb_pixel_total : 206891 time to create 1 rle with new method : 0.47390294075012207 time for calcul the mask position with numpy : 0.021518945693969727 nb_pixel_total : 54014 time to create 1 rle with old method : 0.058629751205444336 time for calcul the mask position with numpy : 0.024419546127319336 nb_pixel_total : 12355 time to create 1 rle with old method : 0.01978898048400879 time for calcul the mask position with numpy : 0.024373769760131836 nb_pixel_total : 15200 time to create 1 rle with old method : 0.019570589065551758 time for calcul the mask position with numpy : 0.023001909255981445 nb_pixel_total : 165044 time to create 1 rle with new method : 0.5029873847961426 time for calcul the mask position with numpy : 0.02133631706237793 nb_pixel_total : 1282 time to create 1 rle with old method : 0.0014352798461914062 time for calcul the mask position with numpy : 0.021109580993652344 nb_pixel_total : 57689 time to create 1 rle with old method : 0.060303449630737305 time for calcul the mask position with numpy : 0.02347278594970703 nb_pixel_total : 415353 time to create 1 rle with new method : 0.5596375465393066 time for calcul the mask position with numpy : 0.030127286911010742 nb_pixel_total : 1479673 time to create 1 rle with new method : 0.653613805770874 time for calcul the mask position with numpy : 0.024520397186279297 nb_pixel_total : 8879 time to create 1 rle with old method : 0.010060310363769531 time for calcul the mask position with numpy : 0.021036386489868164 nb_pixel_total : 15295 time to create 1 rle with old method : 0.01719951629638672 create new chi : 4.119360685348511 time to delete rle : 0.0016200542449951172 batch 1 Loaded 18 chid ids of type : 3726 Number RLEs to save : 20013 TO DO : save crop sub photo not yet done ! save time : 1.1020281314849854 nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 5.383721113204956 time for calcul the mask position with numpy : 0.2146131992340088 nb_pixel_total : 4475613 time to create 1 rle with new method : 0.5318834781646729 time for calcul the mask position with numpy : 0.02088475227355957 nb_pixel_total : 75520 time to create 1 rle with old method : 0.08008408546447754 time for calcul the mask position with numpy : 0.02032184600830078 nb_pixel_total : 31737 time to create 1 rle with old method : 0.033072471618652344 time for calcul the mask position with numpy : 0.02018284797668457 nb_pixel_total : 16884 time to create 1 rle with old method : 0.017824888229370117 time for calcul the mask position with numpy : 0.0198819637298584 nb_pixel_total : 3598 time to create 1 rle with old method : 0.00441288948059082 time for calcul the mask position with numpy : 0.020834922790527344 nb_pixel_total : 199128 time to create 1 rle with new method : 0.31525683403015137 time for calcul the mask position with numpy : 0.021230697631835938 nb_pixel_total : 5807 time to create 1 rle with old method : 0.00938868522644043 time for calcul the mask position with numpy : 0.025173664093017578 nb_pixel_total : 220986 time to create 1 rle with new method : 0.3468017578125 time for calcul the mask position with numpy : 0.021787643432617188 nb_pixel_total : 2501 time to create 1 rle with old method : 0.002877950668334961 time for calcul the mask position with numpy : 0.0208890438079834 nb_pixel_total : 12792 time to create 1 rle with old method : 0.016631364822387695 time for calcul the mask position with numpy : 0.03445887565612793 nb_pixel_total : 1941028 time to create 1 rle with new method : 0.2892727851867676 time for calcul the mask position with numpy : 0.020739316940307617 nb_pixel_total : 7449 time to create 1 rle with old method : 0.007906913757324219 time for calcul the mask position with numpy : 0.020835161209106445 nb_pixel_total : 57197 time to create 1 rle with old method : 0.0612025260925293 create new chi : 2.294142246246338 time to delete rle : 0.002145051956176758 batch 1 Loaded 14 chid ids of type : 3726 Number RLEs to save : 19328 TO DO : save crop sub photo not yet done ! save time : 1.0376100540161133 nb_obj : 21 nb_hashtags : 5 time to prepare the origin masks : 8.641363620758057 time for calcul the mask position with numpy : 0.19746899604797363 nb_pixel_total : 5708828 time to create 1 rle with new method : 0.7028062343597412 time for calcul the mask position with numpy : 0.021389007568359375 nb_pixel_total : 16777 time to create 1 rle with old method : 0.01935291290283203 time for calcul the mask position with numpy : 0.021487712860107422 nb_pixel_total : 14541 time to create 1 rle with old method : 0.01619434356689453 time for calcul the mask position with numpy : 0.029534339904785156 nb_pixel_total : 25163 time to create 1 rle with old method : 0.02709817886352539 time for calcul the mask position with numpy : 0.034711599349975586 nb_pixel_total : 1663 time to create 1 rle with old method : 0.0019457340240478516 time for calcul the mask position with numpy : 0.03578948974609375 nb_pixel_total : 2372 time to create 1 rle with old method : 0.0027747154235839844 time for calcul the mask position with numpy : 0.03809976577758789 nb_pixel_total : 3260 time to create 1 rle with old method : 0.003984212875366211 time for calcul the mask position with numpy : 0.038047075271606445 nb_pixel_total : 82355 time to create 1 rle with old method : 0.09455084800720215 time for calcul the mask position with numpy : 0.0388941764831543 nb_pixel_total : 4989 time to create 1 rle with old method : 0.008107423782348633 time for calcul the mask position with numpy : 0.03744983673095703 nb_pixel_total : 872 time to create 1 rle with old method : 0.0010335445404052734 time for calcul the mask position with numpy : 0.033976078033447266 nb_pixel_total : 311228 time to create 1 rle with new method : 0.6226468086242676 time for calcul the mask position with numpy : 0.03961944580078125 nb_pixel_total : 11963 time to create 1 rle with old method : 0.019081592559814453 time for calcul the mask position with numpy : 0.0451357364654541 nb_pixel_total : 9334 time to create 1 rle with old method : 0.016802310943603516 time for calcul the mask position with numpy : 0.047842979431152344 nb_pixel_total : 239875 time to create 1 rle with new method : 0.5175633430480957 time for calcul the mask position with numpy : 0.034223318099975586 nb_pixel_total : 31758 time to create 1 rle with old method : 0.0335843563079834 time for calcul the mask position with numpy : 0.033434391021728516 nb_pixel_total : 3894 time to create 1 rle with old method : 0.004555940628051758 time for calcul the mask position with numpy : 0.03472256660461426 nb_pixel_total : 1930 time to create 1 rle with old method : 0.0021572113037109375 time for calcul the mask position with numpy : 0.03418540954589844 nb_pixel_total : 16956 time to create 1 rle with old method : 0.018448591232299805 time for calcul the mask position with numpy : 0.03897547721862793 nb_pixel_total : 89558 time to create 1 rle with old method : 0.1363821029663086 time for calcul the mask position with numpy : 0.04483151435852051 nb_pixel_total : 137514 time to create 1 rle with old method : 0.1630091667175293 time for calcul the mask position with numpy : 0.03675055503845215 nb_pixel_total : 177060 time to create 1 rle with new method : 0.7334933280944824 time for calcul the mask position with numpy : 0.040163516998291016 nb_pixel_total : 158350 time to create 1 rle with new method : 0.3717617988586426 create new chi : 4.58565616607666 time to delete rle : 0.0017666816711425781 batch 1 Loaded 22 chid ids of type : 3726 Number RLEs to save : 13933 TO DO : save crop sub photo not yet done ! save time : 0.8369290828704834 nb_obj : 13 nb_hashtags : 6 time to prepare the origin masks : 6.285078525543213 time for calcul the mask position with numpy : 0.6165409088134766 nb_pixel_total : 6400695 time to create 1 rle with new method : 0.8489904403686523 time for calcul the mask position with numpy : 0.0207061767578125 nb_pixel_total : 2283 time to create 1 rle with old method : 0.002773761749267578 time for calcul the mask position with numpy : 0.021055221557617188 nb_pixel_total : 5721 time to create 1 rle with old method : 0.006123065948486328 time for calcul the mask position with numpy : 0.028568267822265625 nb_pixel_total : 3642 time to create 1 rle with old method : 0.004168987274169922 time for calcul the mask position with numpy : 0.02760171890258789 nb_pixel_total : 14304 time to create 1 rle with old method : 0.015671968460083008 time for calcul the mask position with numpy : 0.036113739013671875 nb_pixel_total : 6488 time to create 1 rle with old method : 0.007211923599243164 time for calcul the mask position with numpy : 0.03765702247619629 nb_pixel_total : 54975 time to create 1 rle with old method : 0.060274600982666016 time for calcul the mask position with numpy : 0.036937713623046875 nb_pixel_total : 6614 time to create 1 rle with old method : 0.007524251937866211 time for calcul the mask position with numpy : 0.03764915466308594 nb_pixel_total : 356337 time to create 1 rle with new method : 0.9956393241882324 time for calcul the mask position with numpy : 0.03799581527709961 nb_pixel_total : 16468 time to create 1 rle with old method : 0.018945693969726562 time for calcul the mask position with numpy : 0.034381866455078125 nb_pixel_total : 14801 time to create 1 rle with old method : 0.016289949417114258 time for calcul the mask position with numpy : 0.03511214256286621 nb_pixel_total : 15231 time to create 1 rle with old method : 0.01708054542541504 time for calcul the mask position with numpy : 0.034828901290893555 nb_pixel_total : 9690 time to create 1 rle with old method : 0.011028528213500977 time for calcul the mask position with numpy : 0.03493142127990723 nb_pixel_total : 142991 time to create 1 rle with old method : 0.1849956512451172 create new chi : 3.3051950931549072 time to delete rle : 0.0011615753173828125 batch 1 Loaded 14 chid ids of type : 3726 Number RLEs to save : 7847 TO DO : save crop sub photo not yet done ! save time : 0.4399898052215576 nb_obj : 14 nb_hashtags : 5 time to prepare the origin masks : 10.40459942817688 time for calcul the mask position with numpy : 0.4649829864501953 nb_pixel_total : 6105134 time to create 1 rle with new method : 0.9209690093994141 time for calcul the mask position with numpy : 0.025172710418701172 nb_pixel_total : 40827 time to create 1 rle with old method : 0.04800701141357422 time for calcul the mask position with numpy : 0.025312185287475586 nb_pixel_total : 112959 time to create 1 rle with old method : 0.12111544609069824 time for calcul the mask position with numpy : 0.032495975494384766 nb_pixel_total : 133483 time to create 1 rle with old method : 0.16709518432617188 time for calcul the mask position with numpy : 0.03535008430480957 nb_pixel_total : 36933 time to create 1 rle with old method : 0.040862321853637695 time for calcul the mask position with numpy : 0.037581682205200195 nb_pixel_total : 58614 time to create 1 rle with old method : 0.0681917667388916 time for calcul the mask position with numpy : 0.041326045989990234 nb_pixel_total : 13326 time to create 1 rle with old method : 0.016720056533813477 time for calcul the mask position with numpy : 0.04448843002319336 nb_pixel_total : 190077 time to create 1 rle with new method : 0.4374403953552246 time for calcul the mask position with numpy : 0.03190755844116211 nb_pixel_total : 60297 time to create 1 rle with old method : 0.06566858291625977 time for calcul the mask position with numpy : 0.028606891632080078 nb_pixel_total : 25607 time to create 1 rle with old method : 0.0272982120513916 time for calcul the mask position with numpy : 0.028352975845336914 nb_pixel_total : 98236 time to create 1 rle with old method : 0.10453248023986816 time for calcul the mask position with numpy : 0.021172046661376953 nb_pixel_total : 61028 time to create 1 rle with old method : 0.06416177749633789 time for calcul the mask position with numpy : 0.020436525344848633 nb_pixel_total : 47519 time to create 1 rle with old method : 0.048095703125 time for calcul the mask position with numpy : 0.020601511001586914 nb_pixel_total : 52563 time to create 1 rle with old method : 0.05396103858947754 time for calcul the mask position with numpy : 0.02126789093017578 nb_pixel_total : 13637 time to create 1 rle with old method : 0.014053821563720703 create new chi : 3.1345438957214355 time to delete rle : 0.0011627674102783203 batch 1 Loaded 16 chid ids of type : 3726 Number RLEs to save : 12951 TO DO : save crop sub photo not yet done ! save time : 0.6643087863922119 nb_obj : 15 nb_hashtags : 6 time to prepare the origin masks : 7.7448203563690186 time for calcul the mask position with numpy : 0.3480398654937744 nb_pixel_total : 6027954 time to create 1 rle with new method : 0.5616984367370605 time for calcul the mask position with numpy : 0.022389888763427734 nb_pixel_total : 204247 time to create 1 rle with new method : 0.612868070602417 time for calcul the mask position with numpy : 0.021164894104003906 nb_pixel_total : 31867 time to create 1 rle with old method : 0.03469514846801758 time for calcul the mask position with numpy : 0.020904541015625 nb_pixel_total : 57036 time to create 1 rle with old method : 0.0615992546081543 time for calcul the mask position with numpy : 0.020437240600585938 nb_pixel_total : 1112 time to create 1 rle with old method : 0.0012404918670654297 time for calcul the mask position with numpy : 0.022142410278320312 nb_pixel_total : 25576 time to create 1 rle with old method : 0.027762651443481445 time for calcul the mask position with numpy : 0.02114558219909668 nb_pixel_total : 85171 time to create 1 rle with old method : 0.09450674057006836 time for calcul the mask position with numpy : 0.02082037925720215 nb_pixel_total : 16244 time to create 1 rle with old method : 0.017478227615356445 time for calcul the mask position with numpy : 0.02038741111755371 nb_pixel_total : 45296 time to create 1 rle with old method : 0.04697012901306152 time for calcul the mask position with numpy : 0.02071404457092285 nb_pixel_total : 2072 time to create 1 rle with old method : 0.0022187232971191406 time for calcul the mask position with numpy : 0.020367860794067383 nb_pixel_total : 86 time to create 1 rle with old method : 0.0002040863037109375 time for calcul the mask position with numpy : 0.020591259002685547 nb_pixel_total : 790 time to create 1 rle with old method : 0.0009586811065673828 time for calcul the mask position with numpy : 0.02465510368347168 nb_pixel_total : 203145 time to create 1 rle with new method : 0.6195089817047119 time for calcul the mask position with numpy : 0.024794340133666992 nb_pixel_total : 213702 time to create 1 rle with new method : 0.4772908687591553 time for calcul the mask position with numpy : 0.024228572845458984 nb_pixel_total : 94231 time to create 1 rle with old method : 0.10109901428222656 time for calcul the mask position with numpy : 0.02297496795654297 nb_pixel_total : 41711 time to create 1 rle with old method : 0.04521608352661133 create new chi : 3.499537944793701 time to delete rle : 0.001172780990600586 batch 1 Loaded 16 chid ids of type : 3726 Number RLEs to save : 11654 TO DO : save crop sub photo not yet done ! save time : 0.6362957954406738 map_output_result : {1330579442: (0.0, 'Should be the crop_list due to order', 0.0), 1330579438: (0.0, 'Should be the crop_list due to order', 0.0), 1330579432: (0.0, 'Should be the crop_list due to order', 0.0), 1330579401: (0.0, 'Should be the crop_list due to order', 0.0), 1330579193: (0.0, 'Should be the crop_list due to order', 0.0), 1330579061: (0.0, 'Should be the crop_list due to order', 0.0), 1330578845: (0.0, 'Should be the crop_list due to order', 0.0), 1330578824: (0.0, 'Should be the crop_list due to order', 0.0), 1330578718: (0.0, 'Should be the crop_list due to order', 0.0), 1330578675: (0.0, 'Should be the crop_list due to order', 0.0), 1330578670: (0.0, 'Should be the crop_list due to order', 0.0), 1330578664: (0.0, 'Should be the crop_list due to order', 0.0), 1330578544: (0.0, 'Should be the crop_list due to order', 0.0), 1330578270: (0.0, 'Should be the crop_list due to order', 0.0), 1330578009: (0.0, 'Should be the crop_list due to order', 0.0), 1330577743: (0.0, 'Should be the crop_list due to order', 0.0), 1330577657: (0.0, 'Should be the crop_list due to order', 0.0), 1330577525: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1330579442, 1330579438, 1330579432, 1330579401, 1330579193, 1330579061, 1330578845, 1330578824, 1330578718, 1330578675, 1330578670, 1330578664, 1330578544, 1330578270, 1330578009, 1330577743, 1330577657, 1330577525] Looping around the photos to save general results len do output : 18 /1330579442.Didn't retrieve data . /1330579438.Didn't retrieve data . /1330579432.Didn't retrieve data . /1330579401.Didn't retrieve data . /1330579193.Didn't retrieve data . /1330579061.Didn't retrieve data . /1330578845.Didn't retrieve data . /1330578824.Didn't retrieve data . /1330578718.Didn't retrieve data . /1330578675.Didn't retrieve data . /1330578670.Didn't retrieve data . /1330578664.Didn't retrieve data . /1330578544.Didn't retrieve data . /1330578270.Didn't retrieve data . /1330578009.Didn't retrieve data . /1330577743.Didn't retrieve data . /1330577657.Didn't retrieve data . /1330577525.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579442', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579438', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579432', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579401', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579193', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579061', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578845', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578824', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578718', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578675', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578670', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578664', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578544', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578270', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578009', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577743', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577657', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577525', None, None, None, None, None, '2503008') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 54 time used for this insertion : 0.015462398529052734 save_final save missing photos in datou_result : time spend for datou_step_exec : 217.91208910942078 time spend to save output : 0.016225337982177734 total time spend for step 5 : 217.92831444740295 step6:crop_condition Thu Feb 6 17:15:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 3726 Loading chi in step crop for list_pids : 18 ! batch 1 Loaded 327 chid ids of type : 3726 begin to crop the class : teint_dans_la_masse param for this class : {'min_score': 0.7} filtre for class : teint_dans_la_masse hashtag_id of this class : 2107752385 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 4869462 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738858510_3633234 we have uploaded 14 photos in the portfolio 4869462 time of upload the photos Elapsed time : 4.606966495513916 we have finished the crop for the class : teint_dans_la_masse begin to crop the class : autre_refus param for this class : {'min_score': 0.5} filtre for class : autre_refus hashtag_id of this class : 2107752406 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 4869462 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738858524_3633234 we have uploaded 9 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.23152232170105 we have finished the crop for the class : autre_refus begin to crop the class : carton_gris param for this class : {'min_score': 0.5} filtre for class : carton_gris hashtag_id of this class : 2107753020 Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 4869462 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738858531_3633234 we have uploaded 6 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.49875807762146 we have finished the crop for the class : carton_gris begin to crop the class : cartonnette param for this class : {'min_score': 0.5} filtre for class : cartonnette hashtag_id of this class : 702398920 Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 4869462 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738858536_3633234 we have uploaded 4 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.3459482192993164 we have finished the crop for the class : cartonnette begin to crop the class : carton_brun param for this class : {'min_score': 0.7} filtre for class : carton_brun hashtag_id of this class : 2107753024 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 4869462 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738858542_3633234 we have uploaded 6 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.9030661582946777 we have finished the crop for the class : carton_brun begin to crop the class : plastique param for this class : {'min_score': 0.5} filtre for class : plastique hashtag_id of this class : 492725882 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 4869462 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738858546_3633234 we have uploaded 4 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.160754680633545 we have finished the crop for the class : plastique begin to crop the class : kraft param for this class : {'min_score': 0.5} filtre for class : kraft hashtag_id of this class : 493202403 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 4869462 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738858551_3633234 we have uploaded 3 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.9321455955505371 we have finished the crop for the class : kraft begin to crop the class : metal param for this class : {'min_score': 0.5} filtre for class : metal hashtag_id of this class : 492628673 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1330579442, 1330579438, 1330579432, 1330579401, 1330579193, 1330579061, 1330578845, 1330578824, 1330578718, 1330578675, 1330578670, 1330578664, 1330578544, 1330578270, 1330578009, 1330577743, 1330577657, 1330577525] Looping around the photos to save general results len do output : 46 /1335237542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335237704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579442', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579438', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579432', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579401', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579193', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579061', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578845', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578824', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578718', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578675', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578670', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578664', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578544', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578270', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578009', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577743', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577657', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577525', None, None, None, None, None, '2503008') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 156 time used for this insertion : 0.6408708095550537 save_final save missing photos in datou_result : time spend for datou_step_exec : 49.00884532928467 time spend to save output : 0.6422834396362305 total time spend for step 6 : 49.6511287689209 step7:ventilate_hashtags_in_portfolio Thu Feb 6 17:15:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! To do loadFromThcl(), then load ParamDescType : thcl2725 thcls : [{'id': 2725, 'mtr_user_id': 31, 'name': 'learn_qualipapia_rle_210302_2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,environnement,kraft,metal,papier,plastique', 'svm_portfolios_learning': '3460440,3460441,3460446,3460434,3460439,3467416,3460442,3460443,3486028,3460445', 'photo_hashtag_type': 3410, 'photo_desc_type': 5186, 'type_classification': 'caffe', 'hashtag_id_list': '2107753024,2107753020,2107752385,2107752406,702398920,493012381,493202403,492628673,492668766,492725882'}] thcl {'id': 2725, 'mtr_user_id': 31, 'name': 'learn_qualipapia_rle_210302_2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,environnement,kraft,metal,papier,plastique', 'svm_portfolios_learning': '3460440,3460441,3460446,3460434,3460439,3467416,3460442,3460443,3486028,3460445', 'photo_hashtag_type': 3410, 'photo_desc_type': 5186, 'type_classification': 'caffe', 'hashtag_id_list': '2107753024,2107753020,2107752385,2107752406,702398920,493012381,493202403,492628673,492668766,492725882'} Update svm_hashtag_type_desc : 5186 Iterating over portfolio : 19821680 get user id for portfolio 19821680 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19821680 AND mptpi.`type`=3726 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','autre_refus','mal_croppe','papier','cartonnette','Carton_gris','Teint_Dans_La_Masse','plastique','flou','Carton_brun','environnement','kraft')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19821680 AND mptpi.`type`=3726 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','autre_refus','mal_croppe','papier','cartonnette','Carton_gris','Teint_Dans_La_Masse','plastique','flou','Carton_brun','environnement','kraft')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19821680 AND mptpi.`type`=3726 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','autre_refus','mal_croppe','papier','cartonnette','Carton_gris','Teint_Dans_La_Masse','plastique','flou','Carton_brun','environnement','kraft')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/20299154,20299155,20299156,20299157,20299158,20299159,20299160,20299161,20299162,20299163,20299164,20299165?tags=metal,autre_refus,mal_croppe,papier,cartonnette,Carton_gris,Teint_Dans_La_Masse,plastique,flou,Carton_brun,environnement,kraft Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1330579442, 1330579438, 1330579432, 1330579401, 1330579193, 1330579061, 1330578845, 1330578824, 1330578718, 1330578675, 1330578670, 1330578664, 1330578544, 1330578270, 1330578009, 1330577743, 1330577657, 1330577525] Looping around the photos to save general results len do output : 1 /19821680. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579442', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579438', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579432', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579401', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579193', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579061', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578845', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578824', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578718', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578675', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578670', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578664', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578544', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578270', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578009', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577743', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577657', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577525', None, None, None, None, None, '2503008') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 19 time used for this insertion : 0.015519857406616211 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.716944694519043 time spend to save output : 0.01607346534729004 total time spend for step 7 : 1.733018159866333 step8:final Thu Feb 6 17:15:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1330579442: ('0.07971305335043244',), 1330579438: ('0.07971305335043244',), 1330579432: ('0.07971305335043244',), 1330579401: ('0.07971305335043244',), 1330579193: ('0.07971305335043244',), 1330579061: ('0.07971305335043244',), 1330578845: ('0.07971305335043244',), 1330578824: ('0.07971305335043244',), 1330578718: ('0.07971305335043244',), 1330578675: ('0.07971305335043244',), 1330578670: ('0.07971305335043244',), 1330578664: ('0.07971305335043244',), 1330578544: ('0.07971305335043244',), 1330578270: ('0.07971305335043244',), 1330578009: ('0.07971305335043244',), 1330577743: ('0.07971305335043244',), 1330577657: ('0.07971305335043244',), 1330577525: ('0.07971305335043244',)} new output for save of step final : {1330579442: ('0.07971305335043244',), 1330579438: ('0.07971305335043244',), 1330579432: ('0.07971305335043244',), 1330579401: ('0.07971305335043244',), 1330579193: ('0.07971305335043244',), 1330579061: ('0.07971305335043244',), 1330578845: ('0.07971305335043244',), 1330578824: ('0.07971305335043244',), 1330578718: ('0.07971305335043244',), 1330578675: ('0.07971305335043244',), 1330578670: ('0.07971305335043244',), 1330578664: ('0.07971305335043244',), 1330578544: ('0.07971305335043244',), 1330578270: ('0.07971305335043244',), 1330578009: ('0.07971305335043244',), 1330577743: ('0.07971305335043244',), 1330577657: ('0.07971305335043244',), 1330577525: ('0.07971305335043244',)} [1330579442, 1330579438, 1330579432, 1330579401, 1330579193, 1330579061, 1330578845, 1330578824, 1330578718, 1330578675, 1330578670, 1330578664, 1330578544, 1330578270, 1330578009, 1330577743, 1330577657, 1330577525] Looping around the photos to save general results len do output : 18 /1330579442.Didn't retrieve data . /1330579438.Didn't retrieve data . /1330579432.Didn't retrieve data . /1330579401.Didn't retrieve data . /1330579193.Didn't retrieve data . /1330579061.Didn't retrieve data . /1330578845.Didn't retrieve data . /1330578824.Didn't retrieve data . /1330578718.Didn't retrieve data . /1330578675.Didn't retrieve data . /1330578670.Didn't retrieve data . /1330578664.Didn't retrieve data . /1330578544.Didn't retrieve data . /1330578270.Didn't retrieve data . /1330578009.Didn't retrieve data . /1330577743.Didn't retrieve data . /1330577657.Didn't retrieve data . /1330577525.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579442', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579438', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579432', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579401', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579193', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579061', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578845', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578824', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578718', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578675', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578670', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578664', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578544', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578270', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578009', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577743', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577657', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577525', None, None, None, None, None, '2503008') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 54 time used for this insertion : 0.014167070388793945 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1138455867767334 time spend to save output : 0.015065193176269531 total time spend for step 8 : 0.12891077995300293 step9:velours_tree Thu Feb 6 17:15:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.07609224319458008 time spend to save output : 6.818771362304688e-05 total time spend for step 9 : 0.07616043090820312 step10:send_mail_cod Thu Feb 6 17:15:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin in order to get the selector url, please entre the license of selector results_Auto_P19821680_06-02-2025_17_15_56.pdf 20299154 imagette202991541738858556 20299155 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette202991551738858556 20299156 imagette202991561738858557 20299158 change filename to text .change filename to text .change filename to text .change filename to text .imagette202991581738858557 20299161 change filename to text .change filename to text .change filename to text .change filename to text .imagette202991611738858557 20299162 imagette202991621738858557 20299165 change filename to text .change filename to text .change filename to text .imagette202991651738858557 20299159 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette202991591738858558 20299160 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette202991601738858558 20299163 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette202991631738858559 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=19821680 and hashtag_type = 3726 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20299154,20299155,20299156,20299157,20299158,20299159,20299160,20299161,20299162,20299163,20299164,20299165?tags=metal,autre_refus,mal_croppe,papier,cartonnette,Carton_gris,Teint_Dans_La_Masse,plastique,flou,Carton_brun,environnement,kraft your option no_mail is active, we will not send the real mail to your client args[1330579442] : ('0.07971305335043244',) no score found for photo 1330579442 apple ('0.07971305335043244',) We are sending mail with results at report@fotonower.com args[1330579438] : ('0.07971305335043244',) no score found for photo 1330579438 apple ('0.07971305335043244',) We are sending mail with results at report@fotonower.com args[1330579432] : ('0.07971305335043244',) no score found for photo 1330579432 apple ('0.07971305335043244',) We are sending mail with results at report@fotonower.com args[1330579401] : ('0.07971305335043244',) no score found for photo 1330579401 apple ('0.07971305335043244',) We are sending mail with results at report@fotonower.com args[1330579193] : ('0.07971305335043244',) no score found for photo 1330579193 apple ('0.07971305335043244',) We are sending mail with results at report@fotonower.com args[1330579061] : ('0.07971305335043244',) no score found for photo 1330579061 apple ('0.07971305335043244',) We are sending mail with results at report@fotonower.com args[1330578845] : ('0.07971305335043244',) no score found for photo 1330578845 apple ('0.07971305335043244',) We are sending mail with results at report@fotonower.com args[1330578824] : ('0.07971305335043244',) no score found for photo 1330578824 apple ('0.07971305335043244',) We are sending mail with results at report@fotonower.com args[1330578718] : ('0.07971305335043244',) no score found for photo 1330578718 apple ('0.07971305335043244',) We are sending mail with results at report@fotonower.com args[1330578675] : ('0.07971305335043244',) no score found for photo 1330578675 apple ('0.07971305335043244',) We are sending mail with results at report@fotonower.com args[1330578670] : ('0.07971305335043244',) no score found for photo 1330578670 apple ('0.07971305335043244',) We are sending mail with results at report@fotonower.com args[1330578664] : ('0.07971305335043244',) no score found for photo 1330578664 apple ('0.07971305335043244',) We are sending mail with results at report@fotonower.com args[1330578544] : ('0.07971305335043244',) no score found for photo 1330578544 apple ('0.07971305335043244',) We are sending mail with results at report@fotonower.com args[1330578270] : ('0.07971305335043244',) no score found for photo 1330578270 apple ('0.07971305335043244',) We are sending mail with results at report@fotonower.com args[1330578009] : ('0.07971305335043244',) no score found for photo 1330578009 apple ('0.07971305335043244',) We are sending mail with results at report@fotonower.com args[1330577743] : ('0.07971305335043244',) no score found for photo 1330577743 apple ('0.07971305335043244',) We are sending mail with results at report@fotonower.com args[1330577657] : ('0.07971305335043244',) no score found for photo 1330577657 apple ('0.07971305335043244',) We are sending mail with results at report@fotonower.com args[1330577525] : ('0.07971305335043244',) no score found for photo 1330577525 apple ('0.07971305335043244',) We are sending mail with results at report@fotonower.com refus_total : 0.07971305335043244 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=19821680 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1330578718,1330579442,1330579438,1330579432,1330579401,1330579193,1330579061,1330578845,1330578824,1330577525,1330578675,1330578664,1330578009,1330577743,1330577657,1330578670,1330578544,1330578270) Found this number of photos: 18 begin to download photo : 1330578718 begin to download photo : 1330579401 begin to download photo : 1330578824 begin to download photo : 1330578009 begin to download photo : 1330578544 download finish for photo 1330578009 begin to download photo : 1330577743 download finish for photo 1330578824 begin to download photo : 1330577525 download finish for photo 1330578718 begin to download photo : 1330579442 download finish for photo 1330579401 begin to download photo : 1330579193 download finish for photo 1330577525 begin to download photo : 1330578675 download finish for photo 1330577743 begin to download photo : 1330577657 download finish for photo 1330578544 begin to download photo : 1330578270 download finish for photo 1330579442 begin to download photo : 1330579438 download finish for photo 1330579193 begin to download photo : 1330579061 download finish for photo 1330577657 begin to download photo : 1330578670 download finish for photo 1330578675 begin to download photo : 1330578664 download finish for photo 1330578670 download finish for photo 1330578270 download finish for photo 1330579438 begin to download photo : 1330579432 download finish for photo 1330578664 download finish for photo 1330579061 begin to download photo : 1330578845 download finish for photo 1330579432 download finish for photo 1330578845 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19821680_06-02-2025_17_15_56.pdf results_Auto_P19821680_06-02-2025_17_15_56.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19821680_06-02-2025_17_15_56.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3459','19821680','results_Auto_P19821680_06-02-2025_17_15_56.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19821680_06-02-2025_17_15_56.pdf','pdf','','0.9','0.07971305335043244') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1330579442, 1330579438, 1330579432, 1330579401, 1330579193, 1330579061, 1330578845, 1330578824, 1330578718, 1330578675, 1330578670, 1330578664, 1330578544, 1330578270, 1330578009, 1330577743, 1330577657, 1330577525] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579442', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579438', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579432', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579401', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579193', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579061', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578845', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578824', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578718', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578675', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578670', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578664', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578544', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578270', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578009', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577743', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577657', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577525', None, None, None, None, None, '2503008') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.014300823211669922 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.975101709365845 time spend to save output : 0.01464986801147461 total time spend for step 10 : 6.989751577377319 step11:split_time_score Thu Feb 6 17:16:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! Dont find camara_place_name for portfolio_id : 19821680 Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1330579442, 1330579438, 1330579432, 1330579401, 1330579193, 1330579061, 1330578845, 1330578824, 1330578718, 1330578675, 1330578670, 1330578664, 1330578544, 1330578270, 1330578009, 1330577743, 1330577657, 1330577525] Looping around the photos to save general results len do output : 0 before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579442', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579438', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579432', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579401', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579193', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330579061', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578845', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578824', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578718', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578675', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578670', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578664', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578544', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578270', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330578009', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577743', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577657', None, None, None, None, None, '2503008') ('3459', None, None, None, None, None, None, None, '2503008') ('3459', '19821680', '1330577525', None, None, None, None, None, '2503008') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.014364957809448242 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1006464958190918 time spend to save output : 0.014600038528442383 total time spend for step 11 : 0.11524653434753418 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 18 set_done_treatment 288.33user 176.52system 7:56.08elapsed 97%CPU (0avgtext+0avgdata 5670768maxresident)k 65888inputs+216400outputs (397major+20043341minor)pagefaults 0swaps