python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3657098 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seewe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 7 ; length of list_pids : 7 ; length of list_args : 7 time to download the photos : 1.3330905437469482 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed May 21 17:40:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-21 17:40:33.082645: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-21 17:40:33.111176: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-21 17:40:33.113316: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fd684000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-21 17:40:33.113372: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-21 17:40:33.117292: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-21 17:40:33.358706: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x330cc090 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-21 17:40:33.358761: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-21 17:40:33.360274: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-21 17:40:33.360752: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 17:40:33.363955: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 17:40:33.366859: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-21 17:40:33.367582: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-21 17:40:33.370372: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-21 17:40:33.371673: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-21 17:40:33.376974: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-21 17:40:33.378765: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-21 17:40:33.378853: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 17:40:33.379847: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-21 17:40:33.379869: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-21 17:40:33.379880: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-21 17:40:33.381257: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-21 17:40:33.648174: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-21 17:40:33.648287: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 17:40:33.648306: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 17:40:33.648322: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-21 17:40:33.648337: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-21 17:40:33.648352: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-21 17:40:33.648367: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-21 17:40:33.648383: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-21 17:40:33.649608: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-21 17:40:33.650769: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-21 17:40:33.650804: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 17:40:33.650822: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 17:40:33.650839: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-21 17:40:33.650855: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-21 17:40:33.650872: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-21 17:40:33.650888: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-21 17:40:33.650913: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-21 17:40:33.652151: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-21 17:40:33.652184: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-21 17:40:33.652193: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-21 17:40:33.652200: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-21 17:40:33.653430: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-21 17:40:42.511593: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 17:40:42.689650: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 35 Detection mask done ! Trying to reset tf kernel 3657767 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0011069774627685547 nb_pixel_total : 23283 time to create 1 rle with old method : 0.026157379150390625 length of segment : 242 time for calcul the mask position with numpy : 0.0002524852752685547 nb_pixel_total : 13442 time to create 1 rle with old method : 0.015549421310424805 length of segment : 118 time for calcul the mask position with numpy : 0.0006058216094970703 nb_pixel_total : 20166 time to create 1 rle with old method : 0.023558855056762695 length of segment : 181 time for calcul the mask position with numpy : 0.00044846534729003906 nb_pixel_total : 21875 time to create 1 rle with old method : 0.02535223960876465 length of segment : 277 time for calcul the mask position with numpy : 0.0025179386138916016 nb_pixel_total : 115729 time to create 1 rle with old method : 0.1282825469970703 length of segment : 306 time for calcul the mask position with numpy : 0.0007731914520263672 nb_pixel_total : 34174 time to create 1 rle with old method : 0.03677010536193848 length of segment : 291 time for calcul the mask position with numpy : 0.0007073879241943359 nb_pixel_total : 41589 time to create 1 rle with old method : 0.04540300369262695 length of segment : 281 time for calcul the mask position with numpy : 0.0007104873657226562 nb_pixel_total : 38990 time to create 1 rle with old method : 0.043843746185302734 length of segment : 413 time for calcul the mask position with numpy : 0.0002741813659667969 nb_pixel_total : 12731 time to create 1 rle with old method : 0.01402592658996582 length of segment : 197 time for calcul the mask position with numpy : 0.10695147514343262 nb_pixel_total : 704997 time to create 1 rle with new method : 0.07672119140625 length of segment : 1252 time for calcul the mask position with numpy : 0.005905628204345703 nb_pixel_total : 389185 time to create 1 rle with new method : 0.02745962142944336 length of segment : 761 time for calcul the mask position with numpy : 0.001482248306274414 nb_pixel_total : 86447 time to create 1 rle with old method : 0.09839177131652832 length of segment : 639 time for calcul the mask position with numpy : 0.06314468383789062 nb_pixel_total : 1494536 time to create 1 rle with new method : 0.3472254276275635 length of segment : 1700 time for calcul the mask position with numpy : 0.0006618499755859375 nb_pixel_total : 32091 time to create 1 rle with old method : 0.037035226821899414 length of segment : 250 time for calcul the mask position with numpy : 0.0004963874816894531 nb_pixel_total : 32107 time to create 1 rle with old method : 0.03667569160461426 length of segment : 180 time for calcul the mask position with numpy : 0.0007650852203369141 nb_pixel_total : 44863 time to create 1 rle with old method : 0.05086541175842285 length of segment : 465 time for calcul the mask position with numpy : 0.002041339874267578 nb_pixel_total : 136726 time to create 1 rle with old method : 0.15801453590393066 length of segment : 353 time for calcul the mask position with numpy : 0.0010609626770019531 nb_pixel_total : 66064 time to create 1 rle with old method : 0.07788324356079102 length of segment : 230 time for calcul the mask position with numpy : 0.004312276840209961 nb_pixel_total : 238518 time to create 1 rle with new method : 0.011368989944458008 length of segment : 609 time for calcul the mask position with numpy : 0.0007810592651367188 nb_pixel_total : 41661 time to create 1 rle with old method : 0.051248788833618164 length of segment : 218 time for calcul the mask position with numpy : 0.00125885009765625 nb_pixel_total : 50135 time to create 1 rle with old method : 0.05873370170593262 length of segment : 389 time for calcul the mask position with numpy : 0.000986337661743164 nb_pixel_total : 56848 time to create 1 rle with old method : 0.0658121109008789 length of segment : 355 time for calcul the mask position with numpy : 0.0008227825164794922 nb_pixel_total : 61005 time to create 1 rle with old method : 0.07343029975891113 length of segment : 204 time for calcul the mask position with numpy : 0.0010104179382324219 nb_pixel_total : 69448 time to create 1 rle with old method : 0.08421111106872559 length of segment : 362 time for calcul the mask position with numpy : 0.001165151596069336 nb_pixel_total : 80289 time to create 1 rle with old method : 0.0892796516418457 length of segment : 333 time for calcul the mask position with numpy : 0.0029420852661132812 nb_pixel_total : 216490 time to create 1 rle with new method : 0.007294416427612305 length of segment : 651 time for calcul the mask position with numpy : 0.002081632614135742 nb_pixel_total : 73549 time to create 1 rle with old method : 0.08481597900390625 length of segment : 413 time for calcul the mask position with numpy : 0.0010387897491455078 nb_pixel_total : 48397 time to create 1 rle with old method : 0.06014823913574219 length of segment : 402 time for calcul the mask position with numpy : 0.002215862274169922 nb_pixel_total : 127360 time to create 1 rle with old method : 0.14296817779541016 length of segment : 522 time for calcul the mask position with numpy : 0.00139617919921875 nb_pixel_total : 86722 time to create 1 rle with old method : 0.09905505180358887 length of segment : 613 time for calcul the mask position with numpy : 0.003113269805908203 nb_pixel_total : 208384 time to create 1 rle with new method : 0.008172035217285156 length of segment : 583 time for calcul the mask position with numpy : 0.0007867813110351562 nb_pixel_total : 43183 time to create 1 rle with old method : 0.05020713806152344 length of segment : 275 time for calcul the mask position with numpy : 0.0002911090850830078 nb_pixel_total : 16260 time to create 1 rle with old method : 0.018851041793823242 length of segment : 130 time for calcul the mask position with numpy : 0.003238201141357422 nb_pixel_total : 211130 time to create 1 rle with new method : 0.00862884521484375 length of segment : 552 time for calcul the mask position with numpy : 0.0012881755828857422 nb_pixel_total : 21869 time to create 1 rle with old method : 0.02579045295715332 length of segment : 375 time for calcul the mask position with numpy : 0.0050313472747802734 nb_pixel_total : 234778 time to create 1 rle with new method : 0.013950347900390625 length of segment : 748 time for calcul the mask position with numpy : 0.0030307769775390625 nb_pixel_total : 131355 time to create 1 rle with old method : 0.14538145065307617 length of segment : 420 time for calcul the mask position with numpy : 0.00585484504699707 nb_pixel_total : 370885 time to create 1 rle with new method : 0.015340089797973633 length of segment : 689 time for calcul the mask position with numpy : 0.0018079280853271484 nb_pixel_total : 57323 time to create 1 rle with old method : 0.06395792961120605 length of segment : 308 time for calcul the mask position with numpy : 0.0006916522979736328 nb_pixel_total : 18532 time to create 1 rle with old method : 0.02569866180419922 length of segment : 162 time for calcul the mask position with numpy : 0.00493621826171875 nb_pixel_total : 177701 time to create 1 rle with new method : 0.007100820541381836 length of segment : 571 time for calcul the mask position with numpy : 0.003056049346923828 nb_pixel_total : 116908 time to create 1 rle with old method : 0.13266706466674805 length of segment : 467 time for calcul the mask position with numpy : 0.018378019332885742 nb_pixel_total : 618759 time to create 1 rle with new method : 0.06879734992980957 length of segment : 1386 time for calcul the mask position with numpy : 0.002496004104614258 nb_pixel_total : 23386 time to create 1 rle with old method : 0.027647018432617188 length of segment : 587 time for calcul the mask position with numpy : 0.0017859935760498047 nb_pixel_total : 116752 time to create 1 rle with old method : 0.12888693809509277 length of segment : 369 time for calcul the mask position with numpy : 0.0005052089691162109 nb_pixel_total : 14709 time to create 1 rle with old method : 0.017089366912841797 length of segment : 154 time for calcul the mask position with numpy : 0.0056552886962890625 nb_pixel_total : 208097 time to create 1 rle with new method : 0.008750677108764648 length of segment : 520 time for calcul the mask position with numpy : 0.0038042068481445312 nb_pixel_total : 135317 time to create 1 rle with old method : 0.15417265892028809 length of segment : 527 time for calcul the mask position with numpy : 0.01105356216430664 nb_pixel_total : 309999 time to create 1 rle with new method : 0.13538098335266113 length of segment : 667 time for calcul the mask position with numpy : 0.00655674934387207 nb_pixel_total : 307285 time to create 1 rle with new method : 0.010078907012939453 length of segment : 614 time for calcul the mask position with numpy : 0.0009050369262695312 nb_pixel_total : 49134 time to create 1 rle with old method : 0.054728031158447266 length of segment : 388 time for calcul the mask position with numpy : 0.0007696151733398438 nb_pixel_total : 16834 time to create 1 rle with old method : 0.019417524337768555 length of segment : 170 time for calcul the mask position with numpy : 0.0015206336975097656 nb_pixel_total : 46260 time to create 1 rle with old method : 0.06906461715698242 length of segment : 440 time for calcul the mask position with numpy : 0.004611015319824219 nb_pixel_total : 204484 time to create 1 rle with new method : 0.006242036819458008 length of segment : 632 time for calcul the mask position with numpy : 0.0010495185852050781 nb_pixel_total : 56474 time to create 1 rle with old method : 0.06488466262817383 length of segment : 284 time for calcul the mask position with numpy : 0.0017783641815185547 nb_pixel_total : 75133 time to create 1 rle with old method : 0.08514857292175293 length of segment : 437 time for calcul the mask position with numpy : 0.0004966259002685547 nb_pixel_total : 19345 time to create 1 rle with old method : 0.022633790969848633 length of segment : 156 time for calcul the mask position with numpy : 0.0067958831787109375 nb_pixel_total : 360916 time to create 1 rle with new method : 0.009998559951782227 length of segment : 693 time for calcul the mask position with numpy : 0.002458333969116211 nb_pixel_total : 109131 time to create 1 rle with old method : 0.12132692337036133 length of segment : 310 time for calcul the mask position with numpy : 0.00041985511779785156 nb_pixel_total : 14744 time to create 1 rle with old method : 0.01643991470336914 length of segment : 101 time for calcul the mask position with numpy : 0.0011096000671386719 nb_pixel_total : 51225 time to create 1 rle with old method : 0.05946636199951172 length of segment : 267 time for calcul the mask position with numpy : 0.004906654357910156 nb_pixel_total : 237196 time to create 1 rle with new method : 0.008365154266357422 length of segment : 616 time for calcul the mask position with numpy : 0.025740385055541992 nb_pixel_total : 1288012 time to create 1 rle with new method : 0.3046693801879883 length of segment : 1611 time for calcul the mask position with numpy : 0.002463102340698242 nb_pixel_total : 147479 time to create 1 rle with old method : 0.16028881072998047 length of segment : 449 time for calcul the mask position with numpy : 0.001209259033203125 nb_pixel_total : 73678 time to create 1 rle with old method : 0.08187651634216309 length of segment : 271 time for calcul the mask position with numpy : 0.002822399139404297 nb_pixel_total : 138172 time to create 1 rle with old method : 0.15270256996154785 length of segment : 406 time for calcul the mask position with numpy : 0.0008108615875244141 nb_pixel_total : 57253 time to create 1 rle with old method : 0.06627249717712402 length of segment : 283 time for calcul the mask position with numpy : 0.00034999847412109375 nb_pixel_total : 14597 time to create 1 rle with old method : 0.017227649688720703 length of segment : 179 time for calcul the mask position with numpy : 0.0019698143005371094 nb_pixel_total : 145222 time to create 1 rle with old method : 0.16426897048950195 length of segment : 434 time for calcul the mask position with numpy : 0.0011563301086425781 nb_pixel_total : 25174 time to create 1 rle with old method : 0.02832508087158203 length of segment : 375 time for calcul the mask position with numpy : 0.0017786026000976562 nb_pixel_total : 51411 time to create 1 rle with old method : 0.056226491928100586 length of segment : 316 time for calcul the mask position with numpy : 0.0014307498931884766 nb_pixel_total : 44892 time to create 1 rle with old method : 0.05132341384887695 length of segment : 401 time for calcul the mask position with numpy : 0.0010089874267578125 nb_pixel_total : 21549 time to create 1 rle with old method : 0.02620840072631836 length of segment : 225 time for calcul the mask position with numpy : 0.0031440258026123047 nb_pixel_total : 116028 time to create 1 rle with old method : 0.13382363319396973 length of segment : 480 time for calcul the mask position with numpy : 0.0016281604766845703 nb_pixel_total : 23554 time to create 1 rle with old method : 0.026925086975097656 length of segment : 273 time for calcul the mask position with numpy : 0.001547098159790039 nb_pixel_total : 47625 time to create 1 rle with old method : 0.05353951454162598 length of segment : 336 time for calcul the mask position with numpy : 0.001474618911743164 nb_pixel_total : 42150 time to create 1 rle with old method : 0.04725790023803711 length of segment : 207 time for calcul the mask position with numpy : 0.0009570121765136719 nb_pixel_total : 26985 time to create 1 rle with old method : 0.030689001083374023 length of segment : 309 time for calcul the mask position with numpy : 0.0018324851989746094 nb_pixel_total : 81175 time to create 1 rle with old method : 0.08833909034729004 length of segment : 438 time for calcul the mask position with numpy : 0.0016467571258544922 nb_pixel_total : 61486 time to create 1 rle with old method : 0.0684823989868164 length of segment : 327 time for calcul the mask position with numpy : 0.0037772655487060547 nb_pixel_total : 150232 time to create 1 rle with new method : 0.006989717483520508 length of segment : 285 time for calcul the mask position with numpy : 0.0008337497711181641 nb_pixel_total : 18394 time to create 1 rle with old method : 0.021575212478637695 length of segment : 122 time for calcul the mask position with numpy : 0.005285024642944336 nb_pixel_total : 162318 time to create 1 rle with new method : 0.006855010986328125 length of segment : 477 time for calcul the mask position with numpy : 0.0006935596466064453 nb_pixel_total : 14704 time to create 1 rle with old method : 0.017665863037109375 length of segment : 129 time for calcul the mask position with numpy : 0.001402139663696289 nb_pixel_total : 25086 time to create 1 rle with old method : 0.028925180435180664 length of segment : 265 time for calcul the mask position with numpy : 0.0015304088592529297 nb_pixel_total : 30739 time to create 1 rle with old method : 0.03450512886047363 length of segment : 304 time for calcul the mask position with numpy : 0.0009229183197021484 nb_pixel_total : 19477 time to create 1 rle with old method : 0.022166728973388672 length of segment : 330 time for calcul the mask position with numpy : 0.0019998550415039062 nb_pixel_total : 39337 time to create 1 rle with old method : 0.04662752151489258 length of segment : 461 time for calcul the mask position with numpy : 0.0012660026550292969 nb_pixel_total : 36635 time to create 1 rle with old method : 0.0418703556060791 length of segment : 351 time for calcul the mask position with numpy : 0.0009944438934326172 nb_pixel_total : 20785 time to create 1 rle with old method : 0.023780345916748047 length of segment : 168 time for calcul the mask position with numpy : 0.00138092041015625 nb_pixel_total : 24963 time to create 1 rle with old method : 0.02788066864013672 length of segment : 265 time for calcul the mask position with numpy : 0.003882169723510742 nb_pixel_total : 136358 time to create 1 rle with old method : 0.16766738891601562 length of segment : 466 time for calcul the mask position with numpy : 0.0017364025115966797 nb_pixel_total : 32345 time to create 1 rle with old method : 0.04347658157348633 length of segment : 317 time for calcul the mask position with numpy : 0.002038717269897461 nb_pixel_total : 47915 time to create 1 rle with old method : 0.05826449394226074 length of segment : 265 time for calcul the mask position with numpy : 0.0004189014434814453 nb_pixel_total : 11059 time to create 1 rle with old method : 0.013394594192504883 length of segment : 162 time for calcul the mask position with numpy : 0.0010688304901123047 nb_pixel_total : 24835 time to create 1 rle with old method : 0.030564069747924805 length of segment : 365 time for calcul the mask position with numpy : 0.005781650543212891 nb_pixel_total : 123942 time to create 1 rle with old method : 0.1452791690826416 length of segment : 469 time for calcul the mask position with numpy : 0.005063772201538086 nb_pixel_total : 145547 time to create 1 rle with old method : 0.1710059642791748 length of segment : 703 time for calcul the mask position with numpy : 0.0019116401672363281 nb_pixel_total : 48135 time to create 1 rle with old method : 0.05695343017578125 length of segment : 303 time for calcul the mask position with numpy : 0.003277301788330078 nb_pixel_total : 83030 time to create 1 rle with old method : 0.09507369995117188 length of segment : 408 time for calcul the mask position with numpy : 0.002436399459838867 nb_pixel_total : 57207 time to create 1 rle with old method : 0.06411457061767578 length of segment : 382 time for calcul the mask position with numpy : 0.0010759830474853516 nb_pixel_total : 27345 time to create 1 rle with old method : 0.031192541122436523 length of segment : 226 time for calcul the mask position with numpy : 0.0038046836853027344 nb_pixel_total : 152905 time to create 1 rle with new method : 0.00481867790222168 length of segment : 366 time spent for convertir_results : 14.030181646347046 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 179 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 18892 save missing photos in datou_result : time spend for datou_step_exec : 56.232792139053345 time spend to save output : 1.5042450428009033 total time spend for step 1 : 57.73703718185425 step2:crop_condition Wed May 21 17:41:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 7 ! batch 1 Loaded 179 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 146 About to insert : list_path_to_insert length 146 new photo from crops ! About to upload 146 photos upload in portfolio : 3736932 init cache_photo without model_param we have 146 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747842172_3657098 we have uploaded 146 photos in the portfolio 3736932 time of upload the photos Elapsed time : 37.3560357093811 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747842214_3657098 we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.272183418273926 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 13 About to insert : list_path_to_insert length 13 new photo from crops ! About to upload 13 photos upload in portfolio : 3736932 init cache_photo without model_param we have 13 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747842230_3657098 we have uploaded 13 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.3868935108184814 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1360047288, 1360047019, 1360046988, 1360046967, 1360046965, 1360046963, 1360046868] Looping around the photos to save general results len do output : 174 /1360084357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360084833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360047288', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360047019', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046988', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046967', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046965', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046963', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046868', None, None, None, None, None, '2927478') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 529 time used for this insertion : 0.04143643379211426 save_final save missing photos in datou_result : time spend for datou_step_exec : 145.4613962173462 time spend to save output : 0.0451502799987793 total time spend for step 2 : 145.50654649734497 step3:rle_unique_nms_with_priority Wed May 21 17:43:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 179 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 15 nb_hashtags : 1 time to prepare the origin masks : 5.112443923950195 time for calcul the mask position with numpy : 0.5034868717193604 nb_pixel_total : 5369134 time to create 1 rle with new method : 0.9423627853393555 time for calcul the mask position with numpy : 0.023833513259887695 nb_pixel_total : 32107 time to create 1 rle with old method : 0.034631967544555664 time for calcul the mask position with numpy : 0.023917675018310547 nb_pixel_total : 21452 time to create 1 rle with old method : 0.02279949188232422 time for calcul the mask position with numpy : 0.032768964767456055 nb_pixel_total : 1369099 time to create 1 rle with new method : 0.8588721752166748 time for calcul the mask position with numpy : 0.025806665420532227 nb_pixel_total : 86447 time to create 1 rle with old method : 0.09811878204345703 time for calcul the mask position with numpy : 0.03495478630065918 nb_pixel_total : 389185 time to create 1 rle with new method : 1.1464176177978516 time for calcul the mask position with numpy : 0.030487775802612305 nb_pixel_total : 704997 time to create 1 rle with new method : 0.9097225666046143 time for calcul the mask position with numpy : 0.027752399444580078 nb_pixel_total : 12731 time to create 1 rle with old method : 0.014415740966796875 time for calcul the mask position with numpy : 0.02428722381591797 nb_pixel_total : 38990 time to create 1 rle with old method : 0.04394412040710449 time for calcul the mask position with numpy : 0.023897886276245117 nb_pixel_total : 41589 time to create 1 rle with old method : 0.04622793197631836 time for calcul the mask position with numpy : 0.024239778518676758 nb_pixel_total : 34174 time to create 1 rle with old method : 0.03742480278015137 time for calcul the mask position with numpy : 0.024204492568969727 nb_pixel_total : 115729 time to create 1 rle with old method : 0.1278529167175293 time for calcul the mask position with numpy : 0.025191783905029297 nb_pixel_total : 21875 time to create 1 rle with old method : 0.025390148162841797 time for calcul the mask position with numpy : 0.02410268783569336 nb_pixel_total : 20166 time to create 1 rle with old method : 0.021715879440307617 time for calcul the mask position with numpy : 0.024760723114013672 nb_pixel_total : 13442 time to create 1 rle with old method : 0.015460014343261719 time for calcul the mask position with numpy : 0.024970293045043945 nb_pixel_total : 23283 time to create 1 rle with old method : 0.026563405990600586 create new chi : 5.385357141494751 time to delete rle : 0.03245091438293457 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 16116 TO DO : save crop sub photo not yet done ! save time : 0.9898216724395752 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 8.140026092529297 time for calcul the mask position with numpy : 0.5326430797576904 nb_pixel_total : 6625963 time to create 1 rle with new method : 0.779085636138916 time for calcul the mask position with numpy : 0.025292158126831055 nb_pixel_total : 6144 time to create 1 rle with old method : 0.007547616958618164 time for calcul the mask position with numpy : 0.02599358558654785 nb_pixel_total : 16260 time to create 1 rle with old method : 0.018316268920898438 time for calcul the mask position with numpy : 0.024498462677001953 nb_pixel_total : 43183 time to create 1 rle with old method : 0.04862618446350098 time for calcul the mask position with numpy : 0.025135517120361328 nb_pixel_total : 208384 time to create 1 rle with new method : 0.694753885269165 time for calcul the mask position with numpy : 0.02776193618774414 nb_pixel_total : 86722 time to create 1 rle with old method : 0.10109949111938477 time for calcul the mask position with numpy : 0.02781391143798828 nb_pixel_total : 127360 time to create 1 rle with old method : 0.14301395416259766 time for calcul the mask position with numpy : 0.024707555770874023 nb_pixel_total : 48397 time to create 1 rle with old method : 0.05858802795410156 time for calcul the mask position with numpy : 0.025725841522216797 nb_pixel_total : 72407 time to create 1 rle with old method : 0.08106637001037598 time for calcul the mask position with numpy : 0.025873422622680664 nb_pixel_total : 216490 time to create 1 rle with new method : 0.8279662132263184 time for calcul the mask position with numpy : 0.02489495277404785 nb_pixel_total : 79745 time to create 1 rle with old method : 0.08871817588806152 time for calcul the mask position with numpy : 0.025175094604492188 nb_pixel_total : 69448 time to create 1 rle with old method : 0.07629179954528809 time for calcul the mask position with numpy : 0.026066303253173828 nb_pixel_total : 61005 time to create 1 rle with old method : 0.06463837623596191 time for calcul the mask position with numpy : 0.02361750602722168 nb_pixel_total : 56848 time to create 1 rle with old method : 0.06174755096435547 time for calcul the mask position with numpy : 0.023999691009521484 nb_pixel_total : 48370 time to create 1 rle with old method : 0.05255460739135742 time for calcul the mask position with numpy : 0.02355647087097168 nb_pixel_total : 41661 time to create 1 rle with old method : 0.04573774337768555 time for calcul the mask position with numpy : 0.025173664093017578 nb_pixel_total : 238360 time to create 1 rle with new method : 0.7733891010284424 time for calcul the mask position with numpy : 0.023812294006347656 nb_pixel_total : 66064 time to create 1 rle with old method : 0.06960916519165039 time for calcul the mask position with numpy : 0.023717164993286133 nb_pixel_total : 136726 time to create 1 rle with old method : 0.15535521507263184 time for calcul the mask position with numpy : 0.02583169937133789 nb_pixel_total : 44863 time to create 1 rle with old method : 0.05019688606262207 create new chi : 5.335964202880859 time to delete rle : 0.0022232532501220703 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 16765 TO DO : save crop sub photo not yet done ! save time : 1.0073027610778809 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 8.477837324142456 time for calcul the mask position with numpy : 0.7480378150939941 nb_pixel_total : 6527371 time to create 1 rle with new method : 0.6558542251586914 time for calcul the mask position with numpy : 0.03227639198303223 nb_pixel_total : 21867 time to create 1 rle with old method : 0.0239107608795166 time for calcul the mask position with numpy : 0.032701969146728516 nb_pixel_total : 130391 time to create 1 rle with old method : 0.13956475257873535 time for calcul the mask position with numpy : 0.031296730041503906 nb_pixel_total : 14708 time to create 1 rle with old method : 0.015888214111328125 time for calcul the mask position with numpy : 0.03179311752319336 nb_pixel_total : 57325 time to create 1 rle with old method : 0.06243634223937988 time for calcul the mask position with numpy : 0.032433509826660156 nb_pixel_total : 18516 time to create 1 rle with old method : 0.020186662673950195 time for calcul the mask position with numpy : 0.03207802772521973 nb_pixel_total : 116858 time to create 1 rle with old method : 0.12967419624328613 time for calcul the mask position with numpy : 0.03693246841430664 nb_pixel_total : 517109 time to create 1 rle with new method : 0.6704747676849365 time for calcul the mask position with numpy : 0.0313878059387207 nb_pixel_total : 38900 time to create 1 rle with old method : 0.043126821517944336 time for calcul the mask position with numpy : 0.03327655792236328 nb_pixel_total : 42708 time to create 1 rle with old method : 0.04830288887023926 time for calcul the mask position with numpy : 0.03253769874572754 nb_pixel_total : 105 time to create 1 rle with old method : 0.0003452301025390625 time for calcul the mask position with numpy : 0.035599708557128906 nb_pixel_total : 376486 time to create 1 rle with new method : 0.5927433967590332 time for calcul the mask position with numpy : 0.035028696060180664 nb_pixel_total : 254315 time to create 1 rle with new method : 0.6376791000366211 time for calcul the mask position with numpy : 0.03386878967285156 nb_pixel_total : 177741 time to create 1 rle with new method : 0.5505428314208984 create new chi : 4.948533296585083 time to delete rle : 0.0019254684448242188 batch 1 Loaded 32 chid ids of type : 3594 +++++++++++++++++++++++++++++++++Number RLEs to save : 2525 TO DO : save crop sub photo not yet done ! save time : 0.2925384044647217 nb_obj : 15 nb_hashtags : 4 time to prepare the origin masks : 8.656667232513428 time for calcul the mask position with numpy : 0.5356743335723877 nb_pixel_total : 6381893 time to create 1 rle with new method : 0.6461875438690186 time for calcul the mask position with numpy : 0.03372001647949219 nb_pixel_total : 360913 time to create 1 rle with new method : 0.7215549945831299 time for calcul the mask position with numpy : 0.03284883499145508 nb_pixel_total : 204498 time to create 1 rle with new method : 0.6775722503662109 time for calcul the mask position with numpy : 0.03371095657348633 nb_pixel_total : 135310 time to create 1 rle with old method : 0.15163540840148926 time for calcul the mask position with numpy : 0.03305673599243164 nb_pixel_total : 16833 time to create 1 rle with old method : 0.020697832107543945 time for calcul the mask position with numpy : 0.03294801712036133 nb_pixel_total : 46267 time to create 1 rle with old method : 0.05261731147766113 time for calcul the mask position with numpy : 0.0348353385925293 nb_pixel_total : 307235 time to create 1 rle with new method : 0.5551114082336426 time for calcul the mask position with numpy : 0.03255486488342285 nb_pixel_total : 19350 time to create 1 rle with old method : 0.03245401382446289 time for calcul the mask position with numpy : 0.039974212646484375 nb_pixel_total : 310070 time to create 1 rle with new method : 0.3863389492034912 time for calcul the mask position with numpy : 0.032235145568847656 nb_pixel_total : 49138 time to create 1 rle with old method : 0.05396771430969238 time for calcul the mask position with numpy : 0.03274345397949219 nb_pixel_total : 74956 time to create 1 rle with old method : 0.08303213119506836 time for calcul the mask position with numpy : 0.03218579292297363 nb_pixel_total : 208101 time to create 1 rle with new method : 0.5839924812316895 time for calcul the mask position with numpy : 0.031697750091552734 nb_pixel_total : 55965 time to create 1 rle with old method : 0.060999155044555664 time for calcul the mask position with numpy : 0.03340649604797363 nb_pixel_total : 109127 time to create 1 rle with old method : 0.11666607856750488 time for calcul the mask position with numpy : 0.032207489013671875 nb_pixel_total : 14744 time to create 1 rle with old method : 0.01637578010559082 create new chi : 5.35876727104187 time to delete rle : 0.002039670944213867 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.11323428153991699 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 7.5495288372039795 time for calcul the mask position with numpy : 0.0228726863861084 nb_pixel_total : 10585 time to create 1 rle with old method : 0.01168203353881836 time for calcul the mask position with numpy : 0.024239063262939453 nb_pixel_total : 14596 time to create 1 rle with old method : 0.016240358352661133 time for calcul the mask position with numpy : 0.024217605590820312 nb_pixel_total : 14311 time to create 1 rle with old method : 0.016180038452148438 time for calcul the mask position with numpy : 0.028215646743774414 nb_pixel_total : 138175 time to create 1 rle with old method : 0.15832090377807617 time for calcul the mask position with numpy : 0.02433156967163086 nb_pixel_total : 73674 time to create 1 rle with old method : 0.07912325859069824 time for calcul the mask position with numpy : 0.024850130081176758 nb_pixel_total : 147494 time to create 1 rle with old method : 0.15880417823791504 time for calcul the mask position with numpy : 0.03391742706298828 nb_pixel_total : 1288038 time to create 1 rle with new method : 0.7079000473022461 time for calcul the mask position with numpy : 0.025933027267456055 nb_pixel_total : 237212 time to create 1 rle with new method : 0.7587382793426514 time for calcul the mask position with numpy : 0.02514052391052246 nb_pixel_total : 51226 time to create 1 rle with old method : 0.05695199966430664 time for calcul the mask position with numpy : 0.42141008377075195 nb_pixel_total : 6319089 time to create 1 rle with new method : 0.6954131126403809 create new chi : 3.427644729614258 time to delete rle : 0.001100778579711914 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.10752367973327637 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 9.086663722991943 time for calcul the mask position with numpy : 0.023724079132080078 nb_pixel_total : 150225 time to create 1 rle with new method : 0.7774546146392822 time for calcul the mask position with numpy : 0.025242090225219727 nb_pixel_total : 61461 time to create 1 rle with old method : 0.06755399703979492 time for calcul the mask position with numpy : 0.025946378707885742 nb_pixel_total : 81180 time to create 1 rle with old method : 0.0885612964630127 time for calcul the mask position with numpy : 0.024525165557861328 nb_pixel_total : 26984 time to create 1 rle with old method : 0.029323816299438477 time for calcul the mask position with numpy : 0.02476048469543457 nb_pixel_total : 42153 time to create 1 rle with old method : 0.05060267448425293 time for calcul the mask position with numpy : 0.02803206443786621 nb_pixel_total : 47644 time to create 1 rle with old method : 0.052541255950927734 time for calcul the mask position with numpy : 0.0245974063873291 nb_pixel_total : 23553 time to create 1 rle with old method : 0.025255441665649414 time for calcul the mask position with numpy : 0.02410602569580078 nb_pixel_total : 116034 time to create 1 rle with old method : 0.12623810768127441 time for calcul the mask position with numpy : 0.023894548416137695 nb_pixel_total : 21553 time to create 1 rle with old method : 0.023242950439453125 time for calcul the mask position with numpy : 0.023886680603027344 nb_pixel_total : 44877 time to create 1 rle with old method : 0.04750394821166992 time for calcul the mask position with numpy : 0.024021625518798828 nb_pixel_total : 51411 time to create 1 rle with old method : 0.05587625503540039 time for calcul the mask position with numpy : 0.02582073211669922 nb_pixel_total : 25175 time to create 1 rle with old method : 0.028280019760131836 time for calcul the mask position with numpy : 0.4976990222930908 nb_pixel_total : 7602150 time to create 1 rle with new method : 0.6852869987487793 create new chi : 2.953277826309204 time to delete rle : 0.0018665790557861328 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.09311962127685547 nb_obj : 22 nb_hashtags : 4 time to prepare the origin masks : 8.5594961643219 time for calcul the mask position with numpy : 0.689061164855957 nb_pixel_total : 7168502 time to create 1 rle with new method : 0.6719374656677246 time for calcul the mask position with numpy : 0.03199625015258789 nb_pixel_total : 24837 time to create 1 rle with old method : 0.026831865310668945 time for calcul the mask position with numpy : 0.03134298324584961 nb_pixel_total : 24962 time to create 1 rle with old method : 0.027496814727783203 time for calcul the mask position with numpy : 0.03174853324890137 nb_pixel_total : 32345 time to create 1 rle with old method : 0.03488421440124512 time for calcul the mask position with numpy : 0.03219866752624512 nb_pixel_total : 19481 time to create 1 rle with old method : 0.021349430084228516 time for calcul the mask position with numpy : 0.03195047378540039 nb_pixel_total : 27340 time to create 1 rle with old method : 0.02992987632751465 time for calcul the mask position with numpy : 0.031247377395629883 nb_pixel_total : 14709 time to create 1 rle with old method : 0.015825986862182617 time for calcul the mask position with numpy : 0.031151771545410156 nb_pixel_total : 20782 time to create 1 rle with old method : 0.02238631248474121 time for calcul the mask position with numpy : 0.03130793571472168 nb_pixel_total : 18394 time to create 1 rle with old method : 0.0198366641998291 time for calcul the mask position with numpy : 0.03156018257141113 nb_pixel_total : 123910 time to create 1 rle with old method : 0.13611650466918945 time for calcul the mask position with numpy : 0.031800031661987305 nb_pixel_total : 53119 time to create 1 rle with old method : 0.05873537063598633 time for calcul the mask position with numpy : 0.0331721305847168 nb_pixel_total : 136363 time to create 1 rle with old method : 0.15126633644104004 time for calcul the mask position with numpy : 0.032828330993652344 nb_pixel_total : 30738 time to create 1 rle with old method : 0.03472161293029785 time for calcul the mask position with numpy : 0.03240489959716797 nb_pixel_total : 36633 time to create 1 rle with old method : 0.04129314422607422 time for calcul the mask position with numpy : 0.033286333084106445 nb_pixel_total : 11059 time to create 1 rle with old method : 0.012696504592895508 time for calcul the mask position with numpy : 0.03302907943725586 nb_pixel_total : 145404 time to create 1 rle with old method : 0.16043615341186523 time for calcul the mask position with numpy : 0.031447410583496094 nb_pixel_total : 48138 time to create 1 rle with old method : 0.052023887634277344 time for calcul the mask position with numpy : 0.032172203063964844 nb_pixel_total : 162310 time to create 1 rle with new method : 0.5262269973754883 time for calcul the mask position with numpy : 0.03236055374145508 nb_pixel_total : 47912 time to create 1 rle with old method : 0.05256032943725586 time for calcul the mask position with numpy : 0.03309059143066406 nb_pixel_total : 39345 time to create 1 rle with old method : 0.0442204475402832 time for calcul the mask position with numpy : 0.03425788879394531 nb_pixel_total : 83034 time to create 1 rle with old method : 0.09501218795776367 time for calcul the mask position with numpy : 0.03262495994567871 nb_pixel_total : 25083 time to create 1 rle with old method : 0.02834153175354004 create new chi : 3.7288613319396973 time to delete rle : 0.0037469863891601562 batch 1 Loaded 44 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.1271378993988037 map_output_result : {1360047288: (0.0, 'Should be the crop_list due to order', 0), 1360047019: (0.0, 'Should be the crop_list due to order', 0), 1360046988: (0.0, 'Should be the crop_list due to order', 0), 1360046967: (0.0, 'Should be the crop_list due to order', 0), 1360046965: (0.0, 'Should be the crop_list due to order', 0), 1360046963: (0.0, 'Should be the crop_list due to order', 0), 1360046868: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1360047288, 1360047019, 1360046988, 1360046967, 1360046965, 1360046963, 1360046868] Looping around the photos to save general results len do output : 7 /1360047288.Didn't retrieve data . /1360047019.Didn't retrieve data . /1360046988.Didn't retrieve data . /1360046967.Didn't retrieve data . /1360046965.Didn't retrieve data . /1360046963.Didn't retrieve data . /1360046868.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360047288', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360047019', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046988', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046967', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046965', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046963', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046868', None, None, None, None, None, '2927478') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.013758659362792969 save_final save missing photos in datou_result : time spend for datou_step_exec : 90.74608659744263 time spend to save output : 0.014229536056518555 total time spend for step 3 : 90.76031613349915 step4:ventilate_hashtags_in_portfolio Wed May 21 17:45:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23218052 get user id for portfolio 23218052 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23218052 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','metal','pet_fonce','background','flou','autre','mal_croppe','carton','environnement','pet_clair','pehd')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23218052 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','metal','pet_fonce','background','flou','autre','mal_croppe','carton','environnement','pet_clair','pehd')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23218052 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','metal','pet_fonce','background','flou','autre','mal_croppe','carton','environnement','pet_clair','pehd')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23218788,23218789,23218790,23218791,23218792,23218793,23218794,23218795,23218796,23218797,23218798?tags=papier,metal,pet_fonce,background,flou,autre,mal_croppe,carton,environnement,pet_clair,pehd Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1360047288, 1360047019, 1360046988, 1360046967, 1360046965, 1360046963, 1360046868] Looping around the photos to save general results len do output : 1 /23218052. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360047288', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360047019', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046988', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046967', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046965', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046963', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046868', None, None, None, None, None, '2927478') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.014032125473022461 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5049588680267334 time spend to save output : 0.01427769660949707 total time spend for step 4 : 1.5192365646362305 step5:final Wed May 21 17:45:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1360047288: ('0.20782865547839505',), 1360047019: ('0.20782865547839505',), 1360046988: ('0.20782865547839505',), 1360046967: ('0.20782865547839505',), 1360046965: ('0.20782865547839505',), 1360046963: ('0.20782865547839505',), 1360046868: ('0.20782865547839505',)} new output for save of step final : {1360047288: ('0.20782865547839505',), 1360047019: ('0.20782865547839505',), 1360046988: ('0.20782865547839505',), 1360046967: ('0.20782865547839505',), 1360046965: ('0.20782865547839505',), 1360046963: ('0.20782865547839505',), 1360046868: ('0.20782865547839505',)} [1360047288, 1360047019, 1360046988, 1360046967, 1360046965, 1360046963, 1360046868] Looping around the photos to save general results len do output : 7 /1360047288.Didn't retrieve data . /1360047019.Didn't retrieve data . /1360046988.Didn't retrieve data . /1360046967.Didn't retrieve data . /1360046965.Didn't retrieve data . /1360046963.Didn't retrieve data . /1360046868.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360047288', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360047019', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046988', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046967', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046965', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046963', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046868', None, None, None, None, None, '2927478') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.011763334274291992 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1084752082824707 time spend to save output : 0.012115001678466797 total time spend for step 5 : 0.1205902099609375 step6:blur_detection Wed May 21 17:45:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d.jpg resize: (2160, 3840) 1360047288 -6.65688575466663 treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467.jpg resize: (2160, 3840) 1360047019 -5.661087879272696 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e.jpg resize: (2160, 3840) 1360046988 -5.729604800569289 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04.jpg resize: (2160, 3840) 1360046967 -5.603778468641935 treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d.jpg resize: (2160, 3840) 1360046965 -5.592680843809026 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8.jpg resize: (2160, 3840) 1360046963 -5.9436749500560495 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c.jpg resize: (2160, 3840) 1360046868 -6.443987036279514 treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864625_0.png resize: (269, 109) 1360084357 -4.682669502699007 treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864623_0.png resize: (118, 152) 1360084359 -3.2432740224493712 treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864632_0.png resize: (553, 965) 1360084360 -5.35578396854014 treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864622_0.png resize: (223, 208) 1360084362 -3.7149090938051392 treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864630_0.png resize: (187, 117) 1360084364 -3.7146685528034746 treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864631_0.png resize: (1125, 1197) 1360084365 -5.5194113829089995 treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864636_0.png resize: (180, 232) 1360084367 -1.7220607502714564 treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864626_0.png resize: (297, 501) 1360084369 -2.881043993430044 treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864624_0.png resize: (171, 178) 1360084370 -2.4570526710333183 treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864628_0.png resize: (281, 216) 1360084372 -3.706922749727857 treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864634_0.png resize: (1386, 1559) 1360084374 -5.834221054474773 treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864627_0.png resize: (290, 192) 1360084375 -4.146452075105269 treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864633_0.png resize: (627, 229) 1360084378 -4.433818934578731 treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864629_0.png resize: (286, 261) 1360084380 -3.994670002218812 treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864635_0.png resize: (229, 260) 1360084381 -3.3464556632189915 treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864643_0.png resize: (340, 261) 1360084383 -3.201898390491193 treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864639_0.png resize: (228, 349) 1360084385 -2.428407587225836 treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864641_0.png resize: (214, 257) 1360084386 -1.2827558578000169 treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864642_0.png resize: (388, 348) 1360084388 -1.0818774365322144 treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864655_0.png resize: (517, 619) 1360084389 -4.6936680500062575 treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864653_0.png resize: (274, 242) 1360084390 -1.187198366840889 treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864650_0.png resize: (513, 352) 1360084392 -3.920621145087521 treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864645_0.png resize: (315, 350) 1360084393 -1.322990596173472 treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864637_0.png resize: (465, 123) 1360084394 -2.8666425869257894 treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864640_0.png resize: (479, 772) 1360084396 -2.296328395430739 treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864648_0.png resize: (316, 520) 1360084397 -2.7644749171312823 treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864638_0.png resize: (349, 524) 1360084398 -1.9098940386688594 treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864646_0.png resize: (333, 378) 1360084400 0.2258872428831533 treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864647_0.png resize: (527, 592) 1360084401 -4.6552257293388015 treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864654_0.png resize: (130, 195) 1360084402 -2.7702555185565028 treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864649_0.png resize: (370, 215) 1360084404 -3.9248177588598234 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807689696_0.png resize: (306, 295) 1360084405 -1.9949107983776786 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807693195_0.png resize: (306, 295) 1360084406 -1.9949107983776786 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807689698_0.png resize: (514, 515) 1360084408 -3.5044711916092828 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807693193_0.png resize: (514, 515) 1360084409 -3.5044711916092828 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807689695_0.png resize: (698, 932) 1360084410 -3.809960504232324 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807864657_0.png resize: (689, 916) 1360084412 -3.791765514006372 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807864659_0.png resize: (478, 449) 1360084413 -1.3753030314672474 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807693196_0.png resize: (698, 932) 1360084414 -3.809960504232324 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807689694_0.png resize: (404, 574) 1360084416 -2.7821028773503373 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807693197_0.png resize: (404, 574) 1360084417 -2.7847589907882027 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807864656_0.png resize: (671, 862) 1360084418 -2.5969877625368354 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807689693_0.png resize: (692, 867) 1360084420 -2.68546656039832 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807693198_0.png resize: (692, 867) 1360084421 -2.68546656039832 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807689692_0.png resize: (344, 180) 1360084422 -0.8807892401112092 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807693199_0.png resize: (344, 180) 1360084424 -0.8807892401112092 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807864658_0.png resize: (885, 1396) 1360084425 -4.13359703331055 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807689700_0.png resize: (792, 1220) 1360084426 -4.306907326227538 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807693191_0.png resize: (792, 1220) 1360084428 -4.306907326227538 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807689701_0.png resize: (290, 526) 1360084429 -3.820916135833214 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807864660_0.png resize: (290, 519) 1360084430 -3.8033688436903152 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807693190_0.png resize: (289, 321) 1360084432 -2.01186770604354 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807689699_0.png resize: (323, 536) 1360084433 -1.5103228402749838 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807693192_0.png resize: (323, 536) 1360084434 -1.5103228402749838 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807689702_0.png resize: (120, 177) 1360084436 -3.5963721512141613 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807693189_0.png resize: (120, 177) 1360084437 -3.5963721512141613 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689705_0.png resize: (701, 941) 1360084438 -3.1738533381411584 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693404_0.png resize: (701, 941) 1360084440 -3.1738533381411584 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689711_0.png resize: (268, 278) 1360084441 -3.745761254887332 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693398_0.png resize: (268, 278) 1360084442 -3.775476617823709 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689707_0.png resize: (327, 247) 1360084444 -4.099372263639979 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693402_0.png resize: (327, 247) 1360084445 -4.099372263639979 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689712_0.png resize: (322, 404) 1360084446 -3.6708081888795387 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693397_0.png resize: (322, 404) 1360084448 -3.67272366952284 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689704_0.png resize: (527, 402) 1360084449 -3.522737515801614 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693405_0.png resize: (527, 402) 1360084450 -3.522737515801614 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689708_0.png resize: (170, 189) 1360084452 -3.7024232342180854 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693401_0.png resize: (170, 189) 1360084453 -3.7024232342180854 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689714_0.png resize: (676, 700) 1360084454 -1.9637522666042067 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693395_0.png resize: (676, 700) 1360084456 -1.9637522666042067 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689703_0.png resize: (520, 624) 1360084457 -2.694849501174317 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693406_0.png resize: (520, 624) 1360084458 -2.694849501174317 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689709_0.png resize: (439, 183) 1360084460 -3.146907643012897 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693400_0.png resize: (439, 183) 1360084461 -3.146907643012897 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689706_0.png resize: (525, 838) 1360084462 -3.429896547568957 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693403_0.png resize: (525, 838) 1360084464 -3.429896547568957 treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807693411_0.png resize: (406, 508) 1360084465 -4.836508871131588 treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807689722_0.png resize: (406, 508) 1360084466 -4.836508871131588 treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807689718_0.png resize: (617, 572) 1360084468 -1.8363864004762112 treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807693415_0.png resize: (617, 572) 1360084469 -1.8363864004762112 treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807689724_0.png resize: (178, 141) 1360084470 -3.2637272153924717 treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807693409_0.png resize: (178, 141) 1360084472 -3.2637272153924717 treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807689717_0.png resize: (266, 256) 1360084473 -0.9856106483252747 treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807693416_0.png resize: (266, 256) 1360084474 -0.9856106483252747 treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807689719_0.png resize: (1435, 1508) 1360084476 -5.187124827657948 treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807693414_0.png resize: (1435, 1508) 1360084477 -5.187124827657948 treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807689720_0.png resize: (432, 533) 1360084478 -4.203816974602579 treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807693413_0.png resize: (432, 533) 1360084480 -4.203816974602579 treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807689723_0.png resize: (220, 364) 1360084481 -3.4521850484931367 treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807693410_0.png resize: (87, 341) 1360084482 -4.190345685413562 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689728_0.png resize: (312, 252) 1360084484 -2.4562278105250117 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689727_0.png resize: (309, 261) 1360084485 -2.762802823971574 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693427_0.png resize: (312, 252) 1360084486 -2.4562278105250117 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693428_0.png resize: (309, 261) 1360084488 -2.762802823971574 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689731_0.png resize: (265, 245) 1360084489 -2.578541029518352 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689726_0.png resize: (375, 106) 1360084490 -2.5379598759729567 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693429_0.png resize: (375, 106) 1360084492 -2.5379598759729567 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693424_0.png resize: (265, 245) 1360084493 -2.578541029518352 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689736_0.png resize: (268, 357) 1360084494 -3.428446967176676 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693419_0.png resize: (268, 357) 1360084496 -3.428446967176676 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689735_0.png resize: (344, 306) 1360084497 -4.008036018147808 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693420_0.png resize: (344, 306) 1360084498 -4.008036018147808 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689733_0.png resize: (203, 281) 1360084499 -4.001838265389753 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693422_0.png resize: (203, 281) 1360084501 -4.001838265389753 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689734_0.png resize: (309, 190) 1360084502 -2.6178215025809104 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693421_0.png resize: (309, 190) 1360084503 -2.6178215025809104 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689737_0.png resize: (255, 760) 1360084505 -4.742177682240919 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693418_0.png resize: (255, 760) 1360084506 -4.742177682240919 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689730_0.png resize: (378, 375) 1360084507 -2.4647312866612605 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693425_0.png resize: (378, 375) 1360084509 -2.4647312866612605 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689732_0.png resize: (291, 285) 1360084510 -3.8601329461083935 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693423_0.png resize: (291, 285) 1360084511 -3.8601329461083935 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689754_0.png resize: (403, 522) 1360084513 -5.803320659368542 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693435_0.png resize: (403, 522) 1360084514 -5.803320659368542 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689740_0.png resize: (129, 206) 1360084515 -1.6830411789006288 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693449_0.png resize: (129, 206) 1360084517 -1.6830411789006288 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689739_0.png resize: (472, 537) 1360084518 -2.08211694487247 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693450_0.png resize: (472, 537) 1360084519 -2.08211694487247 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689753_0.png resize: (451, 633) 1360084521 -4.085866747474749 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693436_0.png resize: (451, 633) 1360084522 -4.085866747474749 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689747_0.png resize: (210, 218) 1360084523 -2.463614360575641 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693442_0.png resize: (210, 218) 1360084525 -2.463614360575641 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689750_0.png resize: (206, 339) 1360084526 -2.678953684525893 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693439_0.png resize: (206, 339) 1360084527 -2.678953684525893 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689751_0.png resize: (363, 106) 1360084529 -2.7820085648059103 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689741_0.png resize: (260, 242) 1360084530 -3.3466803899971436 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689745_0.png resize: (351, 122) 1360084531 -3.4001094259400535 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693444_0.png resize: (351, 122) 1360084532 -3.4001094259400535 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693438_0.png resize: (363, 106) 1360084534 -2.7820085648059103 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693448_0.png resize: (260, 242) 1360084535 -3.3466803899971436 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689755_0.png resize: (286, 314) 1360084536 -3.671597055385861 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693434_0.png resize: (286, 314) 1360084538 -3.671597055385861 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689756_0.png resize: (353, 314) 1360084539 -4.40056456856114 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693433_0.png resize: (353, 314) 1360084540 -4.40056456856114 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689757_0.png resize: (303, 310) 1360084542 -4.553459124420142 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693432_0.png resize: (283, 310) 1360084543 -4.505993166091645 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689752_0.png resize: (157, 117) 1360084544 -2.8103894879199114 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693437_0.png resize: (157, 117) 1360084546 -2.8103894879199114 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689742_0.png resize: (303, 208) 1360084547 -2.8548637010077953 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693447_0.png resize: (303, 208) 1360084548 -2.8548637010077953 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689738_0.png resize: (122, 195) 1360084550 -2.179450602683801 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693451_0.png resize: (122, 195) 1360084551 -2.179450602683801 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689748_0.png resize: (458, 387) 1360084552 -3.0617944770584167 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693441_0.png resize: (458, 387) 1360084554 -3.0617944770584167 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689744_0.png resize: (285, 288) 1360084555 -3.6117582819036453 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693445_0.png resize: (285, 288) 1360084556 -3.6117582819036453 treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864652_0.png resize: (532, 604) 1360084665 -4.661601514873855 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807689697_0.png resize: (133, 213) 1360084666 -3.768532883260871 treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807693194_0.png resize: (133, 213) 1360084668 -3.768532883260871 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689713_0.png resize: (149, 315) 1360084670 -3.311828612300233 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693396_0.png resize: (149, 315) 1360084671 -3.311828612300233 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689716_0.png resize: (101, 190) 1360084672 -2.8007129345116875 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693393_0.png resize: (101, 190) 1360084674 -2.8007129345116875 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689729_0.png resize: (170, 179) 1360084676 -2.7905199862143686 treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693426_0.png resize: (170, 179) 1360084677 -2.7905199862143686 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689743_0.png resize: (211, 155) 1360084679 -4.598719117393406 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693446_0.png resize: (211, 155) 1360084681 -4.598719117393406 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689746_0.png resize: (167, 161) 1360084682 -2.6273505098213588 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693443_0.png resize: (167, 161) 1360084683 -2.6273505098213588 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689758_0.png resize: (226, 189) 1360084685 -1.6306017601571086 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693431_0.png resize: (226, 189) 1360084687 -1.6306017601571086 treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864644_0.png resize: (193, 403) 1360084816 -5.256172704478112 treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864651_0.png resize: (377, 341) 1360084817 -3.1702014474597817 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689715_0.png resize: (308, 462) 1360084819 -3.9043001565086795 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693394_0.png resize: (308, 462) 1360084820 -3.9043001565086795 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689710_0.png resize: (620, 436) 1360084822 -4.271800276199916 treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693399_0.png resize: (620, 436) 1360084824 -4.271800276199916 treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807689725_0.png resize: (434, 527) 1360084825 -4.787043146839023 treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807693408_0.png resize: (429, 514) 1360084826 -1.4043825627611222 treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807689721_0.png resize: (271, 368) 1360084827 -4.7666130369391055 treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807693412_0.png resize: (271, 368) 1360084829 -4.7666130369391055 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689749_0.png resize: (248, 237) 1360084830 -3.163675383815267 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693440_0.png resize: (248, 237) 1360084831 -3.163675383815267 treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807864661_0.png resize: (282, 702) 1360084833 -5.206646330051199 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 181 time used for this insertion : 0.024055004119873047 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 181 time used for this insertion : 0.038945913314819336 save missing photos in datou_result : time spend for datou_step_exec : 41.54205632209778 time spend to save output : 0.06896281242370605 total time spend for step 6 : 41.611019134521484 step7:brightness Wed May 21 17:46:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d.jpg treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467.jpg treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e.jpg treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04.jpg treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d.jpg treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8.jpg treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c.jpg treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864625_0.png treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864623_0.png treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864632_0.png treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864622_0.png treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864630_0.png treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864631_0.png treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864636_0.png treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864626_0.png treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864624_0.png treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864628_0.png treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864634_0.png treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864627_0.png treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864633_0.png treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864629_0.png treat image : temp/1747842029_3657098_1360047288_3c76d292b2da12e52ac158c32ba0a33d_rle_crop_3807864635_0.png treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864643_0.png treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864639_0.png treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864641_0.png treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864642_0.png treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864655_0.png treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864653_0.png treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864650_0.png treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864645_0.png treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864637_0.png treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864640_0.png treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864648_0.png treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864638_0.png treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864646_0.png treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864647_0.png treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864654_0.png treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864649_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807689696_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807693195_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807689698_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807693193_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807689695_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807864657_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807864659_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807693196_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807689694_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807693197_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807864656_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807689693_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807693198_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807689692_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807693199_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807864658_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807689700_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807693191_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807689701_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807864660_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807693190_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807689699_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807693192_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807689702_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807693189_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689705_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693404_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689711_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693398_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689707_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693402_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689712_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693397_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689704_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693405_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689708_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693401_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689714_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693395_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689703_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693406_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689709_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693400_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689706_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693403_0.png treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807693411_0.png treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807689722_0.png treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807689718_0.png treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807693415_0.png treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807689724_0.png treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807693409_0.png treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807689717_0.png treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807693416_0.png treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807689719_0.png treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807693414_0.png treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807689720_0.png treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807693413_0.png treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807689723_0.png treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807693410_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689728_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689727_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693427_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693428_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689731_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689726_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693429_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693424_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689736_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693419_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689735_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693420_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689733_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693422_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689734_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693421_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689737_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693418_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689730_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693425_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689732_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693423_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689754_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693435_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689740_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693449_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689739_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693450_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689753_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693436_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689747_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693442_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689750_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693439_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689751_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689741_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689745_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693444_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693438_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693448_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689755_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693434_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689756_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693433_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689757_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693432_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689752_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693437_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689742_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693447_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689738_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693451_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689748_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693441_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689744_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693445_0.png treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864652_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807689697_0.png treat image : temp/1747842029_3657098_1360046988_bf00487b09917f586bbe49e16dce041e_rle_crop_3807693194_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689713_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693396_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689716_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693393_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807689729_0.png treat image : temp/1747842029_3657098_1360046963_002b2da5934f0029a92c7fb4345f57c8_rle_crop_3807693426_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689743_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693446_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689746_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693443_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689758_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693431_0.png treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864644_0.png treat image : temp/1747842029_3657098_1360047019_4b3c613e4580881cbada15289fb9e467_rle_crop_3807864651_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689715_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693394_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807689710_0.png treat image : temp/1747842029_3657098_1360046967_a581f30e48a32b12ff9dab4393f76d04_rle_crop_3807693399_0.png treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807689725_0.png treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807693408_0.png treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807689721_0.png treat image : temp/1747842029_3657098_1360046965_1e99daa8245f089c8a6c642e245d8d8d_rle_crop_3807693412_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807689749_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807693440_0.png treat image : temp/1747842029_3657098_1360046868_2812ab302292fc332664254f76760b1c_rle_crop_3807864661_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 181 time used for this insertion : 0.021096467971801758 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 181 time used for this insertion : 0.0337066650390625 save missing photos in datou_result : time spend for datou_step_exec : 10.772052526473999 time spend to save output : 0.06043219566345215 total time spend for step 7 : 10.832484722137451 step8:velours_tree Wed May 21 17:46:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.10881209373474121 time spend to save output : 4.601478576660156e-05 total time spend for step 8 : 0.10885810852050781 step9:send_mail_cod Wed May 21 17:46:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23218052_21-05-2025_17_46_18.pdf 23218788 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232187881747842378 23218789 imagette232187891747842380 23218790 imagette232187901747842380 23218791 imagette232187911747842380 23218792 imagette232187921747842380 23218793 imagette232187931747842380 23218794 imagette232187941747842380 23218795 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232187951747842380 23218797 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232187971747842382 23218798 imagette232187981747842383 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23218052 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23218788,23218789,23218790,23218791,23218792,23218793,23218794,23218795,23218796,23218797,23218798?tags=papier,metal,pet_fonce,background,flou,autre,mal_croppe,carton,environnement,pet_clair,pehd args[1360047288] : ((1360047288, -6.65688575466663, 492609224), (1360047288, 0.8400971558109115, 2107752395), '0.20782865547839505') We are sending mail with results at report@fotonower.com args[1360047019] : ((1360047019, -5.661087879272696, 492609224), (1360047019, 0.5771034108257128, 2107752395), '0.20782865547839505') We are sending mail with results at report@fotonower.com args[1360046988] : ((1360046988, -5.729604800569289, 492609224), (1360046988, 1.0897778648201826, 2107752395), '0.20782865547839505') We are sending mail with results at report@fotonower.com args[1360046967] : ((1360046967, -5.603778468641935, 492609224), (1360046967, 0.9238644974505451, 2107752395), '0.20782865547839505') We are sending mail with results at report@fotonower.com args[1360046965] : ((1360046965, -5.592680843809026, 492609224), (1360046965, 0.4398418196310922, 2107752395), '0.20782865547839505') We are sending mail with results at report@fotonower.com args[1360046963] : ((1360046963, -5.9436749500560495, 492609224), (1360046963, 0.7764969422396433, 2107752395), '0.20782865547839505') We are sending mail with results at report@fotonower.com args[1360046868] : ((1360046868, -6.443987036279514, 492609224), (1360046868, 0.7425326738020697, 2107752395), '0.20782865547839505') We are sending mail with results at report@fotonower.com refus_total : 0.20782865547839505 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23218052 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23218052_21-05-2025_17_46_18.pdf results_Auto_P23218052_21-05-2025_17_46_18.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23218052_21-05-2025_17_46_18.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23218052','results_Auto_P23218052_21-05-2025_17_46_18.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23218052_21-05-2025_17_46_18.pdf','pdf','','0.89','0.20782865547839505') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23218052

https://www.fotonower.com/image?json=false&list_photos_id=1360047288
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360047019
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360046988
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360046967
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360046965
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360046963
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360046868
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 20.78%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/23218788?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23218795?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23218797?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23218052_21-05-2025_17_46_18.pdf.

Lien vers velours :https://www.fotonower.com/velours/23218788,23218789,23218790,23218791,23218792,23218793,23218794,23218795,23218796,23218797,23218798?tags=papier,metal,pet_fonce,background,flou,autre,mal_croppe,carton,environnement,pet_clair,pehd.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 21 May 2025 15:46:26 GMT Content-Length: 0 Connection: close X-Message-Id: 99ke_9WPQMWuO3VB3HqU9g Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1360047288, 1360047019, 1360046988, 1360046967, 1360046965, 1360046963, 1360046868] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360047288', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360047019', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046988', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046967', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046965', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046963', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046868', None, None, None, None, None, '2927478') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.019527912139892578 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.974402904510498 time spend to save output : 0.01990032196044922 total time spend for step 9 : 7.994303226470947 step10:split_time_score Wed May 21 17:46:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('15', 7),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 21052025 23218052 Nombre de photos uploadées : 7 / 23040 (0%) 21052025 23218052 Nombre de photos taguées (types de déchets): 0 / 7 (0%) 21052025 23218052 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 5.245208740234375e-06 elapsed_time : order_list_meta_photo_and_scores 1.3589859008789062e-05 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.0006155967712402344 elapsed_time : insert_dashboard_record_day_entry 0.028790950775146484 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.1958290412808642 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23198775_21-05-2025_09_15_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23198775 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23198775 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23206862 order by id desc limit 1 Qualite : 0.09769901982060188 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23213494_21-05-2025_16_34_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23213494 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23213494 AND mptpi.`type`=3594 To do Qualite : 0.16463150697200177 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23213504_21-05-2025_16_25_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23213504 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23213504 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23213510 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23213515 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23213535 order by id desc limit 1 Qualite : 0.20782865547839505 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23218052_21-05-2025_17_46_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23218052 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23218052 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23218062 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'21052025': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1360047288, 1360047019, 1360046988, 1360046967, 1360046965, 1360046963, 1360046868] Looping around the photos to save general results len do output : 1 /23218052Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360047288', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360047019', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046988', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046967', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046965', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046963', None, None, None, None, None, '2927478') ('3318', None, None, None, None, None, None, None, '2927478') ('3318', '23218052', '1360046868', None, None, None, None, None, '2927478') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.013514518737792969 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.071433067321777 time spend to save output : 0.013715744018554688 total time spend for step 10 : 5.085148811340332 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 7 set_done_treatment 211.56user 93.55system 6:06.64elapsed 83%CPU (0avgtext+0avgdata 4389508maxresident)k 527224inputs+293888outputs (302major+11438567minor)pagefaults 0swaps