FBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.266761064529419 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Apr 15 22:20:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-04-15 22:20:30.910265: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-15 22:20:30.939276: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-15 22:20:30.941383: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f2e00000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-15 22:20:30.941430: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-04-15 22:20:30.945202: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-04-15 22:20:31.200370: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x27b42840 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-04-15 22:20:31.200429: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-04-15 22:20:31.201661: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-15 22:20:31.202668: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-15 22:20:31.206670: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-15 22:20:31.209619: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-15 22:20:31.210000: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-15 22:20:31.213432: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-15 22:20:31.215081: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-15 22:20:31.221116: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-15 22:20:31.222743: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-15 22:20:31.222842: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-15 22:20:31.223689: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-15 22:20:31.223708: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-15 22:20:31.223717: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-15 22:20:31.225737: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-04-15 22:20:31.683568: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-15 22:20:31.683643: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-15 22:20:31.683660: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-15 22:20:31.683675: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-15 22:20:31.683689: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-15 22:20:31.683704: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-15 22:20:31.683717: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-15 22:20:31.683732: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-15 22:20:31.685034: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-15 22:20:31.686217: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-15 22:20:31.686247: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-15 22:20:31.686263: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-15 22:20:31.686277: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-15 22:20:31.686290: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-15 22:20:31.686304: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-15 22:20:31.686317: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-15 22:20:31.686331: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-15 22:20:31.687660: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-15 22:20:31.687724: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-15 22:20:31.687735: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-15 22:20:31.687745: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-15 22:20:31.689351: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-04-15 22:20:43.970311: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-15 22:20:44.138623: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 57 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 62 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 78 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 55 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 24 Detection mask done ! Trying to reset tf kernel 1533264 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4332 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9621 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0009434223175048828 nb_pixel_total : 23561 time to create 1 rle with old method : 0.033077239990234375 length of segment : 201 time for calcul the mask position with numpy : 0.0012600421905517578 nb_pixel_total : 46599 time to create 1 rle with old method : 0.06066751480102539 length of segment : 350 time for calcul the mask position with numpy : 0.0001537799835205078 nb_pixel_total : 6823 time to create 1 rle with old method : 0.008513927459716797 length of segment : 64 time for calcul the mask position with numpy : 0.00034356117248535156 nb_pixel_total : 16028 time to create 1 rle with old method : 0.019699811935424805 length of segment : 108 time for calcul the mask position with numpy : 0.0027408599853515625 nb_pixel_total : 94156 time to create 1 rle with old method : 0.11312723159790039 length of segment : 713 time for calcul the mask position with numpy : 0.0007874965667724609 nb_pixel_total : 35025 time to create 1 rle with old method : 0.04106307029724121 length of segment : 223 time for calcul the mask position with numpy : 0.0003376007080078125 nb_pixel_total : 19509 time to create 1 rle with old method : 0.02351689338684082 length of segment : 138 time for calcul the mask position with numpy : 0.0005459785461425781 nb_pixel_total : 20628 time to create 1 rle with old method : 0.025770902633666992 length of segment : 149 time for calcul the mask position with numpy : 0.0002741813659667969 nb_pixel_total : 8683 time to create 1 rle with old method : 0.011141538619995117 length of segment : 81 time for calcul the mask position with numpy : 0.0013184547424316406 nb_pixel_total : 35600 time to create 1 rle with old method : 0.0435636043548584 length of segment : 296 time for calcul the mask position with numpy : 0.000347137451171875 nb_pixel_total : 10561 time to create 1 rle with old method : 0.01282048225402832 length of segment : 107 time for calcul the mask position with numpy : 0.0005116462707519531 nb_pixel_total : 25318 time to create 1 rle with old method : 0.031665802001953125 length of segment : 138 time for calcul the mask position with numpy : 0.00017881393432617188 nb_pixel_total : 7079 time to create 1 rle with old method : 0.008831024169921875 length of segment : 92 time for calcul the mask position with numpy : 0.000993490219116211 nb_pixel_total : 28688 time to create 1 rle with old method : 0.037978410720825195 length of segment : 298 time for calcul the mask position with numpy : 0.0002980232238769531 nb_pixel_total : 9709 time to create 1 rle with old method : 0.012261152267456055 length of segment : 121 time for calcul the mask position with numpy : 0.00032711029052734375 nb_pixel_total : 14052 time to create 1 rle with old method : 0.01733255386352539 length of segment : 159 time for calcul the mask position with numpy : 0.0003693103790283203 nb_pixel_total : 10707 time to create 1 rle with old method : 0.013031244277954102 length of segment : 125 time for calcul the mask position with numpy : 0.0003044605255126953 nb_pixel_total : 9575 time to create 1 rle with old method : 0.01173543930053711 length of segment : 119 time for calcul the mask position with numpy : 0.0009467601776123047 nb_pixel_total : 32202 time to create 1 rle with old method : 0.03909420967102051 length of segment : 163 time for calcul the mask position with numpy : 0.0006620883941650391 nb_pixel_total : 23496 time to create 1 rle with old method : 0.02847886085510254 length of segment : 294 time for calcul the mask position with numpy : 0.00015997886657714844 nb_pixel_total : 4778 time to create 1 rle with old method : 0.0059626102447509766 length of segment : 101 time for calcul the mask position with numpy : 0.00023698806762695312 nb_pixel_total : 8049 time to create 1 rle with old method : 0.009930133819580078 length of segment : 187 time for calcul the mask position with numpy : 0.0005519390106201172 nb_pixel_total : 25649 time to create 1 rle with old method : 0.03577399253845215 length of segment : 243 time for calcul the mask position with numpy : 0.0008051395416259766 nb_pixel_total : 27772 time to create 1 rle with old method : 0.034540414810180664 length of segment : 253 time for calcul the mask position with numpy : 0.0004398822784423828 nb_pixel_total : 11845 time to create 1 rle with old method : 0.015467405319213867 length of segment : 178 time for calcul the mask position with numpy : 0.00045299530029296875 nb_pixel_total : 20890 time to create 1 rle with old method : 0.026227951049804688 length of segment : 305 time for calcul the mask position with numpy : 0.00036406517028808594 nb_pixel_total : 17615 time to create 1 rle with old method : 0.022539854049682617 length of segment : 182 time for calcul the mask position with numpy : 0.0002143383026123047 nb_pixel_total : 7715 time to create 1 rle with old method : 0.010050535202026367 length of segment : 70 time for calcul the mask position with numpy : 0.00012993812561035156 nb_pixel_total : 3253 time to create 1 rle with old method : 0.004214048385620117 length of segment : 70 time for calcul the mask position with numpy : 0.00010156631469726562 nb_pixel_total : 2137 time to create 1 rle with old method : 0.002741098403930664 length of segment : 60 time for calcul the mask position with numpy : 0.0004911422729492188 nb_pixel_total : 15255 time to create 1 rle with old method : 0.018968582153320312 length of segment : 213 time for calcul the mask position with numpy : 0.00029158592224121094 nb_pixel_total : 11617 time to create 1 rle with old method : 0.014349699020385742 length of segment : 122 time for calcul the mask position with numpy : 0.0004448890686035156 nb_pixel_total : 14415 time to create 1 rle with old method : 0.018219470977783203 length of segment : 137 time for calcul the mask position with numpy : 0.0003609657287597656 nb_pixel_total : 13318 time to create 1 rle with old method : 0.01699995994567871 length of segment : 138 time for calcul the mask position with numpy : 0.0006773471832275391 nb_pixel_total : 27418 time to create 1 rle with old method : 0.0343174934387207 length of segment : 234 time for calcul the mask position with numpy : 0.0002856254577636719 nb_pixel_total : 11832 time to create 1 rle with old method : 0.014935970306396484 length of segment : 145 time for calcul the mask position with numpy : 0.00048542022705078125 nb_pixel_total : 23486 time to create 1 rle with old method : 0.029150009155273438 length of segment : 179 time for calcul the mask position with numpy : 0.0003192424774169922 nb_pixel_total : 11871 time to create 1 rle with old method : 0.015198945999145508 length of segment : 158 time for calcul the mask position with numpy : 0.00022912025451660156 nb_pixel_total : 10497 time to create 1 rle with old method : 0.013435602188110352 length of segment : 113 time for calcul the mask position with numpy : 0.00057220458984375 nb_pixel_total : 25694 time to create 1 rle with old method : 0.03586244583129883 length of segment : 247 time for calcul the mask position with numpy : 0.0004520416259765625 nb_pixel_total : 24916 time to create 1 rle with old method : 0.030770540237426758 length of segment : 158 time for calcul the mask position with numpy : 0.00016355514526367188 nb_pixel_total : 6264 time to create 1 rle with old method : 0.00809478759765625 length of segment : 101 time for calcul the mask position with numpy : 0.0006260871887207031 nb_pixel_total : 33594 time to create 1 rle with old method : 0.042499542236328125 length of segment : 177 time for calcul the mask position with numpy : 0.0002503395080566406 nb_pixel_total : 11931 time to create 1 rle with old method : 0.014642477035522461 length of segment : 117 time for calcul the mask position with numpy : 0.00018477439880371094 nb_pixel_total : 3242 time to create 1 rle with old method : 0.004121065139770508 length of segment : 118 time for calcul the mask position with numpy : 0.0008294582366943359 nb_pixel_total : 44256 time to create 1 rle with old method : 0.06497335433959961 length of segment : 205 time for calcul the mask position with numpy : 0.006464719772338867 nb_pixel_total : 67231 time to create 1 rle with old method : 0.08152127265930176 length of segment : 490 time for calcul the mask position with numpy : 0.0005319118499755859 nb_pixel_total : 18306 time to create 1 rle with old method : 0.02355360984802246 length of segment : 160 time for calcul the mask position with numpy : 0.00015926361083984375 nb_pixel_total : 6640 time to create 1 rle with old method : 0.008390188217163086 length of segment : 74 time for calcul the mask position with numpy : 0.0002818107604980469 nb_pixel_total : 14682 time to create 1 rle with old method : 0.01973867416381836 length of segment : 136 time for calcul the mask position with numpy : 0.00021505355834960938 nb_pixel_total : 8035 time to create 1 rle with old method : 0.01000833511352539 length of segment : 119 time for calcul the mask position with numpy : 0.0002913475036621094 nb_pixel_total : 13157 time to create 1 rle with old method : 0.016536235809326172 length of segment : 195 time for calcul the mask position with numpy : 0.00027680397033691406 nb_pixel_total : 14823 time to create 1 rle with old method : 0.022796154022216797 length of segment : 142 time for calcul the mask position with numpy : 0.00027298927307128906 nb_pixel_total : 10022 time to create 1 rle with old method : 0.015463113784790039 length of segment : 127 time for calcul the mask position with numpy : 0.0016932487487792969 nb_pixel_total : 39004 time to create 1 rle with old method : 0.06402945518493652 length of segment : 359 time for calcul the mask position with numpy : 0.0005869865417480469 nb_pixel_total : 22761 time to create 1 rle with old method : 0.02859663963317871 length of segment : 207 time for calcul the mask position with numpy : 0.0004012584686279297 nb_pixel_total : 20294 time to create 1 rle with old method : 0.02562880516052246 length of segment : 181 time for calcul the mask position with numpy : 0.00023603439331054688 nb_pixel_total : 8381 time to create 1 rle with old method : 0.010767936706542969 length of segment : 106 time for calcul the mask position with numpy : 0.001087188720703125 nb_pixel_total : 47437 time to create 1 rle with old method : 0.05889320373535156 length of segment : 395 time for calcul the mask position with numpy : 0.0005567073822021484 nb_pixel_total : 26063 time to create 1 rle with old method : 0.03238487243652344 length of segment : 176 time for calcul the mask position with numpy : 0.00030350685119628906 nb_pixel_total : 12825 time to create 1 rle with old method : 0.01659560203552246 length of segment : 118 time for calcul the mask position with numpy : 0.00028061866760253906 nb_pixel_total : 10954 time to create 1 rle with old method : 0.013924837112426758 length of segment : 147 time for calcul the mask position with numpy : 0.00031185150146484375 nb_pixel_total : 14005 time to create 1 rle with old method : 0.021855831146240234 length of segment : 123 time for calcul the mask position with numpy : 0.005083322525024414 nb_pixel_total : 194727 time to create 1 rle with new method : 0.01437520980834961 length of segment : 623 time for calcul the mask position with numpy : 0.0001285076141357422 nb_pixel_total : 4969 time to create 1 rle with old method : 0.006284475326538086 length of segment : 74 time for calcul the mask position with numpy : 0.00027251243591308594 nb_pixel_total : 13852 time to create 1 rle with old method : 0.01727604866027832 length of segment : 99 time for calcul the mask position with numpy : 0.000324249267578125 nb_pixel_total : 18399 time to create 1 rle with old method : 0.02287006378173828 length of segment : 99 time for calcul the mask position with numpy : 0.0004668235778808594 nb_pixel_total : 21538 time to create 1 rle with old method : 0.02613067626953125 length of segment : 183 time for calcul the mask position with numpy : 0.001291036605834961 nb_pixel_total : 84251 time to create 1 rle with old method : 0.10716366767883301 length of segment : 325 time for calcul the mask position with numpy : 0.0004930496215820312 nb_pixel_total : 17830 time to create 1 rle with old method : 0.030837059020996094 length of segment : 156 time for calcul the mask position with numpy : 0.00034618377685546875 nb_pixel_total : 13642 time to create 1 rle with old method : 0.02208256721496582 length of segment : 144 time for calcul the mask position with numpy : 0.00136566162109375 nb_pixel_total : 30960 time to create 1 rle with old method : 0.04317164421081543 length of segment : 189 time for calcul the mask position with numpy : 0.0011055469512939453 nb_pixel_total : 22451 time to create 1 rle with old method : 0.03093409538269043 length of segment : 166 time for calcul the mask position with numpy : 0.0005650520324707031 nb_pixel_total : 8654 time to create 1 rle with old method : 0.011068105697631836 length of segment : 86 time for calcul the mask position with numpy : 0.00182342529296875 nb_pixel_total : 33127 time to create 1 rle with old method : 0.04269838333129883 length of segment : 262 time for calcul the mask position with numpy : 0.0020618438720703125 nb_pixel_total : 25349 time to create 1 rle with old method : 0.029968738555908203 length of segment : 212 time for calcul the mask position with numpy : 0.0016138553619384766 nb_pixel_total : 22267 time to create 1 rle with old method : 0.027956247329711914 length of segment : 199 time for calcul the mask position with numpy : 0.0013549327850341797 nb_pixel_total : 19362 time to create 1 rle with old method : 0.024305105209350586 length of segment : 237 time for calcul the mask position with numpy : 0.004595279693603516 nb_pixel_total : 62743 time to create 1 rle with old method : 0.0775458812713623 length of segment : 401 time for calcul the mask position with numpy : 0.006578922271728516 nb_pixel_total : 80606 time to create 1 rle with old method : 0.10470724105834961 length of segment : 544 time for calcul the mask position with numpy : 0.0008454322814941406 nb_pixel_total : 19256 time to create 1 rle with old method : 0.027190208435058594 length of segment : 157 time for calcul the mask position with numpy : 0.0012187957763671875 nb_pixel_total : 21768 time to create 1 rle with old method : 0.027337074279785156 length of segment : 167 time for calcul the mask position with numpy : 0.0026702880859375 nb_pixel_total : 53847 time to create 1 rle with old method : 0.07052183151245117 length of segment : 256 time for calcul the mask position with numpy : 0.000263214111328125 nb_pixel_total : 6791 time to create 1 rle with old method : 0.008587837219238281 length of segment : 109 time for calcul the mask position with numpy : 0.0007205009460449219 nb_pixel_total : 11050 time to create 1 rle with old method : 0.013767719268798828 length of segment : 132 time for calcul the mask position with numpy : 0.0017626285552978516 nb_pixel_total : 26894 time to create 1 rle with old method : 0.03591322898864746 length of segment : 265 time for calcul the mask position with numpy : 0.0010979175567626953 nb_pixel_total : 22713 time to create 1 rle with old method : 0.02839803695678711 length of segment : 132 time for calcul the mask position with numpy : 0.0007979869842529297 nb_pixel_total : 21150 time to create 1 rle with old method : 0.026187896728515625 length of segment : 141 time for calcul the mask position with numpy : 0.0019197463989257812 nb_pixel_total : 29329 time to create 1 rle with old method : 0.03666186332702637 length of segment : 250 time for calcul the mask position with numpy : 0.0009713172912597656 nb_pixel_total : 18381 time to create 1 rle with old method : 0.022574424743652344 length of segment : 189 time for calcul the mask position with numpy : 0.0026428699493408203 nb_pixel_total : 65023 time to create 1 rle with old method : 0.07894062995910645 length of segment : 369 time for calcul the mask position with numpy : 0.0011157989501953125 nb_pixel_total : 17866 time to create 1 rle with old method : 0.021771907806396484 length of segment : 166 time for calcul the mask position with numpy : 0.0010881423950195312 nb_pixel_total : 19470 time to create 1 rle with old method : 0.023885726928710938 length of segment : 159 time for calcul the mask position with numpy : 0.0035533905029296875 nb_pixel_total : 43926 time to create 1 rle with old method : 0.05313611030578613 length of segment : 355 time for calcul the mask position with numpy : 0.0009343624114990234 nb_pixel_total : 19750 time to create 1 rle with old method : 0.024012327194213867 length of segment : 156 time for calcul the mask position with numpy : 0.0004661083221435547 nb_pixel_total : 13232 time to create 1 rle with old method : 0.0163271427154541 length of segment : 192 time for calcul the mask position with numpy : 0.0006487369537353516 nb_pixel_total : 9439 time to create 1 rle with old method : 0.011979103088378906 length of segment : 83 time for calcul the mask position with numpy : 0.0029990673065185547 nb_pixel_total : 53022 time to create 1 rle with old method : 0.06465554237365723 length of segment : 297 time for calcul the mask position with numpy : 0.0014615058898925781 nb_pixel_total : 19807 time to create 1 rle with old method : 0.025031089782714844 length of segment : 142 time for calcul the mask position with numpy : 0.0009264945983886719 nb_pixel_total : 21774 time to create 1 rle with old method : 0.027109384536743164 length of segment : 152 time for calcul the mask position with numpy : 0.0017802715301513672 nb_pixel_total : 30832 time to create 1 rle with old method : 0.03832054138183594 length of segment : 230 time for calcul the mask position with numpy : 0.0009756088256835938 nb_pixel_total : 14057 time to create 1 rle with old method : 0.017353534698486328 length of segment : 129 time for calcul the mask position with numpy : 0.0023267269134521484 nb_pixel_total : 43432 time to create 1 rle with old method : 0.05225229263305664 length of segment : 392 time for calcul the mask position with numpy : 0.0034644603729248047 nb_pixel_total : 53795 time to create 1 rle with old method : 0.06693458557128906 length of segment : 590 time for calcul the mask position with numpy : 0.00328826904296875 nb_pixel_total : 44808 time to create 1 rle with old method : 0.0543825626373291 length of segment : 503 time for calcul the mask position with numpy : 0.00497126579284668 nb_pixel_total : 99160 time to create 1 rle with old method : 0.11797857284545898 length of segment : 425 time for calcul the mask position with numpy : 0.002062559127807617 nb_pixel_total : 28811 time to create 1 rle with old method : 0.03476405143737793 length of segment : 240 time for calcul the mask position with numpy : 0.0004725456237792969 nb_pixel_total : 9469 time to create 1 rle with old method : 0.011563539505004883 length of segment : 81 time for calcul the mask position with numpy : 0.001706838607788086 nb_pixel_total : 26641 time to create 1 rle with old method : 0.034180402755737305 length of segment : 246 time for calcul the mask position with numpy : 0.0011608600616455078 nb_pixel_total : 15865 time to create 1 rle with old method : 0.022185325622558594 length of segment : 217 time for calcul the mask position with numpy : 0.012102842330932617 nb_pixel_total : 186885 time to create 1 rle with new method : 0.017791748046875 length of segment : 547 time for calcul the mask position with numpy : 0.0006806850433349609 nb_pixel_total : 9891 time to create 1 rle with old method : 0.01234126091003418 length of segment : 89 time for calcul the mask position with numpy : 0.0015215873718261719 nb_pixel_total : 18903 time to create 1 rle with old method : 0.023563623428344727 length of segment : 216 time for calcul the mask position with numpy : 0.001134634017944336 nb_pixel_total : 19263 time to create 1 rle with old method : 0.023941516876220703 length of segment : 168 time for calcul the mask position with numpy : 0.0018236637115478516 nb_pixel_total : 19799 time to create 1 rle with old method : 0.025720834732055664 length of segment : 169 time for calcul the mask position with numpy : 0.0011353492736816406 nb_pixel_total : 16050 time to create 1 rle with old method : 0.02008795738220215 length of segment : 149 time for calcul the mask position with numpy : 0.0017931461334228516 nb_pixel_total : 33120 time to create 1 rle with old method : 0.041147470474243164 length of segment : 298 time for calcul the mask position with numpy : 0.01173853874206543 nb_pixel_total : 221024 time to create 1 rle with new method : 0.014161109924316406 length of segment : 523 time for calcul the mask position with numpy : 0.0011012554168701172 nb_pixel_total : 28320 time to create 1 rle with old method : 0.03406691551208496 length of segment : 310 time for calcul the mask position with numpy : 0.0012974739074707031 nb_pixel_total : 8508 time to create 1 rle with old method : 0.010352134704589844 length of segment : 190 time for calcul the mask position with numpy : 0.0016884803771972656 nb_pixel_total : 24169 time to create 1 rle with old method : 0.030063152313232422 length of segment : 132 time for calcul the mask position with numpy : 0.0007774829864501953 nb_pixel_total : 7014 time to create 1 rle with old method : 0.008510589599609375 length of segment : 336 time for calcul the mask position with numpy : 0.0023398399353027344 nb_pixel_total : 28039 time to create 1 rle with old method : 0.033892154693603516 length of segment : 256 time for calcul the mask position with numpy : 0.0015075206756591797 nb_pixel_total : 30984 time to create 1 rle with old method : 0.03861045837402344 length of segment : 172 time for calcul the mask position with numpy : 0.0007414817810058594 nb_pixel_total : 13205 time to create 1 rle with old method : 0.016571998596191406 length of segment : 92 time for calcul the mask position with numpy : 0.0015060901641845703 nb_pixel_total : 13861 time to create 1 rle with old method : 0.01703023910522461 length of segment : 246 time for calcul the mask position with numpy : 0.004087209701538086 nb_pixel_total : 73560 time to create 1 rle with old method : 0.11174130439758301 length of segment : 502 time for calcul the mask position with numpy : 0.0010716915130615234 nb_pixel_total : 16917 time to create 1 rle with old method : 0.02106642723083496 length of segment : 166 time for calcul the mask position with numpy : 0.0004343986511230469 nb_pixel_total : 9565 time to create 1 rle with old method : 0.01192784309387207 length of segment : 129 time for calcul the mask position with numpy : 0.0014452934265136719 nb_pixel_total : 12555 time to create 1 rle with old method : 0.01601099967956543 length of segment : 198 time for calcul the mask position with numpy : 0.002340555191040039 nb_pixel_total : 31086 time to create 1 rle with old method : 0.03740358352661133 length of segment : 170 time for calcul the mask position with numpy : 0.00121307373046875 nb_pixel_total : 35655 time to create 1 rle with old method : 0.04332256317138672 length of segment : 344 time for calcul the mask position with numpy : 0.000698089599609375 nb_pixel_total : 6570 time to create 1 rle with old method : 0.00856328010559082 length of segment : 125 time for calcul the mask position with numpy : 0.0007407665252685547 nb_pixel_total : 8301 time to create 1 rle with old method : 0.010604381561279297 length of segment : 147 time for calcul the mask position with numpy : 0.0004863739013671875 nb_pixel_total : 6231 time to create 1 rle with old method : 0.007647037506103516 length of segment : 108 time for calcul the mask position with numpy : 0.0010395050048828125 nb_pixel_total : 11015 time to create 1 rle with old method : 0.016289234161376953 length of segment : 141 time for calcul the mask position with numpy : 0.005417823791503906 nb_pixel_total : 38532 time to create 1 rle with old method : 0.048191070556640625 length of segment : 343 time for calcul the mask position with numpy : 0.0013642311096191406 nb_pixel_total : 18919 time to create 1 rle with old method : 0.023365259170532227 length of segment : 157 time for calcul the mask position with numpy : 0.003819704055786133 nb_pixel_total : 65868 time to create 1 rle with old method : 0.0785675048828125 length of segment : 375 time for calcul the mask position with numpy : 0.0007936954498291016 nb_pixel_total : 9540 time to create 1 rle with old method : 0.011406898498535156 length of segment : 132 time for calcul the mask position with numpy : 0.0011293888092041016 nb_pixel_total : 24808 time to create 1 rle with old method : 0.029616117477416992 length of segment : 302 time for calcul the mask position with numpy : 0.0007572174072265625 nb_pixel_total : 12753 time to create 1 rle with old method : 0.01611018180847168 length of segment : 122 time for calcul the mask position with numpy : 0.0017728805541992188 nb_pixel_total : 35665 time to create 1 rle with old method : 0.04527568817138672 length of segment : 282 time for calcul the mask position with numpy : 0.005207538604736328 nb_pixel_total : 72835 time to create 1 rle with old method : 0.08433938026428223 length of segment : 409 time for calcul the mask position with numpy : 0.001397848129272461 nb_pixel_total : 18790 time to create 1 rle with old method : 0.02374887466430664 length of segment : 282 time for calcul the mask position with numpy : 0.007273197174072266 nb_pixel_total : 116592 time to create 1 rle with old method : 0.1392505168914795 length of segment : 512 time for calcul the mask position with numpy : 0.004241943359375 nb_pixel_total : 96682 time to create 1 rle with old method : 0.12035703659057617 length of segment : 364 time for calcul the mask position with numpy : 0.0030651092529296875 nb_pixel_total : 52017 time to create 1 rle with old method : 0.06359291076660156 length of segment : 330 time for calcul the mask position with numpy : 0.0005757808685302734 nb_pixel_total : 10848 time to create 1 rle with old method : 0.013715744018554688 length of segment : 128 time for calcul the mask position with numpy : 0.002415895462036133 nb_pixel_total : 45433 time to create 1 rle with old method : 0.059426069259643555 length of segment : 269 time for calcul the mask position with numpy : 0.0008344650268554688 nb_pixel_total : 14172 time to create 1 rle with old method : 0.018184900283813477 length of segment : 104 time for calcul the mask position with numpy : 0.0012493133544921875 nb_pixel_total : 27520 time to create 1 rle with old method : 0.03395223617553711 length of segment : 228 time for calcul the mask position with numpy : 0.002450704574584961 nb_pixel_total : 59747 time to create 1 rle with old method : 0.07083892822265625 length of segment : 275 time for calcul the mask position with numpy : 0.0014944076538085938 nb_pixel_total : 32111 time to create 1 rle with old method : 0.03943681716918945 length of segment : 151 time for calcul the mask position with numpy : 0.002545595169067383 nb_pixel_total : 64768 time to create 1 rle with old method : 0.07585859298706055 length of segment : 351 time for calcul the mask position with numpy : 0.0013422966003417969 nb_pixel_total : 25410 time to create 1 rle with old method : 0.031244754791259766 length of segment : 299 time for calcul the mask position with numpy : 0.0017316341400146484 nb_pixel_total : 31074 time to create 1 rle with old method : 0.038651227951049805 length of segment : 189 time for calcul the mask position with numpy : 0.0030460357666015625 nb_pixel_total : 31960 time to create 1 rle with old method : 0.03907918930053711 length of segment : 579 time for calcul the mask position with numpy : 0.0005464553833007812 nb_pixel_total : 14348 time to create 1 rle with old method : 0.017748594284057617 length of segment : 133 time for calcul the mask position with numpy : 0.005284786224365234 nb_pixel_total : 95707 time to create 1 rle with old method : 0.11827731132507324 length of segment : 498 time for calcul the mask position with numpy : 0.000827789306640625 nb_pixel_total : 15144 time to create 1 rle with old method : 0.0183565616607666 length of segment : 136 time for calcul the mask position with numpy : 0.0006453990936279297 nb_pixel_total : 15401 time to create 1 rle with old method : 0.0186922550201416 length of segment : 292 time for calcul the mask position with numpy : 0.0007770061492919922 nb_pixel_total : 15288 time to create 1 rle with old method : 0.018416404724121094 length of segment : 164 time for calcul the mask position with numpy : 0.0004076957702636719 nb_pixel_total : 16028 time to create 1 rle with old method : 0.01885533332824707 length of segment : 127 time for calcul the mask position with numpy : 0.0006844997406005859 nb_pixel_total : 14976 time to create 1 rle with old method : 0.018381595611572266 length of segment : 188 time for calcul the mask position with numpy : 0.0013499259948730469 nb_pixel_total : 52538 time to create 1 rle with old method : 0.06288743019104004 length of segment : 267 time for calcul the mask position with numpy : 0.001153707504272461 nb_pixel_total : 29705 time to create 1 rle with old method : 0.03566789627075195 length of segment : 260 time for calcul the mask position with numpy : 0.0006024837493896484 nb_pixel_total : 16393 time to create 1 rle with old method : 0.020400285720825195 length of segment : 154 time for calcul the mask position with numpy : 0.0007159709930419922 nb_pixel_total : 22600 time to create 1 rle with old method : 0.03402447700500488 length of segment : 122 time for calcul the mask position with numpy : 0.0006754398345947266 nb_pixel_total : 13781 time to create 1 rle with old method : 0.023566246032714844 length of segment : 147 time for calcul the mask position with numpy : 0.0025975704193115234 nb_pixel_total : 86499 time to create 1 rle with old method : 0.1053462028503418 length of segment : 321 time for calcul the mask position with numpy : 0.0005655288696289062 nb_pixel_total : 17197 time to create 1 rle with old method : 0.02120804786682129 length of segment : 171 time for calcul the mask position with numpy : 0.0025670528411865234 nb_pixel_total : 104772 time to create 1 rle with old method : 0.12961292266845703 length of segment : 525 time for calcul the mask position with numpy : 0.0011937618255615234 nb_pixel_total : 26973 time to create 1 rle with old method : 0.03342008590698242 length of segment : 264 time for calcul the mask position with numpy : 0.0014519691467285156 nb_pixel_total : 45759 time to create 1 rle with old method : 0.05632781982421875 length of segment : 318 time for calcul the mask position with numpy : 0.0016961097717285156 nb_pixel_total : 41482 time to create 1 rle with old method : 0.050742387771606445 length of segment : 278 time for calcul the mask position with numpy : 0.0007381439208984375 nb_pixel_total : 17877 time to create 1 rle with old method : 0.026099681854248047 length of segment : 163 time for calcul the mask position with numpy : 0.0006737709045410156 nb_pixel_total : 18915 time to create 1 rle with old method : 0.02363300323486328 length of segment : 159 time for calcul the mask position with numpy : 0.0005919933319091797 nb_pixel_total : 30837 time to create 1 rle with old method : 0.03835940361022949 length of segment : 159 time for calcul the mask position with numpy : 0.000835418701171875 nb_pixel_total : 14441 time to create 1 rle with old method : 0.024625301361083984 length of segment : 260 time for calcul the mask position with numpy : 0.0016827583312988281 nb_pixel_total : 46007 time to create 1 rle with old method : 0.06294870376586914 length of segment : 238 time for calcul the mask position with numpy : 0.00018835067749023438 nb_pixel_total : 6642 time to create 1 rle with old method : 0.008521795272827148 length of segment : 82 time for calcul the mask position with numpy : 0.0005192756652832031 nb_pixel_total : 21020 time to create 1 rle with old method : 0.025938749313354492 length of segment : 244 time spent for convertir_results : 12.713120460510254 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 183 chid ids of type : 3594 Number RLEs to save : 40102 save missing photos in datou_result : time spend for datou_step_exec : 88.0713050365448 time spend to save output : 2.3876049518585205 total time spend for step 1 : 90.45890998840332 step2:crop_condition Tue Apr 15 22:21:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 183 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 150 About to insert : list_path_to_insert length 150 new photo from crops ! About to upload 150 photos upload in portfolio : 3736932 init cache_photo without model_param we have 150 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744748543_1532623 we have uploaded 150 photos in the portfolio 3736932 time of upload the photos Elapsed time : 40.09853386878967 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 27 About to insert : list_path_to_insert length 27 new photo from crops ! About to upload 27 photos upload in portfolio : 3736932 init cache_photo without model_param we have 27 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744748587_1532623 we have uploaded 27 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.7818827629089355 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744748598_1532623 we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.545236349105835 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744748600_1532623 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5745787620544434 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1350017016, 1350016973, 1350016970, 1350016966, 1350016960, 1350016954, 1350016948, 1350016856] Looping around the photos to save general results len do output : 183 /1350038751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350038967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350039302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350017016', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016973', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016970', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016966', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016960', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016954', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016948', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016856', None, None, None, None, None, '2723667') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 557 time used for this insertion : 0.03644919395446777 save_final save missing photos in datou_result : time spend for datou_step_exec : 82.77775192260742 time spend to save output : 0.0427095890045166 total time spend for step 2 : 82.82046151161194 step3:rle_unique_nms_with_priority Tue Apr 15 22:23:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 183 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 3.1591029167175293 time for calcul the mask position with numpy : 2.266561269760132 nb_pixel_total : 6818353 time to create 1 rle with new method : 1.1998083591461182 time for calcul the mask position with numpy : 0.024702787399291992 nb_pixel_total : 9695 time to create 1 rle with old method : 0.01197052001953125 time for calcul the mask position with numpy : 0.027031421661376953 nb_pixel_total : 35025 time to create 1 rle with old method : 0.042844295501708984 time for calcul the mask position with numpy : 0.02844691276550293 nb_pixel_total : 94156 time to create 1 rle with old method : 0.11391282081604004 time for calcul the mask position with numpy : 0.023331403732299805 nb_pixel_total : 16028 time to create 1 rle with old method : 0.01950860023498535 time for calcul the mask position with numpy : 0.023418188095092773 nb_pixel_total : 6823 time to create 1 rle with old method : 0.008409500122070312 time for calcul the mask position with numpy : 0.025815725326538086 nb_pixel_total : 46599 time to create 1 rle with old method : 0.056162118911743164 time for calcul the mask position with numpy : 0.023647546768188477 nb_pixel_total : 23561 time to create 1 rle with old method : 0.02904510498046875 create new chi : 3.961216926574707 time to delete rle : 0.028471708297729492 batch 1 Loaded 15 chid ids of type : 3594 ++++++++Number RLEs to save : 5626 TO DO : save crop sub photo not yet done ! save time : 0.41942644119262695 nb_obj : 28 nb_hashtags : 2 time to prepare the origin masks : 3.408353805541992 time for calcul the mask position with numpy : 0.5955040454864502 nb_pixel_total : 6615910 time to create 1 rle with new method : 0.9913597106933594 time for calcul the mask position with numpy : 0.02947998046875 nb_pixel_total : 27772 time to create 1 rle with old method : 0.032344818115234375 time for calcul the mask position with numpy : 0.02826523780822754 nb_pixel_total : 7715 time to create 1 rle with old method : 0.009429693222045898 time for calcul the mask position with numpy : 0.028374910354614258 nb_pixel_total : 14415 time to create 1 rle with old method : 0.016977548599243164 time for calcul the mask position with numpy : 0.0283966064453125 nb_pixel_total : 4778 time to create 1 rle with old method : 0.005742549896240234 time for calcul the mask position with numpy : 0.029104948043823242 nb_pixel_total : 9575 time to create 1 rle with old method : 0.01146697998046875 time for calcul the mask position with numpy : 0.029252052307128906 nb_pixel_total : 15255 time to create 1 rle with old method : 0.01794743537902832 time for calcul the mask position with numpy : 0.028261661529541016 nb_pixel_total : 17770 time to create 1 rle with old method : 0.021447181701660156 time for calcul the mask position with numpy : 0.028776168823242188 nb_pixel_total : 11585 time to create 1 rle with old method : 0.0140380859375 time for calcul the mask position with numpy : 0.02827906608581543 nb_pixel_total : 20890 time to create 1 rle with old method : 0.025759458541870117 time for calcul the mask position with numpy : 0.029224157333374023 nb_pixel_total : 35600 time to create 1 rle with old method : 0.045087575912475586 time for calcul the mask position with numpy : 0.03294777870178223 nb_pixel_total : 11845 time to create 1 rle with old method : 0.015261650085449219 time for calcul the mask position with numpy : 0.03275346755981445 nb_pixel_total : 32202 time to create 1 rle with old method : 0.03918170928955078 time for calcul the mask position with numpy : 0.02968883514404297 nb_pixel_total : 25649 time to create 1 rle with old method : 0.03221940994262695 time for calcul the mask position with numpy : 0.029596328735351562 nb_pixel_total : 10707 time to create 1 rle with old method : 0.016815185546875 time for calcul the mask position with numpy : 0.03816676139831543 nb_pixel_total : 17615 time to create 1 rle with old method : 0.02977156639099121 time for calcul the mask position with numpy : 0.034429311752319336 nb_pixel_total : 10561 time to create 1 rle with old method : 0.012848615646362305 time for calcul the mask position with numpy : 0.031658172607421875 nb_pixel_total : 2137 time to create 1 rle with old method : 0.0027587413787841797 time for calcul the mask position with numpy : 0.030890226364135742 nb_pixel_total : 3253 time to create 1 rle with old method : 0.004049539566040039 time for calcul the mask position with numpy : 0.029260635375976562 nb_pixel_total : 28688 time to create 1 rle with old method : 0.035103797912597656 time for calcul the mask position with numpy : 0.029193878173828125 nb_pixel_total : 23496 time to create 1 rle with old method : 0.028545618057250977 time for calcul the mask position with numpy : 0.028928279876708984 nb_pixel_total : 9709 time to create 1 rle with old method : 0.011975765228271484 time for calcul the mask position with numpy : 0.029450416564941406 nb_pixel_total : 11617 time to create 1 rle with old method : 0.014321327209472656 time for calcul the mask position with numpy : 0.029712200164794922 nb_pixel_total : 14052 time to create 1 rle with old method : 0.017151832580566406 time for calcul the mask position with numpy : 0.029148578643798828 nb_pixel_total : 5736 time to create 1 rle with old method : 0.007180213928222656 time for calcul the mask position with numpy : 0.029010295867919922 nb_pixel_total : 7079 time to create 1 rle with old method : 0.008561134338378906 time for calcul the mask position with numpy : 0.02953195571899414 nb_pixel_total : 20628 time to create 1 rle with old method : 0.02499246597290039 time for calcul the mask position with numpy : 0.02930593490600586 nb_pixel_total : 25318 time to create 1 rle with old method : 0.030511140823364258 time for calcul the mask position with numpy : 0.03431844711303711 nb_pixel_total : 8683 time to create 1 rle with old method : 0.01058053970336914 create new chi : 3.0081334114074707 time to delete rle : 0.001600027084350586 batch 1 Loaded 57 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++Number RLEs to save : 11001 TO DO : save crop sub photo not yet done ! save time : 0.7220125198364258 nb_obj : 17 nb_hashtags : 2 time to prepare the origin masks : 5.084139347076416 time for calcul the mask position with numpy : 0.6350653171539307 nb_pixel_total : 6734035 time to create 1 rle with new method : 0.633965015411377 time for calcul the mask position with numpy : 0.03932070732116699 nb_pixel_total : 13157 time to create 1 rle with old method : 0.019059181213378906 time for calcul the mask position with numpy : 0.0386049747467041 nb_pixel_total : 8035 time to create 1 rle with old method : 0.00984811782836914 time for calcul the mask position with numpy : 0.035529375076293945 nb_pixel_total : 14682 time to create 1 rle with old method : 0.017729997634887695 time for calcul the mask position with numpy : 0.03169417381286621 nb_pixel_total : 6640 time to create 1 rle with old method : 0.010728120803833008 time for calcul the mask position with numpy : 0.04014873504638672 nb_pixel_total : 18306 time to create 1 rle with old method : 0.030358552932739258 time for calcul the mask position with numpy : 0.02693319320678711 nb_pixel_total : 47802 time to create 1 rle with old method : 0.058114051818847656 time for calcul the mask position with numpy : 0.022015810012817383 nb_pixel_total : 44256 time to create 1 rle with old method : 0.059305667877197266 time for calcul the mask position with numpy : 0.021646738052368164 nb_pixel_total : 3242 time to create 1 rle with old method : 0.003858327865600586 time for calcul the mask position with numpy : 0.021541595458984375 nb_pixel_total : 11931 time to create 1 rle with old method : 0.013941526412963867 time for calcul the mask position with numpy : 0.02123856544494629 nb_pixel_total : 33594 time to create 1 rle with old method : 0.039045095443725586 time for calcul the mask position with numpy : 0.021245718002319336 nb_pixel_total : 6264 time to create 1 rle with old method : 0.0075778961181640625 time for calcul the mask position with numpy : 0.022058486938476562 nb_pixel_total : 24916 time to create 1 rle with old method : 0.031241893768310547 time for calcul the mask position with numpy : 0.022261619567871094 nb_pixel_total : 25694 time to create 1 rle with old method : 0.04079937934875488 time for calcul the mask position with numpy : 0.0248870849609375 nb_pixel_total : 10497 time to create 1 rle with old method : 0.01801753044128418 time for calcul the mask position with numpy : 0.022357940673828125 nb_pixel_total : 11871 time to create 1 rle with old method : 0.015079498291015625 time for calcul the mask position with numpy : 0.025236129760742188 nb_pixel_total : 23486 time to create 1 rle with old method : 0.04073739051818848 time for calcul the mask position with numpy : 0.02368021011352539 nb_pixel_total : 11832 time to create 1 rle with old method : 0.014295101165771484 create new chi : 2.201375961303711 time to delete rle : 0.0011608600616455078 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 7692 TO DO : save crop sub photo not yet done ! save time : 0.4750208854675293 nb_obj : 19 nb_hashtags : 2 time to prepare the origin masks : 6.172358751296997 time for calcul the mask position with numpy : 0.6006958484649658 nb_pixel_total : 6454703 time to create 1 rle with new method : 0.8705184459686279 time for calcul the mask position with numpy : 0.03625369071960449 nb_pixel_total : 13642 time to create 1 rle with old method : 0.01660013198852539 time for calcul the mask position with numpy : 0.02236795425415039 nb_pixel_total : 17830 time to create 1 rle with old method : 0.024121522903442383 time for calcul the mask position with numpy : 0.021779775619506836 nb_pixel_total : 84251 time to create 1 rle with old method : 0.09754586219787598 time for calcul the mask position with numpy : 0.02225947380065918 nb_pixel_total : 21538 time to create 1 rle with old method : 0.028510570526123047 time for calcul the mask position with numpy : 0.023105859756469727 nb_pixel_total : 18399 time to create 1 rle with old method : 0.032004356384277344 time for calcul the mask position with numpy : 0.02342844009399414 nb_pixel_total : 13852 time to create 1 rle with old method : 0.022557497024536133 time for calcul the mask position with numpy : 0.022012710571289062 nb_pixel_total : 4969 time to create 1 rle with old method : 0.006038665771484375 time for calcul the mask position with numpy : 0.021925687789916992 nb_pixel_total : 194727 time to create 1 rle with new method : 0.6476335525512695 time for calcul the mask position with numpy : 0.020134925842285156 nb_pixel_total : 14005 time to create 1 rle with old method : 0.01613140106201172 time for calcul the mask position with numpy : 0.02084636688232422 nb_pixel_total : 10954 time to create 1 rle with old method : 0.012537479400634766 time for calcul the mask position with numpy : 0.02046513557434082 nb_pixel_total : 12825 time to create 1 rle with old method : 0.015064477920532227 time for calcul the mask position with numpy : 0.02157282829284668 nb_pixel_total : 26063 time to create 1 rle with old method : 0.031208038330078125 time for calcul the mask position with numpy : 0.021306514739990234 nb_pixel_total : 47437 time to create 1 rle with old method : 0.05635571479797363 time for calcul the mask position with numpy : 0.024011850357055664 nb_pixel_total : 8381 time to create 1 rle with old method : 0.01002645492553711 time for calcul the mask position with numpy : 0.021605730056762695 nb_pixel_total : 20294 time to create 1 rle with old method : 0.023722410202026367 time for calcul the mask position with numpy : 0.02301335334777832 nb_pixel_total : 22761 time to create 1 rle with old method : 0.03919577598571777 time for calcul the mask position with numpy : 0.0235135555267334 nb_pixel_total : 38764 time to create 1 rle with old method : 0.04716229438781738 time for calcul the mask position with numpy : 0.022711753845214844 nb_pixel_total : 10022 time to create 1 rle with old method : 0.0121002197265625 time for calcul the mask position with numpy : 0.022429227828979492 nb_pixel_total : 14823 time to create 1 rle with old method : 0.01795649528503418 create new chi : 3.129227638244629 time to delete rle : 0.0016090869903564453 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 9655 TO DO : save crop sub photo not yet done ! save time : 0.6408436298370361 nb_obj : 30 nb_hashtags : 3 time to prepare the origin masks : 3.8593695163726807 time for calcul the mask position with numpy : 0.4367692470550537 nb_pixel_total : 6211224 time to create 1 rle with new method : 0.577908992767334 time for calcul the mask position with numpy : 0.026912212371826172 nb_pixel_total : 22267 time to create 1 rle with old method : 0.025728702545166016 time for calcul the mask position with numpy : 0.028217792510986328 nb_pixel_total : 19362 time to create 1 rle with old method : 0.022538423538208008 time for calcul the mask position with numpy : 0.028129100799560547 nb_pixel_total : 80606 time to create 1 rle with old method : 0.0911259651184082 time for calcul the mask position with numpy : 0.028323650360107422 nb_pixel_total : 53022 time to create 1 rle with old method : 0.06467938423156738 time for calcul the mask position with numpy : 0.02836298942565918 nb_pixel_total : 30960 time to create 1 rle with old method : 0.03660464286804199 time for calcul the mask position with numpy : 0.02788829803466797 nb_pixel_total : 21768 time to create 1 rle with old method : 0.026290178298950195 time for calcul the mask position with numpy : 0.029202699661254883 nb_pixel_total : 7433 time to create 1 rle with old method : 0.00938725471496582 time for calcul the mask position with numpy : 0.029112815856933594 nb_pixel_total : 21774 time to create 1 rle with old method : 0.025963306427001953 time for calcul the mask position with numpy : 0.02773904800415039 nb_pixel_total : 17866 time to create 1 rle with old method : 0.021146297454833984 time for calcul the mask position with numpy : 0.028104782104492188 nb_pixel_total : 53847 time to create 1 rle with old method : 0.07082366943359375 time for calcul the mask position with numpy : 0.027886152267456055 nb_pixel_total : 29329 time to create 1 rle with old method : 0.03447890281677246 time for calcul the mask position with numpy : 0.027364730834960938 nb_pixel_total : 18381 time to create 1 rle with old method : 0.021832942962646484 time for calcul the mask position with numpy : 0.027773380279541016 nb_pixel_total : 19807 time to create 1 rle with old method : 0.024309396743774414 time for calcul the mask position with numpy : 0.027561426162719727 nb_pixel_total : 22713 time to create 1 rle with old method : 0.026083946228027344 time for calcul the mask position with numpy : 0.02686595916748047 nb_pixel_total : 19470 time to create 1 rle with old method : 0.02213001251220703 time for calcul the mask position with numpy : 0.027248859405517578 nb_pixel_total : 9439 time to create 1 rle with old method : 0.01588726043701172 time for calcul the mask position with numpy : 0.03285527229309082 nb_pixel_total : 22451 time to create 1 rle with old method : 0.03761744499206543 time for calcul the mask position with numpy : 0.028940200805664062 nb_pixel_total : 65023 time to create 1 rle with old method : 0.07861113548278809 time for calcul the mask position with numpy : 0.029633760452270508 nb_pixel_total : 26894 time to create 1 rle with old method : 0.03626418113708496 time for calcul the mask position with numpy : 0.02866673469543457 nb_pixel_total : 33127 time to create 1 rle with old method : 0.03900742530822754 time for calcul the mask position with numpy : 0.028051376342773438 nb_pixel_total : 62743 time to create 1 rle with old method : 0.07384943962097168 time for calcul the mask position with numpy : 0.0282285213470459 nb_pixel_total : 21150 time to create 1 rle with old method : 0.026113271713256836 time for calcul the mask position with numpy : 0.037129878997802734 nb_pixel_total : 8654 time to create 1 rle with old method : 0.01642155647277832 time for calcul the mask position with numpy : 0.038552284240722656 nb_pixel_total : 30832 time to create 1 rle with old method : 0.05604076385498047 time for calcul the mask position with numpy : 0.03816938400268555 nb_pixel_total : 13232 time to create 1 rle with old method : 0.023572444915771484 time for calcul the mask position with numpy : 0.02966165542602539 nb_pixel_total : 19750 time to create 1 rle with old method : 0.02350330352783203 time for calcul the mask position with numpy : 0.028549909591674805 nb_pixel_total : 43926 time to create 1 rle with old method : 0.051885366439819336 time for calcul the mask position with numpy : 0.027864933013916016 nb_pixel_total : 25349 time to create 1 rle with old method : 0.029659032821655273 time for calcul the mask position with numpy : 0.028554201126098633 nb_pixel_total : 6791 time to create 1 rle with old method : 0.00819706916809082 time for calcul the mask position with numpy : 0.027822017669677734 nb_pixel_total : 11050 time to create 1 rle with old method : 0.012789011001586914 create new chi : 2.9809296131134033 time to delete rle : 0.002084016799926758 batch 1 Loaded 61 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++Number RLEs to save : 14854 TO DO : save crop sub photo not yet done ! save time : 0.9367334842681885 nb_obj : 37 nb_hashtags : 3 time to prepare the origin masks : 4.130568265914917 time for calcul the mask position with numpy : 0.8780384063720703 nb_pixel_total : 5799021 time to create 1 rle with new method : 1.087651252746582 time for calcul the mask position with numpy : 0.029297828674316406 nb_pixel_total : 13205 time to create 1 rle with old method : 0.016542911529541016 time for calcul the mask position with numpy : 0.03212332725524902 nb_pixel_total : 28320 time to create 1 rle with old method : 0.0346527099609375 time for calcul the mask position with numpy : 0.029424190521240234 nb_pixel_total : 53795 time to create 1 rle with old method : 0.06712555885314941 time for calcul the mask position with numpy : 0.030934572219848633 nb_pixel_total : 30984 time to create 1 rle with old method : 0.03894495964050293 time for calcul the mask position with numpy : 0.030895471572875977 nb_pixel_total : 9565 time to create 1 rle with old method : 0.011735916137695312 time for calcul the mask position with numpy : 0.029154300689697266 nb_pixel_total : 24169 time to create 1 rle with old method : 0.029595136642456055 time for calcul the mask position with numpy : 0.02916121482849121 nb_pixel_total : 11015 time to create 1 rle with old method : 0.0135498046875 time for calcul the mask position with numpy : 0.029207706451416016 nb_pixel_total : 6231 time to create 1 rle with old method : 0.007866621017456055 time for calcul the mask position with numpy : 0.029674768447875977 nb_pixel_total : 38532 time to create 1 rle with old method : 0.04746127128601074 time for calcul the mask position with numpy : 0.030242919921875 nb_pixel_total : 28811 time to create 1 rle with old method : 0.034958839416503906 time for calcul the mask position with numpy : 0.029329299926757812 nb_pixel_total : 18903 time to create 1 rle with old method : 0.023069143295288086 time for calcul the mask position with numpy : 0.03142595291137695 nb_pixel_total : 19263 time to create 1 rle with old method : 0.023313283920288086 time for calcul the mask position with numpy : 0.03911638259887695 nb_pixel_total : 8301 time to create 1 rle with old method : 0.013863801956176758 time for calcul the mask position with numpy : 0.033701419830322266 nb_pixel_total : 31086 time to create 1 rle with old method : 0.04458332061767578 time for calcul the mask position with numpy : 0.03878450393676758 nb_pixel_total : 33120 time to create 1 rle with old method : 0.04450798034667969 time for calcul the mask position with numpy : 0.0301516056060791 nb_pixel_total : 2921 time to create 1 rle with old method : 0.003862619400024414 time for calcul the mask position with numpy : 0.030326128005981445 nb_pixel_total : 9891 time to create 1 rle with old method : 0.013218402862548828 time for calcul the mask position with numpy : 0.03257894515991211 nb_pixel_total : 73560 time to create 1 rle with old method : 0.09372258186340332 time for calcul the mask position with numpy : 0.029144763946533203 nb_pixel_total : 26641 time to create 1 rle with old method : 0.03280377388000488 time for calcul the mask position with numpy : 0.029536962509155273 nb_pixel_total : 16050 time to create 1 rle with old method : 0.02248525619506836 time for calcul the mask position with numpy : 0.029230594635009766 nb_pixel_total : 14057 time to create 1 rle with old method : 0.017777204513549805 time for calcul the mask position with numpy : 0.03124213218688965 nb_pixel_total : 28039 time to create 1 rle with old method : 0.03537178039550781 time for calcul the mask position with numpy : 0.03111433982849121 nb_pixel_total : 221024 time to create 1 rle with new method : 1.1139452457427979 time for calcul the mask position with numpy : 0.02927875518798828 nb_pixel_total : 13861 time to create 1 rle with old method : 0.016860008239746094 time for calcul the mask position with numpy : 0.029256820678710938 nb_pixel_total : 7014 time to create 1 rle with old method : 0.008592844009399414 time for calcul the mask position with numpy : 0.029276371002197266 nb_pixel_total : 12555 time to create 1 rle with old method : 0.01542973518371582 time for calcul the mask position with numpy : 0.02925729751586914 nb_pixel_total : 16917 time to create 1 rle with old method : 0.020422935485839844 time for calcul the mask position with numpy : 0.029057741165161133 nb_pixel_total : 19799 time to create 1 rle with old method : 0.029144287109375 time for calcul the mask position with numpy : 0.03303861618041992 nb_pixel_total : 18919 time to create 1 rle with old method : 0.030024051666259766 time for calcul the mask position with numpy : 0.02933049201965332 nb_pixel_total : 43432 time to create 1 rle with old method : 0.05171561241149902 time for calcul the mask position with numpy : 0.029204845428466797 nb_pixel_total : 44782 time to create 1 rle with old method : 0.05286002159118652 time for calcul the mask position with numpy : 0.028840303421020508 nb_pixel_total : 15865 time to create 1 rle with old method : 0.01891303062438965 time for calcul the mask position with numpy : 0.02825307846069336 nb_pixel_total : 8508 time to create 1 rle with old method : 0.010249137878417969 time for calcul the mask position with numpy : 0.0313420295715332 nb_pixel_total : 186885 time to create 1 rle with new method : 0.6281936168670654 time for calcul the mask position with numpy : 0.028317928314208984 nb_pixel_total : 6570 time to create 1 rle with old method : 0.007927656173706055 time for calcul the mask position with numpy : 0.027517080307006836 nb_pixel_total : 99160 time to create 1 rle with old method : 0.11423420906066895 time for calcul the mask position with numpy : 0.030843734741210938 nb_pixel_total : 9469 time to create 1 rle with old method : 0.011268854141235352 create new chi : 5.986888408660889 time to delete rle : 0.002691030502319336 batch 1 Loaded 75 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 20372 TO DO : save crop sub photo not yet done ! save time : 1.2548339366912842 nb_obj : 27 nb_hashtags : 3 time to prepare the origin masks : 4.051060676574707 time for calcul the mask position with numpy : 0.4372518062591553 nb_pixel_total : 6031747 time to create 1 rle with new method : 0.5801146030426025 time for calcul the mask position with numpy : 0.029675006866455078 nb_pixel_total : 25410 time to create 1 rle with old method : 0.030689001083374023 time for calcul the mask position with numpy : 0.029509544372558594 nb_pixel_total : 15144 time to create 1 rle with old method : 0.019549131393432617 time for calcul the mask position with numpy : 0.03204464912414551 nb_pixel_total : 72835 time to create 1 rle with old method : 0.10909271240234375 time for calcul the mask position with numpy : 0.0312042236328125 nb_pixel_total : 14172 time to create 1 rle with old method : 0.01703953742980957 time for calcul the mask position with numpy : 0.03266620635986328 nb_pixel_total : 35665 time to create 1 rle with old method : 0.05736994743347168 time for calcul the mask position with numpy : 0.029561519622802734 nb_pixel_total : 15401 time to create 1 rle with old method : 0.018781423568725586 time for calcul the mask position with numpy : 0.029172897338867188 nb_pixel_total : 14348 time to create 1 rle with old method : 0.018727779388427734 time for calcul the mask position with numpy : 0.032926082611083984 nb_pixel_total : 18790 time to create 1 rle with old method : 0.031790971755981445 time for calcul the mask position with numpy : 0.03249335289001465 nb_pixel_total : 116592 time to create 1 rle with old method : 0.13920354843139648 time for calcul the mask position with numpy : 0.02887415885925293 nb_pixel_total : 12753 time to create 1 rle with old method : 0.015548229217529297 time for calcul the mask position with numpy : 0.02871561050415039 nb_pixel_total : 10848 time to create 1 rle with old method : 0.013334512710571289 time for calcul the mask position with numpy : 0.029186248779296875 nb_pixel_total : 59747 time to create 1 rle with old method : 0.07196283340454102 time for calcul the mask position with numpy : 0.028394460678100586 nb_pixel_total : 16028 time to create 1 rle with old method : 0.01898050308227539 time for calcul the mask position with numpy : 0.028469085693359375 nb_pixel_total : 31074 time to create 1 rle with old method : 0.03671073913574219 time for calcul the mask position with numpy : 0.02700328826904297 nb_pixel_total : 78715 time to create 1 rle with old method : 0.09185290336608887 time for calcul the mask position with numpy : 0.028206348419189453 nb_pixel_total : 64768 time to create 1 rle with old method : 0.0763702392578125 time for calcul the mask position with numpy : 0.028989076614379883 nb_pixel_total : 45433 time to create 1 rle with old method : 0.053784847259521484 time for calcul the mask position with numpy : 0.029244422912597656 nb_pixel_total : 52017 time to create 1 rle with old method : 0.0633699893951416 time for calcul the mask position with numpy : 0.029592037200927734 nb_pixel_total : 96682 time to create 1 rle with old method : 0.12457275390625 time for calcul the mask position with numpy : 0.028789997100830078 nb_pixel_total : 14976 time to create 1 rle with old method : 0.017435550689697266 time for calcul the mask position with numpy : 0.029007434844970703 nb_pixel_total : 24808 time to create 1 rle with old method : 0.029322147369384766 time for calcul the mask position with numpy : 0.02931046485900879 nb_pixel_total : 65868 time to create 1 rle with old method : 0.0847463607788086 time for calcul the mask position with numpy : 0.029253721237182617 nb_pixel_total : 32111 time to create 1 rle with old method : 0.03838658332824707 time for calcul the mask position with numpy : 0.029279470443725586 nb_pixel_total : 31960 time to create 1 rle with old method : 0.038616180419921875 time for calcul the mask position with numpy : 0.03380560874938965 nb_pixel_total : 27520 time to create 1 rle with old method : 0.03297877311706543 time for calcul the mask position with numpy : 0.02919173240661621 nb_pixel_total : 9540 time to create 1 rle with old method : 0.011643171310424805 time for calcul the mask position with numpy : 0.029511213302612305 nb_pixel_total : 15288 time to create 1 rle with old method : 0.020014047622680664 create new chi : 3.1413414478302 time to delete rle : 0.002699136734008789 batch 1 Loaded 55 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++Number RLEs to save : 16353 TO DO : save crop sub photo not yet done ! save time : 1.0444257259368896 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 7.434696674346924 time for calcul the mask position with numpy : 0.5328407287597656 nb_pixel_total : 6438094 time to create 1 rle with new method : 0.662590503692627 time for calcul the mask position with numpy : 0.03323721885681152 nb_pixel_total : 21020 time to create 1 rle with old method : 0.024225234985351562 time for calcul the mask position with numpy : 0.03528451919555664 nb_pixel_total : 6642 time to create 1 rle with old method : 0.0077745914459228516 time for calcul the mask position with numpy : 0.035295963287353516 nb_pixel_total : 46007 time to create 1 rle with old method : 0.057652950286865234 time for calcul the mask position with numpy : 0.03601264953613281 nb_pixel_total : 14441 time to create 1 rle with old method : 0.018805980682373047 time for calcul the mask position with numpy : 0.0340421199798584 nb_pixel_total : 29545 time to create 1 rle with old method : 0.03472447395324707 time for calcul the mask position with numpy : 0.03312420845031738 nb_pixel_total : 18915 time to create 1 rle with old method : 0.022551298141479492 time for calcul the mask position with numpy : 0.03262019157409668 nb_pixel_total : 17877 time to create 1 rle with old method : 0.021260976791381836 time for calcul the mask position with numpy : 0.03246426582336426 nb_pixel_total : 41482 time to create 1 rle with old method : 0.04797101020812988 time for calcul the mask position with numpy : 0.020447731018066406 nb_pixel_total : 45759 time to create 1 rle with old method : 0.05560469627380371 time for calcul the mask position with numpy : 0.0206754207611084 nb_pixel_total : 26973 time to create 1 rle with old method : 0.0315089225769043 time for calcul the mask position with numpy : 0.021852731704711914 nb_pixel_total : 104772 time to create 1 rle with old method : 0.1212613582611084 time for calcul the mask position with numpy : 0.02070760726928711 nb_pixel_total : 17197 time to create 1 rle with old method : 0.021256685256958008 time for calcul the mask position with numpy : 0.031514644622802734 nb_pixel_total : 86499 time to create 1 rle with old method : 0.10122036933898926 time for calcul the mask position with numpy : 0.04070091247558594 nb_pixel_total : 13781 time to create 1 rle with old method : 0.016602754592895508 time for calcul the mask position with numpy : 0.035671234130859375 nb_pixel_total : 22600 time to create 1 rle with old method : 0.027498483657836914 time for calcul the mask position with numpy : 0.03312969207763672 nb_pixel_total : 16393 time to create 1 rle with old method : 0.01965928077697754 time for calcul the mask position with numpy : 0.03599071502685547 nb_pixel_total : 29705 time to create 1 rle with old method : 0.03539538383483887 time for calcul the mask position with numpy : 0.0364842414855957 nb_pixel_total : 52538 time to create 1 rle with old method : 0.06286859512329102 create new chi : 2.526909112930298 time to delete rle : 0.0015492439270019531 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 10407 TO DO : save crop sub photo not yet done ! save time : 0.6566452980041504 map_output_result : {1350017016: (0.0, 'Should be the crop_list due to order', 0), 1350016973: (0.0, 'Should be the crop_list due to order', 0), 1350016970: (0.0, 'Should be the crop_list due to order', 0), 1350016966: (0.0, 'Should be the crop_list due to order', 0), 1350016960: (0.0, 'Should be the crop_list due to order', 0), 1350016954: (0.0, 'Should be the crop_list due to order', 0), 1350016948: (0.0, 'Should be the crop_list due to order', 0), 1350016856: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1350017016, 1350016973, 1350016970, 1350016966, 1350016960, 1350016954, 1350016948, 1350016856] Looping around the photos to save general results len do output : 8 /1350017016.Didn't retrieve data . /1350016973.Didn't retrieve data . /1350016970.Didn't retrieve data . /1350016966.Didn't retrieve data . /1350016960.Didn't retrieve data . /1350016954.Didn't retrieve data . /1350016948.Didn't retrieve data . /1350016856.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350017016', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016973', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016970', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016966', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016960', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016954', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016948', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016856', None, None, None, None, None, '2723667') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.01565241813659668 save_final save missing photos in datou_result : time spend for datou_step_exec : 71.6304202079773 time spend to save output : 0.01942276954650879 total time spend for step 3 : 71.6498429775238 step4:ventilate_hashtags_in_portfolio Tue Apr 15 22:24:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22051915 get user id for portfolio 22051915 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22051915 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','mal_croppe','pehd','autre','carton','flou','pet_clair','environnement','pet_fonce','background','papier')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22051915 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','mal_croppe','pehd','autre','carton','flou','pet_clair','environnement','pet_fonce','background','papier')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22051915 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','mal_croppe','pehd','autre','carton','flou','pet_clair','environnement','pet_fonce','background','papier')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22052162,22052163,22052164,22052165,22052166,22052167,22052168,22052169,22052170,22052171,22052172?tags=metal,mal_croppe,pehd,autre,carton,flou,pet_clair,environnement,pet_fonce,background,papier Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1350017016, 1350016973, 1350016970, 1350016966, 1350016960, 1350016954, 1350016948, 1350016856] Looping around the photos to save general results len do output : 1 /22051915. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350017016', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016973', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016970', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016966', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016960', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016954', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016948', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016856', None, None, None, None, None, '2723667') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.0119781494140625 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5716664791107178 time spend to save output : 0.012276172637939453 total time spend for step 4 : 1.5839426517486572 step5:final Tue Apr 15 22:24:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1350017016: ('0.09394774149532498',), 1350016973: ('0.09394774149532498',), 1350016970: ('0.09394774149532498',), 1350016966: ('0.09394774149532498',), 1350016960: ('0.09394774149532498',), 1350016954: ('0.09394774149532498',), 1350016948: ('0.09394774149532498',), 1350016856: ('0.09394774149532498',)} new output for save of step final : {1350017016: ('0.09394774149532498',), 1350016973: ('0.09394774149532498',), 1350016970: ('0.09394774149532498',), 1350016966: ('0.09394774149532498',), 1350016960: ('0.09394774149532498',), 1350016954: ('0.09394774149532498',), 1350016948: ('0.09394774149532498',), 1350016856: ('0.09394774149532498',)} [1350017016, 1350016973, 1350016970, 1350016966, 1350016960, 1350016954, 1350016948, 1350016856] Looping around the photos to save general results len do output : 8 /1350017016.Didn't retrieve data . /1350016973.Didn't retrieve data . /1350016970.Didn't retrieve data . /1350016966.Didn't retrieve data . /1350016960.Didn't retrieve data . /1350016954.Didn't retrieve data . /1350016948.Didn't retrieve data . /1350016856.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350017016', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016973', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016970', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016966', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016960', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016954', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016948', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016856', None, None, None, None, None, '2723667') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.0162351131439209 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.09983062744140625 time spend to save output : 0.016852378845214844 total time spend for step 5 : 0.1166830062866211 step6:blur_detection Tue Apr 15 22:24:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1744748426_1532623_1350017016_cf643d6d820539851276ba01fe0a42f0.jpg resize: (2160, 3264) 1350017016 -2.1717787576238123 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec.jpg resize: (2160, 3264) 1350016973 -6.455696715472253 treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964.jpg resize: (2160, 3264) 1350016970 -3.639939658206311 treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d.jpg resize: (2160, 3264) 1350016966 -1.6654240763382886 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0.jpg resize: (2160, 3264) 1350016960 -4.270747755632283 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f.jpg resize: (2160, 3264) 1350016954 -4.3102017433553215 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310.jpg resize: (2160, 3264) 1350016948 -4.853111803730512 treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772.jpg resize: (2160, 3264) 1350016856 -0.6040500042219484 treat image : temp/1744748426_1532623_1350017016_cf643d6d820539851276ba01fe0a42f0_rle_crop_3747541874_0.png resize: (60, 145) 1350038751 -0.38191394095547976 treat image : temp/1744748426_1532623_1350017016_cf643d6d820539851276ba01fe0a42f0_rle_crop_3747541876_0.png resize: (462, 400) 1350038752 -1.7319099268156914 treat image : temp/1744748426_1532623_1350017016_cf643d6d820539851276ba01fe0a42f0_rle_crop_3747541877_0.png resize: (180, 322) 1350038753 -3.006884225613068 treat image : temp/1744748426_1532623_1350017016_cf643d6d820539851276ba01fe0a42f0_rle_crop_3747541873_0.png resize: (347, 172) 1350038754 -3.091804562152276 treat image : temp/1744748426_1532623_1350017016_cf643d6d820539851276ba01fe0a42f0_rle_crop_3747541875_0.png resize: (101, 203) 1350038757 -1.289999895380134 treat image : temp/1744748426_1532623_1350017016_cf643d6d820539851276ba01fe0a42f0_rle_crop_3747541872_0.png resize: (197, 137) 1350038758 0.8504689323445606 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541891_0.png resize: (292, 138) 1350038760 -3.423750628925261 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541885_0.png resize: (225, 254) 1350038761 -3.8132561736314936 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541879_0.png resize: (143, 184) 1350038763 -2.964180287997169 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541888_0.png resize: (98, 162) 1350038764 -4.254631244257349 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541901_0.png resize: (60, 47) 1350038765 -2.114985578020897 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541902_0.png resize: (242, 116) 1350038766 -3.1277478330230233 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541897_0.png resize: (252, 119) 1350038768 -2.619006925686897 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541905_0.png resize: (137, 135) 1350038769 -4.627845434353185 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541890_0.png resize: (162, 322) 1350038770 -2.8862515912468334 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541892_0.png resize: (101, 78) 1350038772 -2.737449038499773 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541906_0.png resize: (206, 195) 1350038773 -4.522106325339669 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541881_0.png resize: (219, 260) 1350038774 -3.589481630089424 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541899_0.png resize: (70, 147) 1350038775 -4.401946710098983 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541898_0.png resize: (181, 120) 1350038777 -4.405693040815046 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541893_0.png resize: (114, 138) 1350038778 -4.50143354514556 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541884_0.png resize: (92, 106) 1350038779 -0.4984886025920015 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541894_0.png resize: (228, 169) 1350038780 -4.571902652866027 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541886_0.png resize: (121, 120) 1350038782 -2.3051644137784337 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541880_0.png resize: (78, 166) 1350038783 -1.468716201874077 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541900_0.png resize: (69, 68) 1350038784 -3.7180776053275904 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541903_0.png resize: (122, 144) 1350038785 -3.788437018884432 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541895_0.png resize: (250, 207) 1350038787 -4.401663006044891 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541883_0.png resize: (123, 283) 1350038788 -3.278229779631082 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541887_0.png resize: (159, 127) 1350038789 -1.9572782669474602 treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541916_0.png resize: (118, 53) 1350038791 -2.9245271326194624 treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541913_0.png resize: (101, 87) 1350038792 -1.1254297166485647 treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541920_0.png resize: (72, 105) 1350038793 3.2793136144265644 treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541923_0.png resize: (162, 125) 1350038794 -0.4493044505024109 treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541922_0.png resize: (114, 109) 1350038796 -1.4947050210826842 treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541912_0.png resize: (156, 198) 1350038797 -0.5928574510932832 treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541917_0.png resize: (188, 298) 1350038798 -1.2688829506567332 treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541915_0.png resize: (117, 126) 1350038799 -4.018105380716729 treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541907_0.png resize: (145, 121) 1350038802 -0.48791659659081715 treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541918_0.png resize: (294, 392) 1350038803 -3.5991205747576065 treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541908_0.png resize: (177, 184) 1350038804 -1.9871927911280292 treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541911_0.png resize: (219, 209) 1350038805 -2.006056546574007 treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541914_0.png resize: (129, 417) 1350038807 -1.6575457815012002 treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541909_0.png resize: (158, 153) 1350038808 -0.6481259073182986 treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541921_0.png resize: (136, 131) 1350038809 -1.5794237446727692 treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541919_0.png resize: (119, 235) 1350038810 -2.5400795251314587 treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541940_0.png resize: (324, 350) 1350038812 -1.4274983489019066 treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541930_0.png resize: (313, 276) 1350038813 -2.2650180456290974 treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541927_0.png resize: (183, 210) 1350038814 -1.0336059654324818 treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541936_0.png resize: (73, 77) 1350038815 2.3118459516220473 treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541939_0.png resize: (183, 200) 1350038817 -0.011595853641484171 treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541935_0.png resize: (607, 519) 1350038818 -1.234590676649102 treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541933_0.png resize: (145, 123) 1350038819 -0.8063843593045085 treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541925_0.png resize: (127, 115) 1350038820 -1.251412077647585 treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541926_0.png resize: (218, 511) 1350038822 -1.3227332507002199 treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541937_0.png resize: (97, 199) 1350038823 -1.4235139473450134 treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541931_0.png resize: (164, 273) 1350038824 -1.4731317387282952 treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541934_0.png resize: (123, 160) 1350038825 -1.7190882626671566 treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541928_0.png resize: (181, 157) 1350038827 -2.1721873165280354 treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541924_0.png resize: (142, 121) 1350038828 2.6921352981220443 treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541932_0.png resize: (118, 161) 1350038829 -1.9285215648746046 treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541938_0.png resize: (96, 259) 1350038831 -1.2537845848924012 treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541942_0.png resize: (126, 141) 1350038832 -0.3622264552592918 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541953_0.png resize: (167, 208) 1350038833 -1.96031549903302 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541944_0.png resize: (166, 166) 1350038834 -0.35939475227211887 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541958_0.png resize: (114, 261) 1350038836 -0.7093450271594778 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541947_0.png resize: (212, 207) 1350038837 -2.28849040497367 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541955_0.png resize: (107, 91) 1350038838 -3.0383637520156643 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541963_0.png resize: (166, 203) 1350038840 -1.7352584998486569 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541972_0.png resize: (215, 242) 1350038841 -2.417181217511991 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541954_0.png resize: (249, 320) 1350038842 -0.9770014442898928 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541945_0.png resize: (86, 129) 1350038843 -0.8554907835162731 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541960_0.png resize: (165, 258) 1350038845 -1.150415881931392 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541957_0.png resize: (226, 204) 1350038846 -3.0627592744221044 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541971_0.png resize: (149, 168) 1350038847 0.5316691703249372 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541956_0.png resize: (130, 116) 1350038848 -1.554641910958822 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541951_0.png resize: (343, 530) 1350038850 -3.331754003857136 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541952_0.png resize: (157, 278) 1350038851 -0.9084064396991017 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541968_0.png resize: (80, 152) 1350038852 -0.9711403674832366 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541961_0.png resize: (187, 126) 1350038854 -1.4217522189769363 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541949_0.png resize: (217, 175) 1350038855 -2.5850849865115406 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541975_0.png resize: (397, 248) 1350038856 -2.5220870749354134 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541982_0.png resize: (545, 451) 1350038858 -1.4290499836125332 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541999_0.png resize: (164, 148) 1350038860 -1.2792746995978983 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541990_0.png resize: (245, 146) 1350038861 -2.0985180391687233 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747542002_0.png resize: (163, 298) 1350038862 -1.228811936722831 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747542001_0.png resize: (123, 227) 1350038865 -2.361174039114258 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747542000_0.png resize: (104, 120) 1350038866 -1.7644949673515158 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747542008_0.png resize: (343, 395) 1350038867 -1.7341382205828624 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541973_0.png resize: (124, 169) 1350038868 -1.9506453258956518 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541986_0.png resize: (169, 277) 1350038872 -2.830002477602572 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541977_0.png resize: (357, 442) 1350038873 -3.1775270248928247 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747542005_0.png resize: (147, 88) 1350038874 -2.1412334815084044 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541976_0.png resize: (445, 251) 1350038877 -2.3591429103249077 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541980_0.png resize: (228, 183) 1350038878 -1.6357458373005993 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541974_0.png resize: (391, 144) 1350038879 -2.1034536229222693 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541978_0.png resize: (239, 167) 1350038881 -2.991051206327189 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541989_0.png resize: (462, 637) 1350038883 -3.6003173674419675 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747542003_0.png resize: (333, 186) 1350038884 -2.1996027239583666 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541979_0.png resize: (81, 139) 1350038886 -1.843683219452283 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541985_0.png resize: (155, 188) 1350038888 -1.8315674608321333 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747542004_0.png resize: (94, 173) 1350038889 -2.1135291252277444 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541998_0.png resize: (399, 282) 1350038890 -3.2603990019901823 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541983_0.png resize: (89, 142) 1350038893 -0.8755567901799387 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747542006_0.png resize: (108, 79) 1350038894 -0.5130561808701316 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541981_0.png resize: (186, 144) 1350038895 -2.727484568743945 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541992_0.png resize: (122, 287) 1350038897 -2.002051213670801 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541997_0.png resize: (236, 115) 1350038899 -2.370862446963641 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747542009_0.png resize: (209, 186) 1350038900 -1.5096468852146856 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541991_0.png resize: (190, 115) 1350038902 -2.692057025314161 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541994_0.png resize: (256, 183) 1350038904 -3.108954193290047 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541993_0.png resize: (222, 64) 1350038905 -3.618668901945807 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542016_0.png resize: (273, 144) 1350038906 -2.4720038358716634 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542018_0.png resize: (358, 416) 1350038909 -2.3731531095808447 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542030_0.png resize: (128, 132) 1350038910 -0.33446165698584335 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542014_0.png resize: (265, 212) 1350038911 -2.650393191495255 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542019_0.png resize: (315, 321) 1350038913 -2.113652209417589 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542013_0.png resize: (117, 170) 1350038915 -1.8080003039569983 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542022_0.png resize: (101, 184) 1350038916 -1.36715395271419 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542034_0.png resize: (164, 139) 1350038917 -2.2977263575322273 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542029_0.png resize: (308, 260) 1350038921 -3.1132610956941567 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542033_0.png resize: (245, 120) 1350038922 -2.029945915390612 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542015_0.png resize: (409, 425) 1350038923 -1.767296171167856 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542017_0.png resize: (500, 382) 1350038925 -2.2503561525881506 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542035_0.png resize: (127, 177) 1350038927 -0.930843197678988 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542031_0.png resize: (418, 411) 1350038929 -2.204145016056362 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542028_0.png resize: (187, 240) 1350038931 -1.6014830335894668 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542025_0.png resize: (148, 354) 1350038933 -2.455308618993906 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542011_0.png resize: (132, 154) 1350038934 -2.456990662157584 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542012_0.png resize: (295, 117) 1350038935 -3.412878831038693 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542023_0.png resize: (197, 212) 1350038937 -4.191283359201879 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542027_0.png resize: (277, 142) 1350038939 -2.78436145884075 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542036_0.png resize: (183, 154) 1350038940 -1.8831166144324525 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542021_0.png resize: (236, 306) 1350038942 -2.379579587770934 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542026_0.png resize: (350, 246) 1350038944 -3.7934825156265983 treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542051_0.png resize: (258, 83) 1350038945 -0.7693821639513094 treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542045_0.png resize: (264, 225) 1350038946 -0.6859116174297007 treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542052_0.png resize: (238, 272) 1350038949 -3.713447052839741 treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542050_0.png resize: (154, 276) 1350038950 -0.262431287876435 treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542049_0.png resize: (159, 166) 1350038951 0.8682900143151792 treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542047_0.png resize: (224, 386) 1350038953 -1.3671094814170406 treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542044_0.png resize: (437, 353) 1350038955 0.37169391423971176 treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542042_0.png resize: (294, 447) 1350038956 -0.7887273138772957 treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542046_0.png resize: (293, 218) 1350038958 -0.8306759633510667 treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542053_0.png resize: (81, 115) 1350038960 0.10329237811324661 treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542043_0.png resize: (171, 157) 1350038961 -2.95334501910216 treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542040_0.png resize: (117, 260) 1350038962 0.9852688157831887 treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542048_0.png resize: (162, 169) 1350038965 -1.1045710307937848 treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542039_0.png resize: (154, 157) 1350038966 -1.077279666960673 treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542041_0.png resize: (145, 169) 1350038967 -1.1265105541692728 treat image : temp/1744748426_1532623_1350017016_cf643d6d820539851276ba01fe0a42f0_rle_crop_3747541878_0.png resize: (126, 203) 1350039163 -0.30689265606170557 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541882_0.png resize: (107, 128) 1350039165 -1.6460342420184535 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541904_0.png resize: (137, 171) 1350039166 -3.2638175405916554 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541889_0.png resize: (117, 110) 1350039167 -3.777482202987579 treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541896_0.png resize: (140, 158) 1350039168 -2.8676516907918392 treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541910_0.png resize: (113, 122) 1350039170 -0.2241102313314098 treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541941_0.png resize: (149, 189) 1350039171 -1.2436735081901638 treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541929_0.png resize: (106, 121) 1350039172 -0.774768447954781 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541966_0.png resize: (156, 162) 1350039174 -1.791173845048862 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541965_0.png resize: (338, 295) 1350039175 -3.1826819607853807 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541967_0.png resize: (175, 98) 1350039176 -2.5672869382337486 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541970_0.png resize: (123, 272) 1350039177 -1.4151988992396478 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541964_0.png resize: (159, 187) 1350039179 -1.0257338101706006 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541959_0.png resize: (141, 221) 1350039180 -2.044323846326266 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541950_0.png resize: (401, 423) 1350039181 -3.6318356844255657 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541946_0.png resize: (242, 188) 1350039183 -2.923233200065698 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541948_0.png resize: (181, 212) 1350039184 -0.2956259578559338 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541943_0.png resize: (187, 204) 1350039185 -1.0978255310677365 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541995_0.png resize: (172, 240) 1350039186 -0.9865276697298331 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747542007_0.png resize: (127, 150) 1350039188 -2.107070311302397 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541996_0.png resize: (92, 176) 1350039189 0.7384700333552322 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541987_0.png resize: (149, 150) 1350039190 -0.6872662532111543 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541984_0.png resize: (216, 124) 1350039192 -1.3565969704128205 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542032_0.png resize: (136, 167) 1350039194 -1.5748226167462909 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542020_0.png resize: (119, 152) 1350039197 -2.1269417156279933 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542010_0.png resize: (321, 297) 1350039200 -2.4978631737900105 treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542038_0.png resize: (260, 193) 1350039204 -0.5897864681507382 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541969_0.png resize: (291, 291) 1350039278 -2.5199922149695237 treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541962_0.png resize: (339, 218) 1350039279 -3.6212356103108694 treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542024_0.png resize: (268, 309) 1350039280 -3.5970245617610654 treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542037_0.png resize: (266, 253) 1350039282 -2.57409761988092 treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542054_0.png resize: (243, 96) 1350039284 -0.3401300506215211 treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541988_0.png resize: (297, 178) 1350039302 -2.1464649847793003 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 191 time used for this insertion : 0.019393205642700195 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 191 time used for this insertion : 0.03177380561828613 save missing photos in datou_result : time spend for datou_step_exec : 29.515135288238525 time spend to save output : 0.05677056312561035 total time spend for step 6 : 29.571905851364136 step7:brightness Tue Apr 15 22:25:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1744748426_1532623_1350017016_cf643d6d820539851276ba01fe0a42f0.jpg treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec.jpg treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964.jpg treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d.jpg treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0.jpg treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f.jpg treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310.jpg treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772.jpg treat image : temp/1744748426_1532623_1350017016_cf643d6d820539851276ba01fe0a42f0_rle_crop_3747541874_0.png treat image : temp/1744748426_1532623_1350017016_cf643d6d820539851276ba01fe0a42f0_rle_crop_3747541876_0.png treat image : temp/1744748426_1532623_1350017016_cf643d6d820539851276ba01fe0a42f0_rle_crop_3747541877_0.png treat image : temp/1744748426_1532623_1350017016_cf643d6d820539851276ba01fe0a42f0_rle_crop_3747541873_0.png treat image : temp/1744748426_1532623_1350017016_cf643d6d820539851276ba01fe0a42f0_rle_crop_3747541875_0.png treat image : temp/1744748426_1532623_1350017016_cf643d6d820539851276ba01fe0a42f0_rle_crop_3747541872_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541891_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541885_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541879_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541888_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541901_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541902_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541897_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541905_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541890_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541892_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541906_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541881_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541899_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541898_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541893_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541884_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541894_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541886_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541880_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541900_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541903_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541895_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541883_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541887_0.png treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541916_0.png treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541913_0.png treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541920_0.png treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541923_0.png treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541922_0.png treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541912_0.png treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541917_0.png treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541915_0.png treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541907_0.png treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541918_0.png treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541908_0.png treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541911_0.png treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541914_0.png treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541909_0.png treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541921_0.png treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541919_0.png treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541940_0.png treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541930_0.png treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541927_0.png treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541936_0.png treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541939_0.png treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541935_0.png treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541933_0.png treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541925_0.png treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541926_0.png treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541937_0.png treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541931_0.png treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541934_0.png treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541928_0.png treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541924_0.png treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541932_0.png treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541938_0.png treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541942_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541953_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541944_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541958_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541947_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541955_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541963_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541972_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541954_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541945_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541960_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541957_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541971_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541956_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541951_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541952_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541968_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541961_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541949_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541975_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541982_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541999_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541990_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747542002_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747542001_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747542000_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747542008_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541973_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541986_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541977_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747542005_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541976_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541980_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541974_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541978_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541989_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747542003_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541979_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541985_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747542004_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541998_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541983_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747542006_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541981_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541992_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541997_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747542009_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541991_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541994_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541993_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542016_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542018_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542030_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542014_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542019_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542013_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542022_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542034_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542029_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542033_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542015_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542017_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542035_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542031_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542028_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542025_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542011_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542012_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542023_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542027_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542036_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542021_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542026_0.png treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542051_0.png treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542045_0.png treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542052_0.png treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542050_0.png treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542049_0.png treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542047_0.png treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542044_0.png treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542042_0.png treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542046_0.png treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542053_0.png treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542043_0.png treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542040_0.png treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542048_0.png treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542039_0.png treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542041_0.png treat image : temp/1744748426_1532623_1350017016_cf643d6d820539851276ba01fe0a42f0_rle_crop_3747541878_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541882_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541904_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541889_0.png treat image : temp/1744748426_1532623_1350016973_b514e6e8989c2d0fc999f55f0ab8d3ec_rle_crop_3747541896_0.png treat image : temp/1744748426_1532623_1350016970_24cd364f0afab5ae4ca549f675de4964_rle_crop_3747541910_0.png treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541941_0.png treat image : temp/1744748426_1532623_1350016966_df26b3d7045d66c1eaeb8d5cd96b330d_rle_crop_3747541929_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541966_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541965_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541967_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541970_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541964_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541959_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541950_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541946_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541948_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541943_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541995_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747542007_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541996_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541987_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541984_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542032_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542020_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542010_0.png treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542038_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541969_0.png treat image : temp/1744748426_1532623_1350016960_b42b0052a0b79395647d184091bbb8c0_rle_crop_3747541962_0.png treat image : temp/1744748426_1532623_1350016948_6e529dbcaecea9dd2b10a20cd861a310_rle_crop_3747542024_0.png treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542037_0.png treat image : temp/1744748426_1532623_1350016856_851cd446268ffd63dabeed22cd323772_rle_crop_3747542054_0.png treat image : temp/1744748426_1532623_1350016954_43daed966b1d5a6f6703faa1b29b361f_rle_crop_3747541988_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 191 time used for this insertion : 0.023262739181518555 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 191 time used for this insertion : 9.501770257949829 save missing photos in datou_result : time spend for datou_step_exec : 8.075493097305298 time spend to save output : 9.53033709526062 total time spend for step 7 : 17.605830192565918 step8:velours_tree Tue Apr 15 22:25:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.27691054344177246 time spend to save output : 4.696846008300781e-05 total time spend for step 8 : 0.27695751190185547 step9:send_mail_cod Tue Apr 15 22:25:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22051915_15-04-2025_22_25_22.pdf 22052162 imagette220521621744748722 22052163 imagette220521631744748722 22052164 imagette220521641744748722 22052165 change filename to text .imagette220521651744748722 22052166 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette220521661744748722 22052167 imagette220521671744748723 22052168 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette220521681744748723 22052170 imagette220521701744748723 22052171 imagette220521711744748723 22052172 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette220521721744748723 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22051915 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22052162,22052163,22052164,22052165,22052166,22052167,22052168,22052169,22052170,22052171,22052172?tags=metal,mal_croppe,pehd,autre,carton,flou,pet_clair,environnement,pet_fonce,background,papier args[1350017016] : ((1350017016, -2.1717787576238123, 492609224), (1350017016, -0.1538897785331696, 496442774), '0.09394774149532498') We are sending mail with results at report@fotonower.com args[1350016973] : ((1350016973, -6.455696715472253, 492609224), (1350016973, -0.2744547955330295, 496442774), '0.09394774149532498') We are sending mail with results at report@fotonower.com args[1350016970] : ((1350016970, -3.639939658206311, 492609224), (1350016970, -0.0028010379456874486, 2107752395), '0.09394774149532498') We are sending mail with results at report@fotonower.com args[1350016966] : ((1350016966, -1.6654240763382886, 492688767), (1350016966, -0.19508228857928567, 496442774), '0.09394774149532498') We are sending mail with results at report@fotonower.com args[1350016960] : ((1350016960, -4.270747755632283, 492609224), (1350016960, 0.023818507865944992, 2107752395), '0.09394774149532498') We are sending mail with results at report@fotonower.com args[1350016954] : ((1350016954, -4.3102017433553215, 492609224), (1350016954, 0.023402197322674345, 2107752395), '0.09394774149532498') We are sending mail with results at report@fotonower.com args[1350016948] : ((1350016948, -4.853111803730512, 492609224), (1350016948, 0.12252228147621998, 2107752395), '0.09394774149532498') We are sending mail with results at report@fotonower.com args[1350016856] : ((1350016856, -0.6040500042219484, 492688767), (1350016856, 0.28397139614453404, 2107752395), '0.09394774149532498') We are sending mail with results at report@fotonower.com refus_total : 0.09394774149532498 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22051915 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1350016856,1350016948,1350016954,1350016960,1350016966,1350016970,1350016973,1350017016) Found this number of photos: 8 begin to download photo : 1350016856 begin to download photo : 1350016954 begin to download photo : 1350016966 begin to download photo : 1350016973 download finish for photo 1350016966 begin to download photo : 1350016970 download finish for photo 1350016856 begin to download photo : 1350016948 download finish for photo 1350016973 begin to download photo : 1350017016 download finish for photo 1350016954 begin to download photo : 1350016960 download finish for photo 1350016970 download finish for photo 1350017016 download finish for photo 1350016948 download finish for photo 1350016960 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22051915_15-04-2025_22_25_22.pdf results_Auto_P22051915_15-04-2025_22_25_22.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22051915_15-04-2025_22_25_22.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22051915','results_Auto_P22051915_15-04-2025_22_25_22.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22051915_15-04-2025_22_25_22.pdf','pdf','','0.41','0.09394774149532498') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22051915

https://www.fotonower.com/image?json=false&list_photos_id=1350017016
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350016973
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350016970
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350016966
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350016960
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350016954
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350016948
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350016856
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 9.39%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/22052165?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22052166?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22052168?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22052172?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22051915_15-04-2025_22_25_22.pdf.

Lien vers velours :https://www.fotonower.com/velours/22052162,22052163,22052164,22052165,22052166,22052167,22052168,22052169,22052170,22052171,22052172?tags=metal,mal_croppe,pehd,autre,carton,flou,pet_clair,environnement,pet_fonce,background,papier.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 15 Apr 2025 20:25:27 GMT Content-Length: 0 Connection: close X-Message-Id: YyPANCQQSpS1t_kixXVUtg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1350017016, 1350016973, 1350016970, 1350016966, 1350016960, 1350016954, 1350016948, 1350016856] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350017016', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016973', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016970', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016966', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016960', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016954', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016948', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016856', None, None, None, None, None, '2723667') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.01648736000061035 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.979776620864868 time spend to save output : 0.016759157180786133 total time spend for step 9 : 5.996535778045654 step10:split_time_score Tue Apr 15 22:25:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('07', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 15042025 22051915 Nombre de photos uploadées : 8 / 23040 (0%) 15042025 22051915 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 15042025 22051915 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 3.337860107421875e-06 elapsed_time : order_list_meta_photo_and_scores 7.152557373046875e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0005319118499755859 elapsed_time : insert_dashboard_record_day_entry 0.024632692337036133 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22051913 order by id desc limit 1 Qualite : 0.09394774149532498 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22051915_15-04-2025_22_25_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22051915 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22051915 AND mptpi.`type`=3594 To do Qualite : 0.20541652095918328 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22027920_15-04-2025_12_49_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22027920 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22027920 AND mptpi.`type`=3594 To do Qualite : 0.10993276470020877 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22027923_15-04-2025_12_24_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22027923 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22027923 AND mptpi.`type`=3594 To do Qualite : 0.05652087531411031 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22028718_15-04-2025_13_11_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22028718 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22028718 AND mptpi.`type`=3726 To do Qualite : 0.17023427379585465 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22049536_15-04-2025_22_15_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22049536 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22049536 AND mptpi.`type`=3594 To do Qualite : 0.14085696298804612 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22050503_15-04-2025_22_01_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22050503 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22050503 AND mptpi.`type`=3594 To do Qualite : 0.04204030528478445 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22049539_15-04-2025_21_13_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22049539 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22049539 AND mptpi.`type`=3726 To do Qualite : 0.1399238807723525 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22049544_15-04-2025_21_21_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22049544 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22049544 AND mptpi.`type`=3594 To do Qualite : 0.1389535804325939 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22050507_15-04-2025_21_29_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22050507 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22050507 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'15042025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1350017016, 1350016973, 1350016970, 1350016966, 1350016960, 1350016954, 1350016948, 1350016856] Looping around the photos to save general results len do output : 1 /22051915Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350017016', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016973', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016970', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016966', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016960', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016954', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016948', None, None, None, None, None, '2723667') ('3318', None, None, None, None, None, None, None, '2723667') ('3318', '22051915', '1350016856', None, None, None, None, None, '2723667') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.017478466033935547 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.455310583114624 time spend to save output : 0.017672061920166016 total time spend for step 10 : 1.47298264503479 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 139.31user 96.34system 5:04.85elapsed 77%CPU (0avgtext+0avgdata 6144952maxresident)k 874648inputs+86504outputs (11763major+14428336minor)pagefaults 0swaps