FBFBFBFBFwe have missing 2 photos in the step downloads : photo missing : [1353118553, 1353118542] try to delete the photos missing in DB Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1353118553 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1353118542 length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 2.364199161529541 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu Apr 24 04:10:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-04-24 04:10:32.482637: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-24 04:10:32.511157: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-24 04:10:32.513135: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f3f18000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-24 04:10:32.513192: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-04-24 04:10:32.516028: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-04-24 04:10:32.766685: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2d56d950 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-04-24 04:10:32.766724: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-04-24 04:10:32.767642: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-24 04:10:32.769239: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-24 04:10:32.780901: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-24 04:10:32.788505: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-24 04:10:32.789437: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-24 04:10:32.799139: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-24 04:10:32.801838: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-24 04:10:32.818381: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-24 04:10:32.820034: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-24 04:10:32.820127: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-24 04:10:32.821089: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-24 04:10:32.821106: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-24 04:10:32.821116: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-24 04:10:32.822542: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-04-24 04:10:33.115241: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-24 04:10:33.115412: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-24 04:10:33.115439: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-24 04:10:33.115463: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-24 04:10:33.115485: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-24 04:10:33.115507: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-24 04:10:33.115528: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-24 04:10:33.115550: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-24 04:10:33.117159: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-24 04:10:33.118711: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-24 04:10:33.118806: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-24 04:10:33.118831: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-24 04:10:33.118853: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-24 04:10:33.118874: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-24 04:10:33.118926: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-24 04:10:33.118953: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-24 04:10:33.118975: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-24 04:10:33.120594: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-24 04:10:33.120652: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-24 04:10:33.120663: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-24 04:10:33.120674: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-24 04:10:33.122347: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-04-24 04:10:42.511032: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-24 04:10:42.758732: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 9 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 46 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 49 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 47 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 50 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 45 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 52 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 19 Detection mask done ! Trying to reset tf kernel 1941674 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 236 tf kernel not reseted sub process len(results) : 9 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 9 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0026438236236572266 nb_pixel_total : 54610 time to create 1 rle with old method : 0.06429481506347656 length of segment : 352 time for calcul the mask position with numpy : 0.007204771041870117 nb_pixel_total : 232270 time to create 1 rle with new method : 0.023586273193359375 length of segment : 532 time for calcul the mask position with numpy : 0.0004639625549316406 nb_pixel_total : 12373 time to create 1 rle with old method : 0.015017271041870117 length of segment : 193 time for calcul the mask position with numpy : 0.0007162094116210938 nb_pixel_total : 28094 time to create 1 rle with old method : 0.03773140907287598 length of segment : 238 time for calcul the mask position with numpy : 0.00039577484130859375 nb_pixel_total : 13001 time to create 1 rle with old method : 0.016311168670654297 length of segment : 166 time for calcul the mask position with numpy : 0.003203868865966797 nb_pixel_total : 163612 time to create 1 rle with new method : 0.014488697052001953 length of segment : 415 time for calcul the mask position with numpy : 0.0004978179931640625 nb_pixel_total : 17815 time to create 1 rle with old method : 0.021434307098388672 length of segment : 159 time for calcul the mask position with numpy : 0.0006835460662841797 nb_pixel_total : 29512 time to create 1 rle with old method : 0.03491830825805664 length of segment : 174 time for calcul the mask position with numpy : 0.0007410049438476562 nb_pixel_total : 30853 time to create 1 rle with old method : 0.037401437759399414 length of segment : 200 time for calcul the mask position with numpy : 0.0040395259857177734 nb_pixel_total : 203510 time to create 1 rle with new method : 0.015299320220947266 length of segment : 913 time for calcul the mask position with numpy : 0.0009353160858154297 nb_pixel_total : 18603 time to create 1 rle with old method : 0.021354198455810547 length of segment : 201 time for calcul the mask position with numpy : 0.0022449493408203125 nb_pixel_total : 39550 time to create 1 rle with old method : 0.05564427375793457 length of segment : 233 time for calcul the mask position with numpy : 0.001058816909790039 nb_pixel_total : 23447 time to create 1 rle with old method : 0.026923179626464844 length of segment : 166 time for calcul the mask position with numpy : 0.0007228851318359375 nb_pixel_total : 14704 time to create 1 rle with old method : 0.017103910446166992 length of segment : 144 time for calcul the mask position with numpy : 0.0013818740844726562 nb_pixel_total : 19981 time to create 1 rle with old method : 0.022964954376220703 length of segment : 204 time for calcul the mask position with numpy : 0.001392364501953125 nb_pixel_total : 27322 time to create 1 rle with old method : 0.03171133995056152 length of segment : 142 time for calcul the mask position with numpy : 0.0008966922760009766 nb_pixel_total : 21964 time to create 1 rle with old method : 0.028815507888793945 length of segment : 181 time for calcul the mask position with numpy : 0.0003921985626220703 nb_pixel_total : 5743 time to create 1 rle with old method : 0.006742715835571289 length of segment : 91 time for calcul the mask position with numpy : 0.0021486282348632812 nb_pixel_total : 42187 time to create 1 rle with old method : 0.04761242866516113 length of segment : 352 time for calcul the mask position with numpy : 0.0006761550903320312 nb_pixel_total : 12947 time to create 1 rle with old method : 0.01755070686340332 length of segment : 152 time for calcul the mask position with numpy : 0.004256010055541992 nb_pixel_total : 77396 time to create 1 rle with old method : 0.11448240280151367 length of segment : 456 time for calcul the mask position with numpy : 0.0007200241088867188 nb_pixel_total : 31347 time to create 1 rle with old method : 0.03635716438293457 length of segment : 199 time for calcul the mask position with numpy : 0.0008878707885742188 nb_pixel_total : 48480 time to create 1 rle with old method : 0.05619621276855469 length of segment : 213 time for calcul the mask position with numpy : 0.0011823177337646484 nb_pixel_total : 77351 time to create 1 rle with old method : 0.08826732635498047 length of segment : 267 time for calcul the mask position with numpy : 0.000690460205078125 nb_pixel_total : 29779 time to create 1 rle with old method : 0.0348048210144043 length of segment : 238 time for calcul the mask position with numpy : 0.00307464599609375 nb_pixel_total : 176608 time to create 1 rle with new method : 0.010982275009155273 length of segment : 397 time for calcul the mask position with numpy : 0.0032384395599365234 nb_pixel_total : 213894 time to create 1 rle with new method : 0.012767791748046875 length of segment : 627 time for calcul the mask position with numpy : 0.0004906654357910156 nb_pixel_total : 25247 time to create 1 rle with old method : 0.02891707420349121 length of segment : 172 time for calcul the mask position with numpy : 0.0015857219696044922 nb_pixel_total : 107684 time to create 1 rle with old method : 0.12615728378295898 length of segment : 341 time for calcul the mask position with numpy : 0.003572702407836914 nb_pixel_total : 178031 time to create 1 rle with new method : 0.011588573455810547 length of segment : 771 time for calcul the mask position with numpy : 0.0003514289855957031 nb_pixel_total : 11776 time to create 1 rle with old method : 0.013821840286254883 length of segment : 121 time for calcul the mask position with numpy : 0.0010178089141845703 nb_pixel_total : 61513 time to create 1 rle with old method : 0.06967520713806152 length of segment : 200 time for calcul the mask position with numpy : 0.0013377666473388672 nb_pixel_total : 73044 time to create 1 rle with old method : 0.08392024040222168 length of segment : 426 time for calcul the mask position with numpy : 0.0021622180938720703 nb_pixel_total : 86883 time to create 1 rle with old method : 0.0985562801361084 length of segment : 435 time for calcul the mask position with numpy : 0.0008392333984375 nb_pixel_total : 43498 time to create 1 rle with old method : 0.05365705490112305 length of segment : 296 time for calcul the mask position with numpy : 0.0017323493957519531 nb_pixel_total : 81176 time to create 1 rle with old method : 0.10169005393981934 length of segment : 453 time for calcul the mask position with numpy : 0.0026998519897460938 nb_pixel_total : 101324 time to create 1 rle with old method : 0.11908721923828125 length of segment : 668 time for calcul the mask position with numpy : 0.002644062042236328 nb_pixel_total : 103515 time to create 1 rle with old method : 0.12821507453918457 length of segment : 582 time for calcul the mask position with numpy : 0.0024406909942626953 nb_pixel_total : 67111 time to create 1 rle with old method : 0.10447359085083008 length of segment : 381 time for calcul the mask position with numpy : 0.0026421546936035156 nb_pixel_total : 104744 time to create 1 rle with old method : 0.1221623420715332 length of segment : 375 time for calcul the mask position with numpy : 0.0070569515228271484 nb_pixel_total : 151151 time to create 1 rle with new method : 0.011809349060058594 length of segment : 277 time for calcul the mask position with numpy : 0.00047898292541503906 nb_pixel_total : 8026 time to create 1 rle with old method : 0.009386777877807617 length of segment : 91 time for calcul the mask position with numpy : 0.0005800724029541016 nb_pixel_total : 9207 time to create 1 rle with old method : 0.01065206527709961 length of segment : 125 time for calcul the mask position with numpy : 0.0005347728729248047 nb_pixel_total : 8263 time to create 1 rle with old method : 0.010004997253417969 length of segment : 87 time for calcul the mask position with numpy : 0.0014481544494628906 nb_pixel_total : 38806 time to create 1 rle with old method : 0.062348127365112305 length of segment : 212 time for calcul the mask position with numpy : 0.0010495185852050781 nb_pixel_total : 20120 time to create 1 rle with old method : 0.023078441619873047 length of segment : 223 time for calcul the mask position with numpy : 0.0007822513580322266 nb_pixel_total : 16892 time to create 1 rle with old method : 0.019631147384643555 length of segment : 167 time for calcul the mask position with numpy : 0.0012707710266113281 nb_pixel_total : 21711 time to create 1 rle with old method : 0.024261474609375 length of segment : 271 time for calcul the mask position with numpy : 0.00182342529296875 nb_pixel_total : 43357 time to create 1 rle with old method : 0.04947638511657715 length of segment : 234 time for calcul the mask position with numpy : 0.0026159286499023438 nb_pixel_total : 63813 time to create 1 rle with old method : 0.06925749778747559 length of segment : 478 time for calcul the mask position with numpy : 0.004634857177734375 nb_pixel_total : 89396 time to create 1 rle with old method : 0.10011458396911621 length of segment : 394 time for calcul the mask position with numpy : 0.004240274429321289 nb_pixel_total : 57678 time to create 1 rle with old method : 0.06591677665710449 length of segment : 515 time for calcul the mask position with numpy : 0.000629425048828125 nb_pixel_total : 15693 time to create 1 rle with old method : 0.018070459365844727 length of segment : 116 time for calcul the mask position with numpy : 0.0011410713195800781 nb_pixel_total : 27289 time to create 1 rle with old method : 0.0322115421295166 length of segment : 190 time for calcul the mask position with numpy : 0.001596212387084961 nb_pixel_total : 38743 time to create 1 rle with old method : 0.045735836029052734 length of segment : 246 time for calcul the mask position with numpy : 0.0016717910766601562 nb_pixel_total : 28669 time to create 1 rle with old method : 0.03306460380554199 length of segment : 155 time for calcul the mask position with numpy : 0.0007889270782470703 nb_pixel_total : 12964 time to create 1 rle with old method : 0.01514577865600586 length of segment : 141 time for calcul the mask position with numpy : 0.0006690025329589844 nb_pixel_total : 10902 time to create 1 rle with old method : 0.014809370040893555 length of segment : 134 time for calcul the mask position with numpy : 0.0008478164672851562 nb_pixel_total : 18636 time to create 1 rle with old method : 0.024462223052978516 length of segment : 213 time for calcul the mask position with numpy : 0.0017154216766357422 nb_pixel_total : 35384 time to create 1 rle with old method : 0.04480457305908203 length of segment : 230 time for calcul the mask position with numpy : 0.0005867481231689453 nb_pixel_total : 11448 time to create 1 rle with old method : 0.014313459396362305 length of segment : 149 time for calcul the mask position with numpy : 0.0005466938018798828 nb_pixel_total : 8867 time to create 1 rle with old method : 0.010156869888305664 length of segment : 110 time for calcul the mask position with numpy : 0.0011296272277832031 nb_pixel_total : 22710 time to create 1 rle with old method : 0.02594923973083496 length of segment : 289 time for calcul the mask position with numpy : 0.0007092952728271484 nb_pixel_total : 19440 time to create 1 rle with old method : 0.021815776824951172 length of segment : 190 time for calcul the mask position with numpy : 0.0016117095947265625 nb_pixel_total : 4257 time to create 1 rle with old method : 0.005015134811401367 length of segment : 75 time for calcul the mask position with numpy : 0.00047969818115234375 nb_pixel_total : 9839 time to create 1 rle with old method : 0.014389514923095703 length of segment : 120 time for calcul the mask position with numpy : 0.0016329288482666016 nb_pixel_total : 40147 time to create 1 rle with old method : 0.045151710510253906 length of segment : 246 time for calcul the mask position with numpy : 0.0003807544708251953 nb_pixel_total : 5395 time to create 1 rle with old method : 0.006261110305786133 length of segment : 110 time for calcul the mask position with numpy : 0.003595590591430664 nb_pixel_total : 80655 time to create 1 rle with old method : 0.09319114685058594 length of segment : 216 time for calcul the mask position with numpy : 0.0012576580047607422 nb_pixel_total : 23917 time to create 1 rle with old method : 0.026269912719726562 length of segment : 240 time for calcul the mask position with numpy : 0.00036716461181640625 nb_pixel_total : 6891 time to create 1 rle with old method : 0.007631540298461914 length of segment : 92 time for calcul the mask position with numpy : 0.0004475116729736328 nb_pixel_total : 9137 time to create 1 rle with old method : 0.010095596313476562 length of segment : 105 time for calcul the mask position with numpy : 0.001188039779663086 nb_pixel_total : 13777 time to create 1 rle with old method : 0.01579141616821289 length of segment : 137 time for calcul the mask position with numpy : 0.0006144046783447266 nb_pixel_total : 11341 time to create 1 rle with old method : 0.012379646301269531 length of segment : 146 time for calcul the mask position with numpy : 0.0019850730895996094 nb_pixel_total : 42612 time to create 1 rle with old method : 0.045746564865112305 length of segment : 288 time for calcul the mask position with numpy : 0.0015492439270019531 nb_pixel_total : 34177 time to create 1 rle with old method : 0.03764152526855469 length of segment : 310 time for calcul the mask position with numpy : 0.0015840530395507812 nb_pixel_total : 36176 time to create 1 rle with old method : 0.04054737091064453 length of segment : 236 time for calcul the mask position with numpy : 0.001935720443725586 nb_pixel_total : 34320 time to create 1 rle with old method : 0.03856706619262695 length of segment : 271 time for calcul the mask position with numpy : 0.0022330284118652344 nb_pixel_total : 49348 time to create 1 rle with old method : 0.05482029914855957 length of segment : 415 time for calcul the mask position with numpy : 0.0011951923370361328 nb_pixel_total : 25613 time to create 1 rle with old method : 0.028372764587402344 length of segment : 167 time for calcul the mask position with numpy : 0.0019333362579345703 nb_pixel_total : 36219 time to create 1 rle with old method : 0.040163278579711914 length of segment : 273 time for calcul the mask position with numpy : 0.0005612373352050781 nb_pixel_total : 11309 time to create 1 rle with old method : 0.013089895248413086 length of segment : 102 time for calcul the mask position with numpy : 0.0007059574127197266 nb_pixel_total : 11926 time to create 1 rle with old method : 0.015425920486450195 length of segment : 142 time for calcul the mask position with numpy : 0.000522613525390625 nb_pixel_total : 7420 time to create 1 rle with old method : 0.00889444351196289 length of segment : 85 time for calcul the mask position with numpy : 0.004004716873168945 nb_pixel_total : 73417 time to create 1 rle with old method : 0.08182406425476074 length of segment : 212 time for calcul the mask position with numpy : 0.00036716461181640625 nb_pixel_total : 6489 time to create 1 rle with old method : 0.0073833465576171875 length of segment : 119 time for calcul the mask position with numpy : 0.00027751922607421875 nb_pixel_total : 5796 time to create 1 rle with old method : 0.00668787956237793 length of segment : 73 time for calcul the mask position with numpy : 0.0004742145538330078 nb_pixel_total : 8167 time to create 1 rle with old method : 0.009273529052734375 length of segment : 132 time for calcul the mask position with numpy : 0.004027843475341797 nb_pixel_total : 77565 time to create 1 rle with old method : 0.08706402778625488 length of segment : 380 time for calcul the mask position with numpy : 0.0009770393371582031 nb_pixel_total : 17585 time to create 1 rle with old method : 0.01994466781616211 length of segment : 370 time for calcul the mask position with numpy : 0.0027348995208740234 nb_pixel_total : 46819 time to create 1 rle with old method : 0.05207324028015137 length of segment : 405 time for calcul the mask position with numpy : 0.000476837158203125 nb_pixel_total : 7739 time to create 1 rle with old method : 0.008888006210327148 length of segment : 150 time for calcul the mask position with numpy : 0.0015594959259033203 nb_pixel_total : 34290 time to create 1 rle with old method : 0.03832101821899414 length of segment : 203 time for calcul the mask position with numpy : 0.0005552768707275391 nb_pixel_total : 19026 time to create 1 rle with old method : 0.021836042404174805 length of segment : 172 time for calcul the mask position with numpy : 0.0012240409851074219 nb_pixel_total : 34237 time to create 1 rle with old method : 0.03844857215881348 length of segment : 212 time for calcul the mask position with numpy : 0.0007419586181640625 nb_pixel_total : 17723 time to create 1 rle with old method : 0.019155025482177734 length of segment : 160 time for calcul the mask position with numpy : 0.0015213489532470703 nb_pixel_total : 37748 time to create 1 rle with old method : 0.050237417221069336 length of segment : 325 time for calcul the mask position with numpy : 0.0006487369537353516 nb_pixel_total : 13572 time to create 1 rle with old method : 0.014867067337036133 length of segment : 113 time for calcul the mask position with numpy : 0.001317739486694336 nb_pixel_total : 15703 time to create 1 rle with old method : 0.017467260360717773 length of segment : 181 time for calcul the mask position with numpy : 0.0022025108337402344 nb_pixel_total : 46957 time to create 1 rle with old method : 0.051320552825927734 length of segment : 307 time for calcul the mask position with numpy : 0.0008969306945800781 nb_pixel_total : 29115 time to create 1 rle with old method : 0.03267931938171387 length of segment : 173 time for calcul the mask position with numpy : 0.0003781318664550781 nb_pixel_total : 6464 time to create 1 rle with old method : 0.006963968276977539 length of segment : 107 time for calcul the mask position with numpy : 0.00044846534729003906 nb_pixel_total : 10390 time to create 1 rle with old method : 0.01180887222290039 length of segment : 126 time for calcul the mask position with numpy : 0.0001761913299560547 nb_pixel_total : 7216 time to create 1 rle with old method : 0.008341312408447266 length of segment : 126 time for calcul the mask position with numpy : 0.0003943443298339844 nb_pixel_total : 6407 time to create 1 rle with old method : 0.007227420806884766 length of segment : 112 time for calcul the mask position with numpy : 0.001054525375366211 nb_pixel_total : 22174 time to create 1 rle with old method : 0.02562427520751953 length of segment : 174 time for calcul the mask position with numpy : 0.0008656978607177734 nb_pixel_total : 21834 time to create 1 rle with old method : 0.025035619735717773 length of segment : 149 time for calcul the mask position with numpy : 0.0007531642913818359 nb_pixel_total : 15847 time to create 1 rle with old method : 0.01764392852783203 length of segment : 215 time for calcul the mask position with numpy : 0.0015094280242919922 nb_pixel_total : 38361 time to create 1 rle with old method : 0.04224109649658203 length of segment : 215 time for calcul the mask position with numpy : 0.0008559226989746094 nb_pixel_total : 16291 time to create 1 rle with old method : 0.019890785217285156 length of segment : 179 time for calcul the mask position with numpy : 0.0009403228759765625 nb_pixel_total : 17194 time to create 1 rle with old method : 0.019789934158325195 length of segment : 159 time for calcul the mask position with numpy : 0.0016939640045166016 nb_pixel_total : 39362 time to create 1 rle with old method : 0.04521894454956055 length of segment : 190 time for calcul the mask position with numpy : 0.0009517669677734375 nb_pixel_total : 18277 time to create 1 rle with old method : 0.021472692489624023 length of segment : 161 time for calcul the mask position with numpy : 0.005820035934448242 nb_pixel_total : 146916 time to create 1 rle with old method : 0.16519665718078613 length of segment : 394 time for calcul the mask position with numpy : 0.0009405612945556641 nb_pixel_total : 11662 time to create 1 rle with old method : 0.013647079467773438 length of segment : 247 time for calcul the mask position with numpy : 0.0009095668792724609 nb_pixel_total : 21170 time to create 1 rle with old method : 0.024543285369873047 length of segment : 147 time for calcul the mask position with numpy : 0.0018732547760009766 nb_pixel_total : 52467 time to create 1 rle with old method : 0.07358169555664062 length of segment : 206 time for calcul the mask position with numpy : 0.0012192726135253906 nb_pixel_total : 18011 time to create 1 rle with old method : 0.029370546340942383 length of segment : 199 time for calcul the mask position with numpy : 0.0010037422180175781 nb_pixel_total : 10578 time to create 1 rle with old method : 0.012735128402709961 length of segment : 143 time for calcul the mask position with numpy : 0.0008242130279541016 nb_pixel_total : 11585 time to create 1 rle with old method : 0.014525175094604492 length of segment : 126 time for calcul the mask position with numpy : 0.0012578964233398438 nb_pixel_total : 28811 time to create 1 rle with old method : 0.03366208076477051 length of segment : 222 time for calcul the mask position with numpy : 0.0031778812408447266 nb_pixel_total : 61117 time to create 1 rle with old method : 0.06841635704040527 length of segment : 410 time for calcul the mask position with numpy : 0.0012707710266113281 nb_pixel_total : 28685 time to create 1 rle with old method : 0.033143043518066406 length of segment : 179 time for calcul the mask position with numpy : 0.0005979537963867188 nb_pixel_total : 11960 time to create 1 rle with old method : 0.021993398666381836 length of segment : 125 time for calcul the mask position with numpy : 0.0006701946258544922 nb_pixel_total : 5593 time to create 1 rle with old method : 0.00944209098815918 length of segment : 183 time for calcul the mask position with numpy : 0.0008871555328369141 nb_pixel_total : 14953 time to create 1 rle with old method : 0.017969369888305664 length of segment : 214 time for calcul the mask position with numpy : 0.0006716251373291016 nb_pixel_total : 13942 time to create 1 rle with old method : 0.016150474548339844 length of segment : 155 time for calcul the mask position with numpy : 0.002025604248046875 nb_pixel_total : 42929 time to create 1 rle with old method : 0.049657344818115234 length of segment : 155 time for calcul the mask position with numpy : 0.00044536590576171875 nb_pixel_total : 12405 time to create 1 rle with old method : 0.014485597610473633 length of segment : 124 time for calcul the mask position with numpy : 0.0006084442138671875 nb_pixel_total : 15959 time to create 1 rle with old method : 0.0224149227142334 length of segment : 127 time for calcul the mask position with numpy : 0.0009799003601074219 nb_pixel_total : 19204 time to create 1 rle with old method : 0.023718833923339844 length of segment : 240 time for calcul the mask position with numpy : 0.0015056133270263672 nb_pixel_total : 38669 time to create 1 rle with old method : 0.04365873336791992 length of segment : 242 time for calcul the mask position with numpy : 0.0025472640991210938 nb_pixel_total : 53267 time to create 1 rle with old method : 0.05900073051452637 length of segment : 267 time for calcul the mask position with numpy : 0.006378650665283203 nb_pixel_total : 136644 time to create 1 rle with old method : 0.1540510654449463 length of segment : 597 time for calcul the mask position with numpy : 0.00487828254699707 nb_pixel_total : 134841 time to create 1 rle with old method : 0.14673590660095215 length of segment : 534 time for calcul the mask position with numpy : 0.00034308433532714844 nb_pixel_total : 18227 time to create 1 rle with old method : 0.020900249481201172 length of segment : 82 time for calcul the mask position with numpy : 0.0014791488647460938 nb_pixel_total : 17284 time to create 1 rle with old method : 0.028512239456176758 length of segment : 199 time for calcul the mask position with numpy : 0.0007004737854003906 nb_pixel_total : 10592 time to create 1 rle with old method : 0.012679338455200195 length of segment : 158 time for calcul the mask position with numpy : 0.0012280941009521484 nb_pixel_total : 28144 time to create 1 rle with old method : 0.03145480155944824 length of segment : 143 time for calcul the mask position with numpy : 0.0008733272552490234 nb_pixel_total : 22151 time to create 1 rle with old method : 0.025145292282104492 length of segment : 146 time for calcul the mask position with numpy : 0.0008854866027832031 nb_pixel_total : 19245 time to create 1 rle with old method : 0.021987438201904297 length of segment : 134 time for calcul the mask position with numpy : 0.0009679794311523438 nb_pixel_total : 14286 time to create 1 rle with old method : 0.01589369773864746 length of segment : 221 time for calcul the mask position with numpy : 0.002360105514526367 nb_pixel_total : 39867 time to create 1 rle with old method : 0.04508042335510254 length of segment : 312 time for calcul the mask position with numpy : 0.0008792877197265625 nb_pixel_total : 19732 time to create 1 rle with old method : 0.023905038833618164 length of segment : 112 time for calcul the mask position with numpy : 0.000308990478515625 nb_pixel_total : 5658 time to create 1 rle with old method : 0.006650686264038086 length of segment : 83 time for calcul the mask position with numpy : 0.0012285709381103516 nb_pixel_total : 31133 time to create 1 rle with old method : 0.03463482856750488 length of segment : 190 time for calcul the mask position with numpy : 0.004736185073852539 nb_pixel_total : 83937 time to create 1 rle with old method : 0.09399676322937012 length of segment : 421 time for calcul the mask position with numpy : 0.0041201114654541016 nb_pixel_total : 83286 time to create 1 rle with old method : 0.09326314926147461 length of segment : 325 time for calcul the mask position with numpy : 0.0026044845581054688 nb_pixel_total : 58150 time to create 1 rle with old method : 0.06663799285888672 length of segment : 473 time for calcul the mask position with numpy : 0.0011715888977050781 nb_pixel_total : 21942 time to create 1 rle with old method : 0.025104761123657227 length of segment : 200 time for calcul the mask position with numpy : 0.0007917881011962891 nb_pixel_total : 16301 time to create 1 rle with old method : 0.018279314041137695 length of segment : 197 time for calcul the mask position with numpy : 0.0006101131439208984 nb_pixel_total : 14502 time to create 1 rle with old method : 0.01674056053161621 length of segment : 198 time for calcul the mask position with numpy : 0.0009267330169677734 nb_pixel_total : 18069 time to create 1 rle with old method : 0.020816326141357422 length of segment : 141 time for calcul the mask position with numpy : 0.0017969608306884766 nb_pixel_total : 30581 time to create 1 rle with old method : 0.04001951217651367 length of segment : 175 time for calcul the mask position with numpy : 0.00047779083251953125 nb_pixel_total : 6012 time to create 1 rle with old method : 0.0068569183349609375 length of segment : 117 time for calcul the mask position with numpy : 0.0004982948303222656 nb_pixel_total : 8180 time to create 1 rle with old method : 0.012283802032470703 length of segment : 74 time for calcul the mask position with numpy : 0.0031671524047851562 nb_pixel_total : 74197 time to create 1 rle with old method : 0.08333611488342285 length of segment : 281 time for calcul the mask position with numpy : 0.0007798671722412109 nb_pixel_total : 7023 time to create 1 rle with old method : 0.008198261260986328 length of segment : 145 time for calcul the mask position with numpy : 0.002790212631225586 nb_pixel_total : 58053 time to create 1 rle with old method : 0.06666851043701172 length of segment : 302 time for calcul the mask position with numpy : 0.00118255615234375 nb_pixel_total : 13224 time to create 1 rle with old method : 0.015586376190185547 length of segment : 191 time for calcul the mask position with numpy : 0.003194093704223633 nb_pixel_total : 63537 time to create 1 rle with old method : 0.07155227661132812 length of segment : 468 time for calcul the mask position with numpy : 0.0006945133209228516 nb_pixel_total : 11427 time to create 1 rle with old method : 0.01318049430847168 length of segment : 168 time for calcul the mask position with numpy : 0.0014255046844482422 nb_pixel_total : 35046 time to create 1 rle with old method : 0.040169477462768555 length of segment : 330 time for calcul the mask position with numpy : 0.001268148422241211 nb_pixel_total : 26854 time to create 1 rle with old method : 0.03028416633605957 length of segment : 169 time for calcul the mask position with numpy : 0.000957489013671875 nb_pixel_total : 20033 time to create 1 rle with old method : 0.022731542587280273 length of segment : 227 time for calcul the mask position with numpy : 0.0019860267639160156 nb_pixel_total : 43497 time to create 1 rle with old method : 0.04806399345397949 length of segment : 310 time for calcul the mask position with numpy : 0.0010290145874023438 nb_pixel_total : 36383 time to create 1 rle with old method : 0.0435185432434082 length of segment : 197 time for calcul the mask position with numpy : 0.000978231430053711 nb_pixel_total : 22587 time to create 1 rle with old method : 0.0258328914642334 length of segment : 146 time for calcul the mask position with numpy : 0.00048279762268066406 nb_pixel_total : 12808 time to create 1 rle with old method : 0.0146942138671875 length of segment : 131 time for calcul the mask position with numpy : 0.00043463706970214844 nb_pixel_total : 7542 time to create 1 rle with old method : 0.008744001388549805 length of segment : 129 time for calcul the mask position with numpy : 0.0017857551574707031 nb_pixel_total : 39530 time to create 1 rle with old method : 0.04438424110412598 length of segment : 441 time for calcul the mask position with numpy : 0.0004429817199707031 nb_pixel_total : 9182 time to create 1 rle with old method : 0.010443449020385742 length of segment : 88 time for calcul the mask position with numpy : 0.005339384078979492 nb_pixel_total : 150291 time to create 1 rle with new method : 0.011966466903686523 length of segment : 424 time for calcul the mask position with numpy : 0.001003265380859375 nb_pixel_total : 12960 time to create 1 rle with old method : 0.021158218383789062 length of segment : 234 time for calcul the mask position with numpy : 0.014974355697631836 nb_pixel_total : 270166 time to create 1 rle with new method : 0.016896963119506836 length of segment : 812 time for calcul the mask position with numpy : 0.0011718273162841797 nb_pixel_total : 26269 time to create 1 rle with old method : 0.04393291473388672 length of segment : 177 time for calcul the mask position with numpy : 0.008231878280639648 nb_pixel_total : 179493 time to create 1 rle with new method : 0.027181148529052734 length of segment : 904 time for calcul the mask position with numpy : 0.0014271736145019531 nb_pixel_total : 63086 time to create 1 rle with old method : 0.0713949203491211 length of segment : 173 time for calcul the mask position with numpy : 0.0021347999572753906 nb_pixel_total : 63162 time to create 1 rle with old method : 0.07278704643249512 length of segment : 215 time for calcul the mask position with numpy : 0.007592678070068359 nb_pixel_total : 217859 time to create 1 rle with new method : 0.04017925262451172 length of segment : 938 time for calcul the mask position with numpy : 0.00257110595703125 nb_pixel_total : 117481 time to create 1 rle with old method : 0.13336849212646484 length of segment : 348 time for calcul the mask position with numpy : 0.0006873607635498047 nb_pixel_total : 35710 time to create 1 rle with old method : 0.040837764739990234 length of segment : 270 time for calcul the mask position with numpy : 0.0013523101806640625 nb_pixel_total : 66401 time to create 1 rle with old method : 0.07478570938110352 length of segment : 395 time for calcul the mask position with numpy : 0.0004246234893798828 nb_pixel_total : 30422 time to create 1 rle with old method : 0.034784555435180664 length of segment : 151 time for calcul the mask position with numpy : 0.0013041496276855469 nb_pixel_total : 51884 time to create 1 rle with old method : 0.05985879898071289 length of segment : 222 time for calcul the mask position with numpy : 0.00037169456481933594 nb_pixel_total : 8478 time to create 1 rle with old method : 0.009905815124511719 length of segment : 106 time spent for convertir_results : 14.693546295166016 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 186 chid ids of type : 3594 Number RLEs to save : 45868 save missing photos in datou_result : time spend for datou_step_exec : 79.16513586044312 time spend to save output : 2.701875925064087 total time spend for step 1 : 81.8670117855072 step2:crop_condition Thu Apr 24 04:11:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 186 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 121 About to insert : list_path_to_insert length 121 new photo from crops ! About to upload 121 photos upload in portfolio : 3736932 init cache_photo without model_param we have 121 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745460735_1941155 we have uploaded 121 photos in the portfolio 3736932 time of upload the photos Elapsed time : 35.59872341156006 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 3736932 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745460778_1941155 we have uploaded 21 photos in the portfolio 3736932 time of upload the photos Elapsed time : 21.40049934387207 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745460800_1941155 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6856958866119385 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 37 About to insert : list_path_to_insert length 37 new photo from crops ! About to upload 37 photos upload in portfolio : 3736932 init cache_photo without model_param we have 37 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745460812_1941155 we have uploaded 37 photos in the portfolio 3736932 time of upload the photos Elapsed time : 26.74597668647766 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745460841_1941155 we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.6355702877044678 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745460845_1941155 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6218109130859375 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1353161022, 1353161018, 1353118550, 1353118539, 1353118414, 1353118411, 1353118409, 1353118380, 1353118346] Looping around the photos to save general results len do output : 186 /1353255389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353255633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353161022', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353161018', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118550', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118539', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118414', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118411', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118409', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118380', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118346', None, None, None, None, None, '2755503') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 567 time used for this insertion : 0.06611967086791992 save_final save missing photos in datou_result : time spend for datou_step_exec : 134.08741784095764 time spend to save output : 0.07456636428833008 total time spend for step 2 : 134.16198420524597 step3:rle_unique_nms_with_priority Thu Apr 24 04:14:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 186 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 21 nb_hashtags : 4 time to prepare the origin masks : 8.69961142539978 time for calcul the mask position with numpy : 0.2557101249694824 nb_pixel_total : 5961309 time to create 1 rle with new method : 0.778113842010498 time for calcul the mask position with numpy : 0.03373217582702637 nb_pixel_total : 77396 time to create 1 rle with old method : 0.08139801025390625 time for calcul the mask position with numpy : 0.032323360443115234 nb_pixel_total : 12384 time to create 1 rle with old method : 0.01356816291809082 time for calcul the mask position with numpy : 0.030161380767822266 nb_pixel_total : 42187 time to create 1 rle with old method : 0.044472455978393555 time for calcul the mask position with numpy : 0.02068161964416504 nb_pixel_total : 5743 time to create 1 rle with old method : 0.006233930587768555 time for calcul the mask position with numpy : 0.021480321884155273 nb_pixel_total : 21964 time to create 1 rle with old method : 0.02397465705871582 time for calcul the mask position with numpy : 0.020667552947998047 nb_pixel_total : 27322 time to create 1 rle with old method : 0.029114961624145508 time for calcul the mask position with numpy : 0.01983928680419922 nb_pixel_total : 19981 time to create 1 rle with old method : 0.021296024322509766 time for calcul the mask position with numpy : 0.01939678192138672 nb_pixel_total : 14704 time to create 1 rle with old method : 0.016255617141723633 time for calcul the mask position with numpy : 0.021122217178344727 nb_pixel_total : 23447 time to create 1 rle with old method : 0.025895357131958008 time for calcul the mask position with numpy : 0.021574020385742188 nb_pixel_total : 39550 time to create 1 rle with old method : 0.043062686920166016 time for calcul the mask position with numpy : 0.020920515060424805 nb_pixel_total : 18603 time to create 1 rle with old method : 0.02028799057006836 time for calcul the mask position with numpy : 0.02249932289123535 nb_pixel_total : 203510 time to create 1 rle with new method : 0.7362031936645508 time for calcul the mask position with numpy : 0.019710063934326172 nb_pixel_total : 30853 time to create 1 rle with old method : 0.03316473960876465 time for calcul the mask position with numpy : 0.020441770553588867 nb_pixel_total : 29512 time to create 1 rle with old method : 0.03194451332092285 time for calcul the mask position with numpy : 0.020407915115356445 nb_pixel_total : 17815 time to create 1 rle with old method : 0.01897883415222168 time for calcul the mask position with numpy : 0.021388769149780273 nb_pixel_total : 163612 time to create 1 rle with new method : 0.6411259174346924 time for calcul the mask position with numpy : 0.02149200439453125 nb_pixel_total : 13001 time to create 1 rle with old method : 0.01433563232421875 time for calcul the mask position with numpy : 0.02051711082458496 nb_pixel_total : 28094 time to create 1 rle with old method : 0.030884265899658203 time for calcul the mask position with numpy : 0.026636123657226562 nb_pixel_total : 12373 time to create 1 rle with old method : 0.013892412185668945 time for calcul the mask position with numpy : 0.03488779067993164 nb_pixel_total : 232270 time to create 1 rle with new method : 0.6203453540802002 time for calcul the mask position with numpy : 0.03281283378601074 nb_pixel_total : 54610 time to create 1 rle with old method : 0.0591433048248291 create new chi : 4.158753156661987 time to delete rle : 0.019510746002197266 batch 1 Loaded 43 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 13449 TO DO : save crop sub photo not yet done ! save time : 0.7980227470397949 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 8.32550048828125 time for calcul the mask position with numpy : 0.266049861907959 nb_pixel_total : 5693255 time to create 1 rle with new method : 0.6774685382843018 time for calcul the mask position with numpy : 0.03666543960571289 nb_pixel_total : 22045 time to create 1 rle with old method : 0.02460479736328125 time for calcul the mask position with numpy : 0.03710007667541504 nb_pixel_total : 90349 time to create 1 rle with old method : 0.10236930847167969 time for calcul the mask position with numpy : 0.035115957260131836 nb_pixel_total : 81176 time to create 1 rle with old method : 0.09307408332824707 time for calcul the mask position with numpy : 0.035256385803222656 nb_pixel_total : 43498 time to create 1 rle with old method : 0.04958510398864746 time for calcul the mask position with numpy : 0.03601431846618652 nb_pixel_total : 86883 time to create 1 rle with old method : 0.10267424583435059 time for calcul the mask position with numpy : 0.04275107383728027 nb_pixel_total : 73044 time to create 1 rle with old method : 0.08121514320373535 time for calcul the mask position with numpy : 0.034333229064941406 nb_pixel_total : 61513 time to create 1 rle with old method : 0.0799868106842041 time for calcul the mask position with numpy : 0.041587114334106445 nb_pixel_total : 10101 time to create 1 rle with old method : 0.015336036682128906 time for calcul the mask position with numpy : 0.03892922401428223 nb_pixel_total : 178031 time to create 1 rle with new method : 0.5113873481750488 time for calcul the mask position with numpy : 0.03477001190185547 nb_pixel_total : 107684 time to create 1 rle with old method : 0.11827802658081055 time for calcul the mask position with numpy : 0.031219482421875 nb_pixel_total : 25247 time to create 1 rle with old method : 0.028077363967895508 time for calcul the mask position with numpy : 0.023264646530151367 nb_pixel_total : 213894 time to create 1 rle with new method : 0.6647584438323975 time for calcul the mask position with numpy : 0.03806734085083008 nb_pixel_total : 176563 time to create 1 rle with new method : 0.5849637985229492 time for calcul the mask position with numpy : 0.028408288955688477 nb_pixel_total : 29779 time to create 1 rle with old method : 0.03335261344909668 time for calcul the mask position with numpy : 0.029068946838378906 nb_pixel_total : 77351 time to create 1 rle with old method : 0.09010076522827148 time for calcul the mask position with numpy : 0.02755260467529297 nb_pixel_total : 48480 time to create 1 rle with old method : 0.05674314498901367 time for calcul the mask position with numpy : 0.026156902313232422 nb_pixel_total : 31347 time to create 1 rle with old method : 0.0365605354309082 create new chi : 4.3178911209106445 time to delete rle : 0.0021271705627441406 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 14078 TO DO : save crop sub photo not yet done ! save time : 0.8687953948974609 nb_obj : 18 nb_hashtags : 2 time to prepare the origin masks : 7.376137733459473 time for calcul the mask position with numpy : 0.5458805561065674 nb_pixel_total : 6326102 time to create 1 rle with new method : 1.2011291980743408 time for calcul the mask position with numpy : 0.02199578285217285 nb_pixel_total : 28669 time to create 1 rle with old method : 0.04108023643493652 time for calcul the mask position with numpy : 0.025266408920288086 nb_pixel_total : 38743 time to create 1 rle with old method : 0.04919028282165527 time for calcul the mask position with numpy : 0.024562597274780273 nb_pixel_total : 27289 time to create 1 rle with old method : 0.03129863739013672 time for calcul the mask position with numpy : 0.024338960647583008 nb_pixel_total : 15693 time to create 1 rle with old method : 0.018083810806274414 time for calcul the mask position with numpy : 0.02319622039794922 nb_pixel_total : 57678 time to create 1 rle with old method : 0.07064652442932129 time for calcul the mask position with numpy : 0.02307295799255371 nb_pixel_total : 2865 time to create 1 rle with old method : 0.0037429332733154297 time for calcul the mask position with numpy : 0.0236663818359375 nb_pixel_total : 63813 time to create 1 rle with old method : 0.08093786239624023 time for calcul the mask position with numpy : 0.023402929306030273 nb_pixel_total : 43357 time to create 1 rle with old method : 0.062293291091918945 time for calcul the mask position with numpy : 0.028798580169677734 nb_pixel_total : 21711 time to create 1 rle with old method : 0.02820730209350586 time for calcul the mask position with numpy : 0.03892970085144043 nb_pixel_total : 16892 time to create 1 rle with old method : 0.020921945571899414 time for calcul the mask position with numpy : 0.037676334381103516 nb_pixel_total : 20120 time to create 1 rle with old method : 0.023789405822753906 time for calcul the mask position with numpy : 0.03567361831665039 nb_pixel_total : 38806 time to create 1 rle with old method : 0.06250572204589844 time for calcul the mask position with numpy : 0.04511880874633789 nb_pixel_total : 8263 time to create 1 rle with old method : 0.013632059097290039 time for calcul the mask position with numpy : 0.048044681549072266 nb_pixel_total : 9207 time to create 1 rle with old method : 0.016704797744750977 time for calcul the mask position with numpy : 0.0324246883392334 nb_pixel_total : 8026 time to create 1 rle with old method : 0.009082317352294922 time for calcul the mask position with numpy : 0.02470993995666504 nb_pixel_total : 151151 time to create 1 rle with new method : 0.8282310962677002 time for calcul the mask position with numpy : 0.02340078353881836 nb_pixel_total : 104744 time to create 1 rle with old method : 0.11820650100708008 time for calcul the mask position with numpy : 0.023496150970458984 nb_pixel_total : 67111 time to create 1 rle with old method : 0.07633090019226074 create new chi : 3.8981549739837646 time to delete rle : 0.0016515254974365234 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 10643 TO DO : save crop sub photo not yet done ! save time : 0.6710922718048096 nb_obj : 21 nb_hashtags : 4 time to prepare the origin masks : 8.815083742141724 time for calcul the mask position with numpy : 0.3179781436920166 nb_pixel_total : 6591568 time to create 1 rle with new method : 0.6221611499786377 time for calcul the mask position with numpy : 0.036887168884277344 nb_pixel_total : 36176 time to create 1 rle with old method : 0.05845069885253906 time for calcul the mask position with numpy : 0.037621259689331055 nb_pixel_total : 34177 time to create 1 rle with old method : 0.038500308990478516 time for calcul the mask position with numpy : 0.03436756134033203 nb_pixel_total : 42612 time to create 1 rle with old method : 0.047467947006225586 time for calcul the mask position with numpy : 0.03577303886413574 nb_pixel_total : 11341 time to create 1 rle with old method : 0.012400388717651367 time for calcul the mask position with numpy : 0.03298616409301758 nb_pixel_total : 13777 time to create 1 rle with old method : 0.015325546264648438 time for calcul the mask position with numpy : 0.029778003692626953 nb_pixel_total : 9137 time to create 1 rle with old method : 0.010454177856445312 time for calcul the mask position with numpy : 0.03403043746948242 nb_pixel_total : 6891 time to create 1 rle with old method : 0.0077838897705078125 time for calcul the mask position with numpy : 0.032785654067993164 nb_pixel_total : 23917 time to create 1 rle with old method : 0.027536869049072266 time for calcul the mask position with numpy : 0.03394508361816406 nb_pixel_total : 80655 time to create 1 rle with old method : 0.08903121948242188 time for calcul the mask position with numpy : 0.023341894149780273 nb_pixel_total : 5395 time to create 1 rle with old method : 0.006134748458862305 time for calcul the mask position with numpy : 0.024634838104248047 nb_pixel_total : 40147 time to create 1 rle with old method : 0.046764373779296875 time for calcul the mask position with numpy : 0.026071786880493164 nb_pixel_total : 9839 time to create 1 rle with old method : 0.011248588562011719 time for calcul the mask position with numpy : 0.023593902587890625 nb_pixel_total : 4257 time to create 1 rle with old method : 0.0051920413970947266 time for calcul the mask position with numpy : 0.02223658561706543 nb_pixel_total : 19440 time to create 1 rle with old method : 0.022108793258666992 time for calcul the mask position with numpy : 0.024729013442993164 nb_pixel_total : 22710 time to create 1 rle with old method : 0.025706052780151367 time for calcul the mask position with numpy : 0.023746967315673828 nb_pixel_total : 8867 time to create 1 rle with old method : 0.010161161422729492 time for calcul the mask position with numpy : 0.023097753524780273 nb_pixel_total : 11448 time to create 1 rle with old method : 0.012448310852050781 time for calcul the mask position with numpy : 0.02219986915588379 nb_pixel_total : 35384 time to create 1 rle with old method : 0.03966331481933594 time for calcul the mask position with numpy : 0.022655963897705078 nb_pixel_total : 18636 time to create 1 rle with old method : 0.021328449249267578 time for calcul the mask position with numpy : 0.02355337142944336 nb_pixel_total : 10902 time to create 1 rle with old method : 0.012684345245361328 time for calcul the mask position with numpy : 0.02208542823791504 nb_pixel_total : 12964 time to create 1 rle with old method : 0.019829511642456055 create new chi : 2.1124064922332764 time to delete rle : 0.001968860626220703 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++++Number RLEs to save : 9714 TO DO : save crop sub photo not yet done ! save time : 0.6010804176330566 nb_obj : 28 nb_hashtags : 4 time to prepare the origin masks : 3.7809336185455322 time for calcul the mask position with numpy : 0.5001857280731201 nb_pixel_total : 6353770 time to create 1 rle with new method : 0.6171784400939941 time for calcul the mask position with numpy : 0.03056049346923828 nb_pixel_total : 10390 time to create 1 rle with old method : 0.012579917907714844 time for calcul the mask position with numpy : 0.03188943862915039 nb_pixel_total : 46957 time to create 1 rle with old method : 0.05583381652832031 time for calcul the mask position with numpy : 0.02956366539001465 nb_pixel_total : 34237 time to create 1 rle with old method : 0.03756093978881836 time for calcul the mask position with numpy : 0.030051469802856445 nb_pixel_total : 17585 time to create 1 rle with old method : 0.01969766616821289 time for calcul the mask position with numpy : 0.029633522033691406 nb_pixel_total : 7420 time to create 1 rle with old method : 0.008159875869750977 time for calcul the mask position with numpy : 0.027974843978881836 nb_pixel_total : 6407 time to create 1 rle with old method : 0.006918668746948242 time for calcul the mask position with numpy : 0.0284423828125 nb_pixel_total : 6464 time to create 1 rle with old method : 0.007405996322631836 time for calcul the mask position with numpy : 0.030588626861572266 nb_pixel_total : 34320 time to create 1 rle with old method : 0.04185628890991211 time for calcul the mask position with numpy : 0.029327392578125 nb_pixel_total : 36219 time to create 1 rle with old method : 0.0405423641204834 time for calcul the mask position with numpy : 0.030612468719482422 nb_pixel_total : 7739 time to create 1 rle with old method : 0.0140380859375 time for calcul the mask position with numpy : 0.03647494316101074 nb_pixel_total : 29115 time to create 1 rle with old method : 0.037404775619506836 time for calcul the mask position with numpy : 0.029219388961791992 nb_pixel_total : 19026 time to create 1 rle with old method : 0.02112412452697754 time for calcul the mask position with numpy : 0.029610157012939453 nb_pixel_total : 73417 time to create 1 rle with old method : 0.08314943313598633 time for calcul the mask position with numpy : 0.02946615219116211 nb_pixel_total : 77565 time to create 1 rle with old method : 0.08615517616271973 time for calcul the mask position with numpy : 0.02947402000427246 nb_pixel_total : 17723 time to create 1 rle with old method : 0.019921064376831055 time for calcul the mask position with numpy : 0.02871108055114746 nb_pixel_total : 11309 time to create 1 rle with old method : 0.01272726058959961 time for calcul the mask position with numpy : 0.029119014739990234 nb_pixel_total : 49348 time to create 1 rle with old method : 0.05522012710571289 time for calcul the mask position with numpy : 0.029370546340942383 nb_pixel_total : 11926 time to create 1 rle with old method : 0.013441324234008789 time for calcul the mask position with numpy : 0.029619693756103516 nb_pixel_total : 8167 time to create 1 rle with old method : 0.00937032699584961 time for calcul the mask position with numpy : 0.02941584587097168 nb_pixel_total : 13572 time to create 1 rle with old method : 0.015481948852539062 time for calcul the mask position with numpy : 0.029388904571533203 nb_pixel_total : 6489 time to create 1 rle with old method : 0.007379293441772461 time for calcul the mask position with numpy : 0.030472517013549805 nb_pixel_total : 46819 time to create 1 rle with old method : 0.05375480651855469 time for calcul the mask position with numpy : 0.029628276824951172 nb_pixel_total : 34290 time to create 1 rle with old method : 0.03953719139099121 time for calcul the mask position with numpy : 0.0291440486907959 nb_pixel_total : 5106 time to create 1 rle with old method : 0.006080150604248047 time for calcul the mask position with numpy : 0.029661893844604492 nb_pixel_total : 25613 time to create 1 rle with old method : 0.029330968856811523 time for calcul the mask position with numpy : 0.029612302780151367 nb_pixel_total : 37748 time to create 1 rle with old method : 0.04222917556762695 time for calcul the mask position with numpy : 0.030473947525024414 nb_pixel_total : 15703 time to create 1 rle with old method : 0.01821112632751465 time for calcul the mask position with numpy : 0.03070211410522461 nb_pixel_total : 5796 time to create 1 rle with old method : 0.009306192398071289 create new chi : 2.7993693351745605 time to delete rle : 0.0035233497619628906 batch 1 Loaded 57 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++Number RLEs to save : 13374 TO DO : save crop sub photo not yet done ! save time : 0.8351881504058838 nb_obj : 25 nb_hashtags : 3 time to prepare the origin masks : 8.870486497879028 time for calcul the mask position with numpy : 0.3819413185119629 nb_pixel_total : 6352157 time to create 1 rle with new method : 1.0292956829071045 time for calcul the mask position with numpy : 0.0361027717590332 nb_pixel_total : 15959 time to create 1 rle with old method : 0.01793193817138672 time for calcul the mask position with numpy : 0.03934645652770996 nb_pixel_total : 12405 time to create 1 rle with old method : 0.01393747329711914 time for calcul the mask position with numpy : 0.03527522087097168 nb_pixel_total : 42929 time to create 1 rle with old method : 0.05183291435241699 time for calcul the mask position with numpy : 0.03468489646911621 nb_pixel_total : 13942 time to create 1 rle with old method : 0.015640735626220703 time for calcul the mask position with numpy : 0.03555178642272949 nb_pixel_total : 14953 time to create 1 rle with old method : 0.01672959327697754 time for calcul the mask position with numpy : 0.033186912536621094 nb_pixel_total : 5593 time to create 1 rle with old method : 0.0061528682708740234 time for calcul the mask position with numpy : 0.021894216537475586 nb_pixel_total : 11960 time to create 1 rle with old method : 0.013578414916992188 time for calcul the mask position with numpy : 0.023551464080810547 nb_pixel_total : 28685 time to create 1 rle with old method : 0.03198885917663574 time for calcul the mask position with numpy : 0.02293229103088379 nb_pixel_total : 61117 time to create 1 rle with old method : 0.06681013107299805 time for calcul the mask position with numpy : 0.026337862014770508 nb_pixel_total : 28811 time to create 1 rle with old method : 0.031145811080932617 time for calcul the mask position with numpy : 0.0209805965423584 nb_pixel_total : 11585 time to create 1 rle with old method : 0.012912273406982422 time for calcul the mask position with numpy : 0.034960031509399414 nb_pixel_total : 10578 time to create 1 rle with old method : 0.017548561096191406 time for calcul the mask position with numpy : 0.039498090744018555 nb_pixel_total : 18011 time to create 1 rle with old method : 0.020228147506713867 time for calcul the mask position with numpy : 0.03347039222717285 nb_pixel_total : 52467 time to create 1 rle with old method : 0.05613398551940918 time for calcul the mask position with numpy : 0.034612417221069336 nb_pixel_total : 21170 time to create 1 rle with old method : 0.022675752639770508 time for calcul the mask position with numpy : 0.0335540771484375 nb_pixel_total : 11662 time to create 1 rle with old method : 0.012595653533935547 time for calcul the mask position with numpy : 0.03422880172729492 nb_pixel_total : 146916 time to create 1 rle with old method : 0.16047883033752441 time for calcul the mask position with numpy : 0.03398442268371582 nb_pixel_total : 18277 time to create 1 rle with old method : 0.019896745681762695 time for calcul the mask position with numpy : 0.03420305252075195 nb_pixel_total : 39362 time to create 1 rle with old method : 0.04261207580566406 time for calcul the mask position with numpy : 0.03455662727355957 nb_pixel_total : 17194 time to create 1 rle with old method : 0.018990039825439453 time for calcul the mask position with numpy : 0.03239917755126953 nb_pixel_total : 16291 time to create 1 rle with old method : 0.017618894577026367 time for calcul the mask position with numpy : 0.0224761962890625 nb_pixel_total : 38361 time to create 1 rle with old method : 0.04495739936828613 time for calcul the mask position with numpy : 0.021817445755004883 nb_pixel_total : 15847 time to create 1 rle with old method : 0.017255306243896484 time for calcul the mask position with numpy : 0.021758556365966797 nb_pixel_total : 21834 time to create 1 rle with old method : 0.02451777458190918 time for calcul the mask position with numpy : 0.023080825805664062 nb_pixel_total : 22174 time to create 1 rle with old method : 0.025056123733520508 create new chi : 2.989900588989258 time to delete rle : 0.002003192901611328 batch 1 Loaded 51 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 11756 TO DO : save crop sub photo not yet done ! save time : 0.7464108467102051 nb_obj : 29 nb_hashtags : 3 time to prepare the origin masks : 3.9974327087402344 time for calcul the mask position with numpy : 0.55617356300354 nb_pixel_total : 5967359 time to create 1 rle with new method : 0.871401309967041 time for calcul the mask position with numpy : 0.02910757064819336 nb_pixel_total : 19732 time to create 1 rle with old method : 0.022412538528442383 time for calcul the mask position with numpy : 0.030766725540161133 nb_pixel_total : 19245 time to create 1 rle with old method : 0.021984577178955078 time for calcul the mask position with numpy : 0.029329538345336914 nb_pixel_total : 18069 time to create 1 rle with old method : 0.020313501358032227 time for calcul the mask position with numpy : 0.029670000076293945 nb_pixel_total : 16301 time to create 1 rle with old method : 0.018572092056274414 time for calcul the mask position with numpy : 0.02919769287109375 nb_pixel_total : 6012 time to create 1 rle with old method : 0.006738901138305664 time for calcul the mask position with numpy : 0.029105663299560547 nb_pixel_total : 7023 time to create 1 rle with old method : 0.007972240447998047 time for calcul the mask position with numpy : 0.02933788299560547 nb_pixel_total : 30581 time to create 1 rle with old method : 0.03548145294189453 time for calcul the mask position with numpy : 0.029374361038208008 nb_pixel_total : 28144 time to create 1 rle with old method : 0.03664827346801758 time for calcul the mask position with numpy : 0.029344797134399414 nb_pixel_total : 17284 time to create 1 rle with old method : 0.020427942276000977 time for calcul the mask position with numpy : 0.030567646026611328 nb_pixel_total : 58150 time to create 1 rle with old method : 0.06790566444396973 time for calcul the mask position with numpy : 0.03121352195739746 nb_pixel_total : 53267 time to create 1 rle with old method : 0.06193852424621582 time for calcul the mask position with numpy : 0.029647111892700195 nb_pixel_total : 134841 time to create 1 rle with old method : 0.17627954483032227 time for calcul the mask position with numpy : 0.029293298721313477 nb_pixel_total : 22151 time to create 1 rle with old method : 0.031230688095092773 time for calcul the mask position with numpy : 0.0292050838470459 nb_pixel_total : 5658 time to create 1 rle with old method : 0.0064334869384765625 time for calcul the mask position with numpy : 0.029618501663208008 nb_pixel_total : 31133 time to create 1 rle with old method : 0.034459590911865234 time for calcul the mask position with numpy : 0.02986621856689453 nb_pixel_total : 136644 time to create 1 rle with old method : 0.15338993072509766 time for calcul the mask position with numpy : 0.028499364852905273 nb_pixel_total : 11931 time to create 1 rle with old method : 0.013398408889770508 time for calcul the mask position with numpy : 0.027907133102416992 nb_pixel_total : 74197 time to create 1 rle with old method : 0.07948184013366699 time for calcul the mask position with numpy : 0.02908039093017578 nb_pixel_total : 19204 time to create 1 rle with old method : 0.02196216583251953 time for calcul the mask position with numpy : 0.030249834060668945 nb_pixel_total : 14286 time to create 1 rle with old method : 0.016105175018310547 time for calcul the mask position with numpy : 0.028644800186157227 nb_pixel_total : 14502 time to create 1 rle with old method : 0.01603984832763672 time for calcul the mask position with numpy : 0.03211474418640137 nb_pixel_total : 58053 time to create 1 rle with old method : 0.06405925750732422 time for calcul the mask position with numpy : 0.028942584991455078 nb_pixel_total : 83286 time to create 1 rle with old method : 0.09087944030761719 time for calcul the mask position with numpy : 0.0317997932434082 nb_pixel_total : 39867 time to create 1 rle with old method : 0.05574607849121094 time for calcul the mask position with numpy : 0.02906513214111328 nb_pixel_total : 8180 time to create 1 rle with old method : 0.00922250747680664 time for calcul the mask position with numpy : 0.028559207916259766 nb_pixel_total : 21942 time to create 1 rle with old method : 0.024500370025634766 time for calcul the mask position with numpy : 0.02953171730041504 nb_pixel_total : 38669 time to create 1 rle with old method : 0.043074607849121094 time for calcul the mask position with numpy : 0.030003070831298828 nb_pixel_total : 83937 time to create 1 rle with old method : 0.09776854515075684 time for calcul the mask position with numpy : 0.02827763557434082 nb_pixel_total : 10592 time to create 1 rle with old method : 0.011377334594726562 create new chi : 3.5846691131591797 time to delete rle : 0.0024633407592773438 batch 1 Loaded 59 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++Number RLEs to save : 15524 TO DO : save crop sub photo not yet done ! save time : 0.9490208625793457 nb_obj : 15 nb_hashtags : 2 time to prepare the origin masks : 6.679960250854492 time for calcul the mask position with numpy : 0.4600811004638672 nb_pixel_total : 6545356 time to create 1 rle with new method : 0.9385168552398682 time for calcul the mask position with numpy : 0.03396797180175781 nb_pixel_total : 12943 time to create 1 rle with old method : 0.01465606689453125 time for calcul the mask position with numpy : 0.026182889938354492 nb_pixel_total : 150291 time to create 1 rle with new method : 0.3859140872955322 time for calcul the mask position with numpy : 0.022062063217163086 nb_pixel_total : 9182 time to create 1 rle with old method : 0.01007843017578125 time for calcul the mask position with numpy : 0.02553248405456543 nb_pixel_total : 39530 time to create 1 rle with old method : 0.04416489601135254 time for calcul the mask position with numpy : 0.022541522979736328 nb_pixel_total : 7542 time to create 1 rle with old method : 0.009650468826293945 time for calcul the mask position with numpy : 0.021266698837280273 nb_pixel_total : 12808 time to create 1 rle with old method : 0.013936042785644531 time for calcul the mask position with numpy : 0.021877527236938477 nb_pixel_total : 22587 time to create 1 rle with old method : 0.025652170181274414 time for calcul the mask position with numpy : 0.023607730865478516 nb_pixel_total : 36383 time to create 1 rle with old method : 0.03944134712219238 time for calcul the mask position with numpy : 0.021977663040161133 nb_pixel_total : 43497 time to create 1 rle with old method : 0.04831576347351074 time for calcul the mask position with numpy : 0.02585577964782715 nb_pixel_total : 20033 time to create 1 rle with old method : 0.02595376968383789 time for calcul the mask position with numpy : 0.024744272232055664 nb_pixel_total : 26854 time to create 1 rle with old method : 0.0428009033203125 time for calcul the mask position with numpy : 0.02353215217590332 nb_pixel_total : 35046 time to create 1 rle with old method : 0.04079246520996094 time for calcul the mask position with numpy : 0.025402069091796875 nb_pixel_total : 11427 time to create 1 rle with old method : 0.012708425521850586 time for calcul the mask position with numpy : 0.02285909652709961 nb_pixel_total : 63537 time to create 1 rle with old method : 0.07044219970703125 time for calcul the mask position with numpy : 0.022737503051757812 nb_pixel_total : 13224 time to create 1 rle with old method : 0.015273571014404297 create new chi : 2.637547016143799 time to delete rle : 0.0014052391052246094 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 9440 TO DO : save crop sub photo not yet done ! save time : 0.6200170516967773 nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 5.429568767547607 time for calcul the mask position with numpy : 0.4057960510253906 nb_pixel_total : 6017645 time to create 1 rle with new method : 1.0228207111358643 time for calcul the mask position with numpy : 0.021265745162963867 nb_pixel_total : 8478 time to create 1 rle with old method : 0.009490966796875 time for calcul the mask position with numpy : 0.021217823028564453 nb_pixel_total : 51884 time to create 1 rle with old method : 0.05741453170776367 time for calcul the mask position with numpy : 0.022627830505371094 nb_pixel_total : 30422 time to create 1 rle with old method : 0.034131526947021484 time for calcul the mask position with numpy : 0.021488666534423828 nb_pixel_total : 66401 time to create 1 rle with old method : 0.07338142395019531 time for calcul the mask position with numpy : 0.02502155303955078 nb_pixel_total : 35710 time to create 1 rle with old method : 0.04015183448791504 time for calcul the mask position with numpy : 0.021667957305908203 nb_pixel_total : 19665 time to create 1 rle with old method : 0.022433042526245117 time for calcul the mask position with numpy : 0.023034334182739258 nb_pixel_total : 217859 time to create 1 rle with new method : 0.6495983600616455 time for calcul the mask position with numpy : 0.035077810287475586 nb_pixel_total : 63162 time to create 1 rle with old method : 0.07165145874023438 time for calcul the mask position with numpy : 0.0350191593170166 nb_pixel_total : 63086 time to create 1 rle with old method : 0.0863790512084961 time for calcul the mask position with numpy : 0.03677248954772949 nb_pixel_total : 179493 time to create 1 rle with new method : 0.590700626373291 time for calcul the mask position with numpy : 0.030380725860595703 nb_pixel_total : 26269 time to create 1 rle with old method : 0.02944016456604004 time for calcul the mask position with numpy : 0.030718564987182617 nb_pixel_total : 270166 time to create 1 rle with new method : 0.8470189571380615 create new chi : 4.385574579238892 time to delete rle : 0.0036437511444091797 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 11176 TO DO : save crop sub photo not yet done ! save time : 0.7884140014648438 map_output_result : {1353161022: (0.0, 'Should be the crop_list due to order', 0), 1353161018: (0.0, 'Should be the crop_list due to order', 0), 1353118550: (0.0, 'Should be the crop_list due to order', 0), 1353118539: (0.0, 'Should be the crop_list due to order', 0), 1353118414: (0.0, 'Should be the crop_list due to order', 0), 1353118411: (0.0, 'Should be the crop_list due to order', 0), 1353118409: (0.0, 'Should be the crop_list due to order', 0), 1353118380: (0.0, 'Should be the crop_list due to order', 0), 1353118346: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1353161022, 1353161018, 1353118550, 1353118539, 1353118414, 1353118411, 1353118409, 1353118380, 1353118346] Looping around the photos to save general results len do output : 9 /1353161022.Didn't retrieve data . /1353161018.Didn't retrieve data . /1353118550.Didn't retrieve data . /1353118539.Didn't retrieve data . /1353118414.Didn't retrieve data . /1353118411.Didn't retrieve data . /1353118409.Didn't retrieve data . /1353118380.Didn't retrieve data . /1353118346.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353161022', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353161018', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118550', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118539', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118414', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118411', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118409', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118380', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118346', None, None, None, None, None, '2755503') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.014142751693725586 save_final save missing photos in datou_result : time spend for datou_step_exec : 100.88702392578125 time spend to save output : 0.014762163162231445 total time spend for step 3 : 100.90178608894348 step4:ventilate_hashtags_in_portfolio Thu Apr 24 04:15:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22366555 get user id for portfolio 22366555 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22366555 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','autre','flou','carton','pet_fonce','papier','pehd','environnement','background','pet_clair','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22366555 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','autre','flou','carton','pet_fonce','papier','pehd','environnement','background','pet_clair','metal')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22366555 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','autre','flou','carton','pet_fonce','papier','pehd','environnement','background','pet_clair','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22366633,22366634,22366635,22366636,22366637,22366638,22366639,22366640,22366641,22366642,22366643?tags=mal_croppe,autre,flou,carton,pet_fonce,papier,pehd,environnement,background,pet_clair,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1353161022, 1353161018, 1353118550, 1353118539, 1353118414, 1353118411, 1353118409, 1353118380, 1353118346] Looping around the photos to save general results len do output : 1 /22366555. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353161022', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353161018', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118550', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118539', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118414', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118411', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118409', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118380', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118346', None, None, None, None, None, '2755503') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.01790022850036621 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5972676277160645 time spend to save output : 0.01811528205871582 total time spend for step 4 : 1.6153829097747803 step5:final Thu Apr 24 04:15:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1353161022: ('0.12046302285060113',), 1353161018: ('0.12046302285060113',), 1353118550: ('0.12046302285060113',), 1353118539: ('0.12046302285060113',), 1353118414: ('0.12046302285060113',), 1353118411: ('0.12046302285060113',), 1353118409: ('0.12046302285060113',), 1353118380: ('0.12046302285060113',), 1353118346: ('0.12046302285060113',)} new output for save of step final : {1353161022: ('0.12046302285060113',), 1353161018: ('0.12046302285060113',), 1353118550: ('0.12046302285060113',), 1353118539: ('0.12046302285060113',), 1353118414: ('0.12046302285060113',), 1353118411: ('0.12046302285060113',), 1353118409: ('0.12046302285060113',), 1353118380: ('0.12046302285060113',), 1353118346: ('0.12046302285060113',)} [1353161022, 1353161018, 1353118550, 1353118539, 1353118414, 1353118411, 1353118409, 1353118380, 1353118346] Looping around the photos to save general results len do output : 9 /1353161022.Didn't retrieve data . /1353161018.Didn't retrieve data . /1353118550.Didn't retrieve data . /1353118539.Didn't retrieve data . /1353118414.Didn't retrieve data . /1353118411.Didn't retrieve data . /1353118409.Didn't retrieve data . /1353118380.Didn't retrieve data . /1353118346.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353161022', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353161018', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118550', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118539', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118414', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118411', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118409', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118380', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118346', None, None, None, None, None, '2755503') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.013178348541259766 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11969947814941406 time spend to save output : 0.013907670974731445 total time spend for step 5 : 0.1336071491241455 step6:blur_detection Thu Apr 24 04:15:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e.jpg resize: (2160, 3264) 1353161022 -3.2419400488593224 treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def.jpg resize: (2160, 3264) 1353161018 -1.4197795078749187 treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720.jpg resize: (2160, 3264) 1353118550 -3.4092841144610007 treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999.jpg resize: (2160, 3264) 1353118539 0.6366030643413826 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb.jpg resize: (2160, 3264) 1353118414 -4.122408560183707 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6.jpg resize: (2160, 3264) 1353118411 -2.7238494422673085 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1.jpg resize: (2160, 3264) 1353118409 -3.459142741799071 treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495.jpg resize: (2160, 3264) 1353118380 -2.9157884819994804 treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8.jpg resize: (2160, 3264) 1353118346 -1.4376181214293726 treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832363_0.png resize: (413, 588) 1353255389 -1.2475088694273315 treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832378_0.png resize: (395, 266) 1353255390 -0.8272167922461117 treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832375_0.png resize: (90, 82) 1353255391 0.8619197874038083 treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832360_0.png resize: (191, 109) 1353255392 -1.6905330971553882 treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832376_0.png resize: (352, 191) 1353255393 -2.848809938720547 treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832366_0.png resize: (194, 237) 1353255394 -2.4636030576990007 treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832364_0.png resize: (159, 136) 1353255395 1.0053596509229028 treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832359_0.png resize: (489, 773) 1353255396 -3.197344603584617 treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832370_0.png resize: (166, 195) 1353255397 -2.0005195185283955 treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832361_0.png resize: (189, 207) 1353255398 -2.934382061969425 treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832377_0.png resize: (125, 178) 1353255399 -0.9754598169318707 treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832362_0.png resize: (166, 159) 1353255400 -1.5450993459978024 treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832387_0.png resize: (699, 347) 1353255401 -1.11415133657064 treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832383_0.png resize: (395, 656) 1353255403 -1.1012820332419175 treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832385_0.png resize: (171, 208) 1353255404 0.04253652158020905 treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832393_0.png resize: (427, 338) 1353255405 -0.9121016437148686 treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832381_0.png resize: (263, 386) 1353255406 0.0035002055506018767 treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832391_0.png resize: (427, 327) 1353255407 -0.5251904597017206 treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832382_0.png resize: (233, 261) 1353255408 -0.2562957470447344 treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832411_0.png resize: (182, 217) 1353255409 -1.2657763975836729 treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832404_0.png resize: (167, 151) 1353255410 -1.5501886648212753 treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832405_0.png resize: (235, 171) 1353255411 -1.7140278859446942 treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832401_0.png resize: (84, 183) 1353255412 -1.9538331026302298 treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832410_0.png resize: (107, 183) 1353255413 -0.6287681564637063 treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832403_0.png resize: (223, 118) 1353255414 -0.4260791489963534 treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832409_0.png resize: (515, 319) 1353255415 -1.9347964039000005 treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832408_0.png resize: (351, 534) 1353255416 -2.8912380220398872 treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832399_0.png resize: (91, 139) 1353255417 0.07287029475770991 treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832402_0.png resize: (212, 245) 1353255418 -1.514567229009792 treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832412_0.png resize: (212, 242) 1353255419 -0.6843989835670713 treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832400_0.png resize: (124, 133) 1353255420 -1.7027363714629602 treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832425_0.png resize: (109, 72) 1353255421 -1.811542789132193 treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832421_0.png resize: (177, 140) 1353255422 -1.598205750965424 treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832420_0.png resize: (220, 160) 1353255423 -2.447280285193069 treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832434_0.png resize: (226, 218) 1353255424 -1.77064958016354 treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832423_0.png resize: (118, 122) 1353255425 -1.430708324276304 treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832433_0.png resize: (298, 145) 1353255426 -1.5580390524242662 treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832416_0.png resize: (213, 103) 1353255427 0.5327028605830738 treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832428_0.png resize: (92, 92) 1353255428 1.6046235999117826 treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832429_0.png resize: (101, 102) 1353255430 3.6620587428080653 treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832418_0.png resize: (149, 103) 1353255431 0.4264501772822451 treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832422_0.png resize: (75, 81) 1353255432 -0.5196787373485565 treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832414_0.png resize: (141, 154) 1353255433 0.2640300214811757 treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832419_0.png resize: (110, 101) 1353255434 0.041387743176626995 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832437_0.png resize: (164, 227) 1353255435 -1.5922321009692022 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832452_0.png resize: (210, 243) 1353255436 -1.310427681878649 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832441_0.png resize: (82, 133) 1353255437 -0.7325322861807827 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832449_0.png resize: (150, 89) 1353255438 -2.040864330024909 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832436_0.png resize: (380, 191) 1353255439 -1.7912028810556115 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832459_0.png resize: (107, 105) 1353255440 -1.7968408721884495 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832435_0.png resize: (266, 201) 1353255441 -1.4867310680093928 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832442_0.png resize: (196, 597) 1353255442 -1.5428094044306402 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832438_0.png resize: (218, 299) 1353255443 -1.477044751259959 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832444_0.png resize: (66, 102) 1353255445 1.096847792651092 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832447_0.png resize: (208, 181) 1353255446 -4.236878989379431 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832460_0.png resize: (126, 117) 1353255447 -2.052899437259529 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832458_0.png resize: (140, 302) 1353255448 -2.150393726767986 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832461_0.png resize: (126, 82) 1353255449 -1.3351383445301654 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832448_0.png resize: (306, 276) 1353255450 -2.38301305133848 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832445_0.png resize: (132, 95) 1353255451 -1.465517325271107 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832462_0.png resize: (111, 83) 1353255452 -1.2728786868778654 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832455_0.png resize: (113, 196) 1353255453 -2.380980744817059 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832439_0.png resize: (102, 166) 1353255454 -2.6998575931166373 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832440_0.png resize: (142, 142) 1353255455 -2.3450658932766775 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832456_0.png resize: (179, 223) 1353255456 -2.3061712384902164 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832443_0.png resize: (118, 63) 1353255457 -0.0025198668294469247 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832468_0.png resize: (159, 195) 1353255458 -2.068011035293127 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832484_0.png resize: (155, 119) 1353255459 -1.394245004127164 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832472_0.png resize: (247, 95) 1353255460 -2.3167894641805646 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832473_0.png resize: (143, 181) 1353255461 -0.11441401362400772 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832487_0.png resize: (121, 202) 1353255462 -1.3569195776199414 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832480_0.png resize: (179, 234) 1353255463 -1.1382940912854302 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832479_0.png resize: (353, 279) 1353255464 -1.8341861341570584 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832476_0.png resize: (116, 185) 1353255465 -2.0291011779221892 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832466_0.png resize: (206, 249) 1353255466 -1.6204910931892322 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832471_0.png resize: (309, 582) 1353255467 -1.497881933905543 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832483_0.png resize: (191, 118) 1353255468 -2.7512110668920307 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832470_0.png resize: (161, 176) 1353255469 -1.4466120633998865 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832482_0.png resize: (139, 65) 1353255470 0.8803486470881948 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832474_0.png resize: (193, 359) 1353255472 -1.2929800649836387 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832465_0.png resize: (215, 92) 1353255473 -0.12850645262882449 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832488_0.png resize: (209, 131) 1353255474 -2.250815913252925 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832516_0.png resize: (289, 386) 1353255475 -2.0076618543396045 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832505_0.png resize: (321, 362) 1353255476 -0.9462047039029539 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832489_0.png resize: (239, 206) 1353255477 -1.297038725570182 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832503_0.png resize: (177, 253) 1353255478 -1.2040990933905589 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832497_0.png resize: (131, 212) 1353255479 -1.5709936223672534 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832498_0.png resize: (134, 220) 1353255480 -1.0773720463239451 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832491_0.png resize: (419, 519) 1353255481 -2.6352544368274757 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832493_0.png resize: (82, 250) 1353255482 2.2238580012799853 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832513_0.png resize: (72, 160) 1353255483 -0.7925488536644337 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832490_0.png resize: (266, 319) 1353255484 -1.6341015308499791 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832509_0.png resize: (193, 90) 1353255485 -2.7988598979050097 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832512_0.png resize: (117, 66) 1353255486 0.9321255693344124 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832508_0.png resize: (186, 119) 1353255487 -2.5859120988886057 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832506_0.png resize: (369, 258) 1353255488 -1.8787191916218593 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832510_0.png resize: (141, 192) 1353255489 -0.14213887497807481 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832502_0.png resize: (76, 101) 1353255490 0.23830822320694364 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832495_0.png resize: (158, 92) 1353255491 -1.4105347008643276 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832504_0.png resize: (378, 412) 1353255492 -1.8926286635492764 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832515_0.png resize: (143, 93) 1353255494 -3.008784535782328 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832494_0.png resize: (199, 211) 1353255495 -2.117141571340442 treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832530_0.png resize: (420, 568) 1353255496 0.34459920717393094 treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832529_0.png resize: (88, 142) 1353255497 -1.3674739455641336 treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832519_0.png resize: (155, 105) 1353255498 -1.5718320870778135 treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832520_0.png resize: (237, 217) 1353255499 -2.6047049417800774 treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832518_0.png resize: (425, 231) 1353255500 -0.8588482506713312 treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832524_0.png resize: (195, 241) 1353255501 -0.7463975716874609 treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832525_0.png resize: (146, 230) 1353255502 -1.3420101781188938 treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832522_0.png resize: (223, 156) 1353255503 -2.156757066127055 treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832523_0.png resize: (310, 281) 1353255504 -0.7360737208761328 treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832531_0.png resize: (163, 130) 1353255505 -2.369839767338464 treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832517_0.png resize: (191, 152) 1353255506 -1.9721294649588161 treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832527_0.png resize: (129, 85) 1353255507 -0.06554806232250414 treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832521_0.png resize: (169, 249) 1353255508 -1.6870771798786244 treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832528_0.png resize: (344, 169) 1353255509 -2.7107279585362436 treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832543_0.png resize: (106, 105) 1353255510 -0.7260405938103797 treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832534_0.png resize: (897, 495) 1353255511 0.1411037556822144 treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832541_0.png resize: (145, 244) 1353255512 -1.250275566848005 treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832540_0.png resize: (371, 252) 1353255513 -0.9369402350769014 treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832533_0.png resize: (177, 297) 1353255514 -0.8429821896255246 treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832358_0.png resize: (345, 270) 1353255527 -2.6042469858982535 treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832369_0.png resize: (232, 273) 1353255528 -2.58991371174109 treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832394_0.png resize: (637, 279) 1353255529 -1.2439741841781475 treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832388_0.png resize: (121, 140) 1353255530 -1.3527074464067752 treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832379_0.png resize: (199, 228) 1353255531 -1.5051400664128924 treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832430_0.png resize: (123, 237) 1353255532 -1.1786301056984752 treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832427_0.png resize: (216, 150) 1353255533 -1.5402043757157835 treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832415_0.png resize: (133, 133) 1353255534 -0.477499159622962 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832478_0.png resize: (217, 216) 1353255535 -1.9759812974850328 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832463_0.png resize: (174, 177) 1353255536 -1.1980223489632402 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832475_0.png resize: (198, 127) 1353255537 -1.0790079018297678 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832485_0.png resize: (145, 404) 1353255538 -2.4614623543403678 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832467_0.png resize: (179, 146) 1353255539 -1.8633607787275832 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832486_0.png resize: (124, 135) 1353255540 -1.0537028069709402 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832500_0.png resize: (244, 310) 1353255541 -2.5863828757327694 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832499_0.png resize: (221, 128) 1353255542 -2.0552884965037457 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832496_0.png resize: (143, 264) 1353255543 -1.268384250494149 treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832537_0.png resize: (598, 985) 1353255544 -0.4766112716062331 treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832532_0.png resize: (811, 557) 1353255545 -0.6720258588369715 treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832538_0.png resize: (347, 774) 1353255546 -0.527653928333438 treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832542_0.png resize: (221, 406) 1353255547 -0.5690231998026911 treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832374_0.png resize: (170, 152) 1353255549 -3.3878170632945843 treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832365_0.png resize: (173, 268) 1353255570 -3.499895767162067 treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832367_0.png resize: (841, 341) 1353255571 -1.7661405680586344 treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832372_0.png resize: (204, 180) 1353255572 -2.2758950517629795 treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832368_0.png resize: (188, 124) 1353255573 -1.7198429828666955 treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832371_0.png resize: (142, 127) 1353255574 -1.4235098472300078 treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832373_0.png resize: (140, 236) 1353255575 -2.622518172708337 treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832392_0.png resize: (258, 265) 1353255576 -4.101450271360406 treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832386_0.png resize: (336, 434) 1353255577 -1.1629841311731106 treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832389_0.png resize: (191, 443) 1353255578 -1.4094155312042258 treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832395_0.png resize: (570, 351) 1353255579 -1.0682666400237848 treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832384_0.png resize: (625, 546) 1353255580 -1.771081382544182 treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832380_0.png resize: (211, 335) 1353255581 -3.4528053933300713 treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832390_0.png resize: (378, 287) 1353255582 -1.3347817228897219 treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832406_0.png resize: (168, 405) 1353255583 -1.5711336793724766 treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832413_0.png resize: (154, 260) 1353255584 -3.5330375787004393 treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832396_0.png resize: (381, 292) 1353255585 -3.0145309979582424 treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832397_0.png resize: (324, 570) 1353255586 -3.133849435881986 treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832398_0.png resize: (264, 756) 1353255587 -0.7822870056095093 treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832407_0.png resize: (326, 282) 1353255588 -1.6073567850842956 treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832432_0.png resize: (273, 245) 1353255589 -1.8711196902234066 treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832417_0.png resize: (180, 333) 1353255590 -1.9322289453103498 treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832426_0.png resize: (213, 544) 1353255591 -0.5971293181194357 treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832424_0.png resize: (245, 210) 1353255592 -3.273394313939345 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832446_0.png resize: (347, 353) 1353255593 -3.2787387647331734 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832451_0.png resize: (169, 139) 1353255594 -3.71023835936386 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832450_0.png resize: (186, 315) 1353255596 -2.4141910544154346 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832464_0.png resize: (141, 208) 1353255597 -3.0286207967241534 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832477_0.png resize: (126, 152) 1353255598 -2.179957064246613 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832469_0.png resize: (171, 333) 1353255599 -1.5016884955772236 treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832481_0.png resize: (125, 116) 1353255600 -1.0540147785396456 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832492_0.png resize: (532, 333) 1353255601 -1.7017683466942188 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832511_0.png resize: (175, 232) 1353255602 -0.4675323920387657 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832514_0.png resize: (265, 400) 1353255603 -3.6851746486263632 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832501_0.png resize: (111, 234) 1353255604 -1.2053801897280392 treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832507_0.png resize: (182, 163) 1353255605 -2.635235415071023 treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832536_0.png resize: (172, 597) 1353255606 -1.9204231676076737 treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832535_0.png resize: (167, 456) 1353255607 -2.1517086501400686 treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832431_0.png resize: (146, 86) 1353255623 1.8299818741842242 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832454_0.png resize: (324, 150) 1353255624 -1.225584054071533 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832453_0.png resize: (160, 139) 1353255625 -0.36488636596063223 treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832526_0.png resize: (131, 113) 1353255626 -0.41599964195357414 treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832539_0.png resize: (265, 178) 1353255627 -0.8466774705616809 treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832457_0.png resize: (300, 276) 1353255633 -3.6677764212194846 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 195 time used for this insertion : 0.020138025283813477 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 195 time used for this insertion : 0.03227519989013672 save missing photos in datou_result : time spend for datou_step_exec : 38.634177923202515 time spend to save output : 0.05828213691711426 total time spend for step 6 : 38.69246006011963 step7:brightness Thu Apr 24 04:16:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e.jpg treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def.jpg treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720.jpg treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999.jpg treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb.jpg treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6.jpg treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1.jpg treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495.jpg treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8.jpg treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832363_0.png treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832378_0.png treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832375_0.png treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832360_0.png treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832376_0.png treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832366_0.png treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832364_0.png treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832359_0.png treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832370_0.png treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832361_0.png treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832377_0.png treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832362_0.png treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832387_0.png treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832383_0.png treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832385_0.png treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832393_0.png treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832381_0.png treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832391_0.png treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832382_0.png treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832411_0.png treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832404_0.png treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832405_0.png treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832401_0.png treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832410_0.png treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832403_0.png treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832409_0.png treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832408_0.png treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832399_0.png treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832402_0.png treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832412_0.png treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832400_0.png treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832425_0.png treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832421_0.png treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832420_0.png treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832434_0.png treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832423_0.png treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832433_0.png treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832416_0.png treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832428_0.png treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832429_0.png treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832418_0.png treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832422_0.png treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832414_0.png treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832419_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832437_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832452_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832441_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832449_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832436_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832459_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832435_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832442_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832438_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832444_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832447_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832460_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832458_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832461_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832448_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832445_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832462_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832455_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832439_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832440_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832456_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832443_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832468_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832484_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832472_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832473_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832487_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832480_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832479_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832476_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832466_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832471_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832483_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832470_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832482_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832474_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832465_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832488_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832516_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832505_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832489_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832503_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832497_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832498_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832491_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832493_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832513_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832490_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832509_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832512_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832508_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832506_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832510_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832502_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832495_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832504_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832515_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832494_0.png treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832530_0.png treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832529_0.png treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832519_0.png treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832520_0.png treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832518_0.png treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832524_0.png treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832525_0.png treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832522_0.png treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832523_0.png treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832531_0.png treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832517_0.png treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832527_0.png treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832521_0.png treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832528_0.png treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832543_0.png treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832534_0.png treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832541_0.png treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832540_0.png treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832533_0.png treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832358_0.png treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832369_0.png treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832394_0.png treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832388_0.png treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832379_0.png treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832430_0.png treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832427_0.png treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832415_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832478_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832463_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832475_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832485_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832467_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832486_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832500_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832499_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832496_0.png treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832537_0.png treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832532_0.png treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832538_0.png treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832542_0.png treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832374_0.png treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832365_0.png treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832367_0.png treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832372_0.png treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832368_0.png treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832371_0.png treat image : temp/1745460627_1941155_1353161022_d440ca36daa4dc84a1ffd6f9263c294e_rle_crop_3766832373_0.png treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832392_0.png treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832386_0.png treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832389_0.png treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832395_0.png treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832384_0.png treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832380_0.png treat image : temp/1745460627_1941155_1353161018_3c6eb34ab37fa6c101f82ed6d51f8def_rle_crop_3766832390_0.png treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832406_0.png treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832413_0.png treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832396_0.png treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832397_0.png treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832398_0.png treat image : temp/1745460627_1941155_1353118550_92fede1a68578decd8229c29e9b22720_rle_crop_3766832407_0.png treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832432_0.png treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832417_0.png treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832426_0.png treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832424_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832446_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832451_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832450_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832464_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832477_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832469_0.png treat image : temp/1745460627_1941155_1353118411_9752599cbc73b49a473f7f406ab95ee6_rle_crop_3766832481_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832492_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832511_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832514_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832501_0.png treat image : temp/1745460627_1941155_1353118409_dd1de0ab1771478eb5cfe28e1331a6a1_rle_crop_3766832507_0.png treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832536_0.png treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832535_0.png treat image : temp/1745460627_1941155_1353118539_b36fd8fadd2c9e92615f14433be19999_rle_crop_3766832431_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832454_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832453_0.png treat image : temp/1745460627_1941155_1353118380_0a893571eb09e85470db088d69bd6495_rle_crop_3766832526_0.png treat image : temp/1745460627_1941155_1353118346_2a15490b16f5fc0d59317563953ebfa8_rle_crop_3766832539_0.png treat image : temp/1745460627_1941155_1353118414_721e1eca1199e80cc80c804e29fb99cb_rle_crop_3766832457_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 195 time used for this insertion : 0.02372598648071289 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 195 time used for this insertion : 0.03802800178527832 save missing photos in datou_result : time spend for datou_step_exec : 9.807435750961304 time spend to save output : 0.06766605377197266 total time spend for step 7 : 9.875101804733276 step8:velours_tree Thu Apr 24 04:16:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.486954927444458 time spend to save output : 5.698204040527344e-05 total time spend for step 8 : 1.4870119094848633 step9:send_mail_cod Thu Apr 24 04:16:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22366555_24-04-2025_04_16_38.pdf 22366633 imagette223666331745460998 22366634 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette223666341745460998 22366635 imagette223666351745460998 22366636 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette223666361745460998 22366637 imagette223666371745461007 22366638 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette223666381745461007 22366639 change filename to text .imagette223666391745461008 22366641 imagette223666411745461008 22366642 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette223666421745461008 22366643 change filename to text .imagette223666431745461010 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22366555 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22366633,22366634,22366635,22366636,22366637,22366638,22366639,22366640,22366641,22366642,22366643?tags=mal_croppe,autre,flou,carton,pet_fonce,papier,pehd,environnement,background,pet_clair,metal args[1353161022] : ((1353161022, -3.2419400488593224, 492609224), (1353161022, 0.0817809716073914, 2107752395), '0.12046302285060113') We are sending mail with results at report@fotonower.com args[1353161018] : ((1353161018, -1.4197795078749187, 492688767), (1353161018, 0.18945827367394613, 2107752395), '0.12046302285060113') We are sending mail with results at report@fotonower.com args[1353118550] : ((1353118550, -3.4092841144610007, 492609224), (1353118550, 0.23943607674380146, 2107752395), '0.12046302285060113') We are sending mail with results at report@fotonower.com args[1353118539] : ((1353118539, 0.6366030643413826, 492688767), (1353118539, -0.37752639759231943, 496442774), '0.12046302285060113') We are sending mail with results at report@fotonower.com args[1353118414] : ((1353118414, -4.122408560183707, 492609224), (1353118414, 0.1160079812650825, 2107752395), '0.12046302285060113') We are sending mail with results at report@fotonower.com args[1353118411] : ((1353118411, -2.7238494422673085, 492609224), (1353118411, 0.17208252323527573, 2107752395), '0.12046302285060113') We are sending mail with results at report@fotonower.com args[1353118409] : ((1353118409, -3.459142741799071, 492609224), (1353118409, 0.29840308179194197, 2107752395), '0.12046302285060113') We are sending mail with results at report@fotonower.com args[1353118380] : ((1353118380, -2.9157884819994804, 492609224), (1353118380, 0.03350977774674752, 2107752395), '0.12046302285060113') We are sending mail with results at report@fotonower.com args[1353118346] : ((1353118346, -1.4376181214293726, 492688767), (1353118346, -0.19685431194839478, 496442774), '0.12046302285060113') We are sending mail with results at report@fotonower.com refus_total : 0.12046302285060113 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22366555 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22366555_24-04-2025_04_16_38.pdf results_Auto_P22366555_24-04-2025_04_16_38.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22366555_24-04-2025_04_16_38.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22366555','results_Auto_P22366555_24-04-2025_04_16_38.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22366555_24-04-2025_04_16_38.pdf','pdf','','0.72','0.12046302285060113') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22366555

https://www.fotonower.com/image?json=false&list_photos_id=1353161022
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353161018
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353118550
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353118539
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353118414
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353118411
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353118409
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353118380
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353118346
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 12.05%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/22366634?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22366636?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22366638?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/22366639?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22366642?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/22366643?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22366555_24-04-2025_04_16_38.pdf.

Lien vers velours :https://www.fotonower.com/velours/22366633,22366634,22366635,22366636,22366637,22366638,22366639,22366640,22366641,22366642,22366643?tags=mal_croppe,autre,flou,carton,pet_fonce,papier,pehd,environnement,background,pet_clair,metal.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 24 Apr 2025 02:16:53 GMT Content-Length: 0 Connection: close X-Message-Id: Q6bEW2TIQwmPuFyhXSqmZg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1353161022, 1353161018, 1353118550, 1353118539, 1353118414, 1353118411, 1353118409, 1353118380, 1353118346] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353161022', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353161018', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118550', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118539', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118414', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118411', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118409', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118380', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118346', None, None, None, None, None, '2755503') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014303922653198242 save_final save missing photos in datou_result : time spend for datou_step_exec : 14.594481468200684 time spend to save output : 0.01461172103881836 total time spend for step 9 : 14.609093189239502 step10:split_time_score Thu Apr 24 04:16:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 23042025 22366555 Nombre de photos uploadées : 11 / 23040 (0%) 23042025 22366555 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 23042025 22366555 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 4.291534423828125e-06 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0004398822784423828 elapsed_time : insert_dashboard_record_day_entry 0.024503707885742188 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22366519 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22366522 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22366526 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22366532 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22366545 order by id desc limit 1 Qualite : 0.3200109800491196 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22352034_23-04-2025_17_36_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22352034 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22352034 AND mptpi.`type`=3726 To do Qualite : 0.1556769131263616 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22352035_23-04-2025_17_41_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22352035 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22352035 AND mptpi.`type`=3594 To do Qualite : 0.1991258217214356 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22358079_23-04-2025_20_30_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22358079 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22358079 AND mptpi.`type`=3594 To do Qualite : 0.1164668720497458 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22353122_23-04-2025_18_16_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22353122 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22353122 AND mptpi.`type`=3594 To do Qualite : 0.04576437746737057 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22366552_24-04-2025_04_14_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22366552 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22366552 AND mptpi.`type`=3726 To do Qualite : 0.12046302285060113 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22366555_24-04-2025_04_16_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22366555 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22366555 AND mptpi.`type`=3594 To do Qualite : 0.14075071000622477 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22359946_23-04-2025_22_22_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22359946 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22359946 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'23042025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1353161022, 1353161018, 1353118550, 1353118539, 1353118414, 1353118411, 1353118409, 1353118380, 1353118346] Looping around the photos to save general results len do output : 1 /22366555Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353161022', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353161018', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118550', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118539', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118414', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118411', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118409', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118380', None, None, None, None, None, '2755503') ('3318', None, None, None, None, None, None, None, '2755503') ('3318', '22366555', '1353118346', None, None, None, None, None, '2755503') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.013048171997070312 save_final save missing photos in datou_result : begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.010907888412475586 time spend for datou_step_exec : 4.8048601150512695 time spend to save output : 0.02429032325744629 total time spend for step 10 : 4.829150438308716 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 154.89user 129.73system 6:33.56elapsed 72%CPU (0avgtext+0avgdata 5596720maxresident)k 1019184inputs+92336outputs (20462major+16103084minor)pagefaults 0swaps