python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2420083 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't see2025-05-27 01:50:32.258058: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-27 01:50:32.283100: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-27 01:50:32.284779: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fdb8c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-27 01:50:32.284808: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-27 01:50:32.287932: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-27 01:50:32.428613: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x42cc38a0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-27 01:50:32.428653: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-27 01:50:32.429344: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 01:50:32.429634: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 01:50:32.431679: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 01:50:32.433942: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 01:50:32.434263: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 01:50:32.436475: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 01:50:32.437479: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 01:50:32.441666: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 01:50:32.442693: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 01:50:32.442765: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 01:50:32.443325: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-27 01:50:32.443342: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-27 01:50:32.443352: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-27 01:50:32.444271: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2581 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-27 01:50:32.747686: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 01:50:32.747781: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 01:50:32.747801: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 01:50:32.747820: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 01:50:32.747837: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 01:50:32.747854: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 01:50:32.747870: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 01:50:32.747887: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 01:50:32.748707: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 01:50:32.749612: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 01:50:32.749647: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 01:50:32.749663: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 01:50:32.749676: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 01:50:32.749695: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 01:50:32.749717: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 01:50:32.749736: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 01:50:32.749756: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 01:50:32.750761: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 01:50:32.750806: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-27 01:50:32.750819: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-27 01:50:32.750829: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-27 01:50:32.751764: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2581 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-27 01:50:42.149456: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 01:50:42.337055: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 01:50:43.664547: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 01:50:43.664610: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 01:50:43.671038: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 01:50:43.671061: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 01:50:43.724840: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 01:50:43.724907: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 01:50:43.767295: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 01:50:43.767338: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 01:50:43.818321: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 01:50:43.818358: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 01:50:43.820454: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.52G (1634598912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:43.820996: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.37G (1471139072 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.149292: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-05-27 01:50:44.192663: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.193526: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.194612: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.195332: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.206134: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.206892: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.207663: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.208363: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.209025: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.209681: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.225899: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.226594: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.299759: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.300490: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.321716: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.322440: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.323097: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.323743: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.328097: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.328765: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.329375: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.329989: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.331574: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.331597: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-05-27 01:50:44.341539: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.342214: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.351622: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.352295: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.352951: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.353585: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.354263: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 01:50:44.354947: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 53 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 21 Detection mask done ! Trying to reset tf kernel 2420943 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 647 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3033 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00034427642822265625 nb_pixel_total : 7744 time to create 1 rle with old method : 0.012018203735351562 length of segment : 71 time for calcul the mask position with numpy : 0.0012080669403076172 nb_pixel_total : 33208 time to create 1 rle with old method : 0.04590868949890137 length of segment : 208 time for calcul the mask position with numpy : 0.005560636520385742 nb_pixel_total : 163983 time to create 1 rle with new method : 0.013380289077758789 length of segment : 714 time for calcul the mask position with numpy : 0.0006279945373535156 nb_pixel_total : 21995 time to create 1 rle with old method : 0.025127887725830078 length of segment : 194 time for calcul the mask position with numpy : 0.00035881996154785156 nb_pixel_total : 8452 time to create 1 rle with old method : 0.016660213470458984 length of segment : 97 time for calcul the mask position with numpy : 0.00038051605224609375 nb_pixel_total : 10643 time to create 1 rle with old method : 0.020227432250976562 length of segment : 113 time for calcul the mask position with numpy : 0.0017385482788085938 nb_pixel_total : 60254 time to create 1 rle with old method : 0.10567498207092285 length of segment : 357 time for calcul the mask position with numpy : 0.0006272792816162109 nb_pixel_total : 30210 time to create 1 rle with old method : 0.03481626510620117 length of segment : 218 time for calcul the mask position with numpy : 0.0017282962799072266 nb_pixel_total : 83528 time to create 1 rle with old method : 0.09322214126586914 length of segment : 609 time for calcul the mask position with numpy : 0.0003409385681152344 nb_pixel_total : 11206 time to create 1 rle with old method : 0.012988805770874023 length of segment : 153 time for calcul the mask position with numpy : 0.0004470348358154297 nb_pixel_total : 16463 time to create 1 rle with old method : 0.01917576789855957 length of segment : 288 time for calcul the mask position with numpy : 0.0006124973297119141 nb_pixel_total : 26476 time to create 1 rle with old method : 0.030530929565429688 length of segment : 248 time for calcul the mask position with numpy : 0.0013403892517089844 nb_pixel_total : 51212 time to create 1 rle with old method : 0.05955362319946289 length of segment : 247 time for calcul the mask position with numpy : 0.00026416778564453125 nb_pixel_total : 10583 time to create 1 rle with old method : 0.012794971466064453 length of segment : 87 time for calcul the mask position with numpy : 0.0005650520324707031 nb_pixel_total : 18714 time to create 1 rle with old method : 0.022350788116455078 length of segment : 148 time for calcul the mask position with numpy : 0.0009613037109375 nb_pixel_total : 52252 time to create 1 rle with old method : 0.059285879135131836 length of segment : 304 time for calcul the mask position with numpy : 0.0009720325469970703 nb_pixel_total : 45442 time to create 1 rle with old method : 0.05226755142211914 length of segment : 218 time for calcul the mask position with numpy : 0.000553131103515625 nb_pixel_total : 31115 time to create 1 rle with old method : 0.035172462463378906 length of segment : 172 time for calcul the mask position with numpy : 0.0006101131439208984 nb_pixel_total : 18922 time to create 1 rle with old method : 0.021450281143188477 length of segment : 321 time for calcul the mask position with numpy : 0.0003104209899902344 nb_pixel_total : 17221 time to create 1 rle with old method : 0.019178152084350586 length of segment : 201 time for calcul the mask position with numpy : 0.0011265277862548828 nb_pixel_total : 46410 time to create 1 rle with old method : 0.05134415626525879 length of segment : 353 time for calcul the mask position with numpy : 0.001333475112915039 nb_pixel_total : 69994 time to create 1 rle with old method : 0.07653141021728516 length of segment : 350 time for calcul the mask position with numpy : 0.00046181678771972656 nb_pixel_total : 18501 time to create 1 rle with old method : 0.021430253982543945 length of segment : 190 time for calcul the mask position with numpy : 0.0017058849334716797 nb_pixel_total : 92173 time to create 1 rle with old method : 0.10145139694213867 length of segment : 455 time for calcul the mask position with numpy : 0.0006341934204101562 nb_pixel_total : 31669 time to create 1 rle with old method : 0.03585338592529297 length of segment : 222 time for calcul the mask position with numpy : 0.001169443130493164 nb_pixel_total : 56499 time to create 1 rle with old method : 0.0630338191986084 length of segment : 421 time for calcul the mask position with numpy : 0.0045316219329833984 nb_pixel_total : 202465 time to create 1 rle with new method : 0.011659383773803711 length of segment : 494 time for calcul the mask position with numpy : 0.0005702972412109375 nb_pixel_total : 31389 time to create 1 rle with old method : 0.036096811294555664 length of segment : 136 time for calcul the mask position with numpy : 0.001428842544555664 nb_pixel_total : 80636 time to create 1 rle with old method : 0.08717751502990723 length of segment : 357 time for calcul the mask position with numpy : 0.0020494461059570312 nb_pixel_total : 95021 time to create 1 rle with old method : 0.1036994457244873 length of segment : 573 time for calcul the mask position with numpy : 0.0008990764617919922 nb_pixel_total : 65419 time to create 1 rle with old method : 0.07245373725891113 length of segment : 473 time for calcul the mask position with numpy : 0.0002827644348144531 nb_pixel_total : 14436 time to create 1 rle with old method : 0.01624751091003418 length of segment : 123 time for calcul the mask position with numpy : 0.001399993896484375 nb_pixel_total : 79974 time to create 1 rle with old method : 0.0873556137084961 length of segment : 440 time for calcul the mask position with numpy : 0.0023031234741210938 nb_pixel_total : 105651 time to create 1 rle with old method : 0.1112205982208252 length of segment : 483 time for calcul the mask position with numpy : 0.0024614334106445312 nb_pixel_total : 92568 time to create 1 rle with old method : 0.10048723220825195 length of segment : 362 time for calcul the mask position with numpy : 0.0004277229309082031 nb_pixel_total : 20912 time to create 1 rle with old method : 0.022764921188354492 length of segment : 177 time for calcul the mask position with numpy : 0.002159595489501953 nb_pixel_total : 100344 time to create 1 rle with old method : 0.1089024543762207 length of segment : 647 time for calcul the mask position with numpy : 0.0009071826934814453 nb_pixel_total : 43556 time to create 1 rle with old method : 0.048818111419677734 length of segment : 351 time for calcul the mask position with numpy : 0.0007927417755126953 nb_pixel_total : 43896 time to create 1 rle with old method : 0.052771806716918945 length of segment : 207 time for calcul the mask position with numpy : 0.0023577213287353516 nb_pixel_total : 107677 time to create 1 rle with old method : 0.11674761772155762 length of segment : 280 time for calcul the mask position with numpy : 0.044486284255981445 nb_pixel_total : 704418 time to create 1 rle with new method : 0.4047513008117676 length of segment : 932 time for calcul the mask position with numpy : 0.002310037612915039 nb_pixel_total : 144662 time to create 1 rle with old method : 0.15374183654785156 length of segment : 565 time for calcul the mask position with numpy : 0.00027441978454589844 nb_pixel_total : 13648 time to create 1 rle with old method : 0.014505386352539062 length of segment : 199 time for calcul the mask position with numpy : 0.0004520416259765625 nb_pixel_total : 27951 time to create 1 rle with old method : 0.030244112014770508 length of segment : 267 time for calcul the mask position with numpy : 0.0010454654693603516 nb_pixel_total : 60256 time to create 1 rle with old method : 0.06498289108276367 length of segment : 378 time for calcul the mask position with numpy : 0.00023412704467773438 nb_pixel_total : 14452 time to create 1 rle with old method : 0.019409894943237305 length of segment : 153 time for calcul the mask position with numpy : 0.0009562969207763672 nb_pixel_total : 26655 time to create 1 rle with old method : 0.028566837310791016 length of segment : 283 time for calcul the mask position with numpy : 0.0010595321655273438 nb_pixel_total : 39820 time to create 1 rle with old method : 0.04757213592529297 length of segment : 245 time for calcul the mask position with numpy : 0.0052983760833740234 nb_pixel_total : 172546 time to create 1 rle with new method : 0.007222890853881836 length of segment : 301 time for calcul the mask position with numpy : 0.002152681350708008 nb_pixel_total : 80117 time to create 1 rle with old method : 0.08419203758239746 length of segment : 322 time for calcul the mask position with numpy : 0.00414276123046875 nb_pixel_total : 196629 time to create 1 rle with new method : 0.006335258483886719 length of segment : 517 time for calcul the mask position with numpy : 0.006682872772216797 nb_pixel_total : 195088 time to create 1 rle with new method : 0.01092076301574707 length of segment : 1174 time for calcul the mask position with numpy : 0.0008091926574707031 nb_pixel_total : 26817 time to create 1 rle with old method : 0.029467105865478516 length of segment : 273 time for calcul the mask position with numpy : 0.000843048095703125 nb_pixel_total : 34410 time to create 1 rle with old method : 0.037631988525390625 length of segment : 260 time for calcul the mask position with numpy : 0.0015568733215332031 nb_pixel_total : 38731 time to create 1 rle with old method : 0.04069352149963379 length of segment : 368 time for calcul the mask position with numpy : 0.0010640621185302734 nb_pixel_total : 23320 time to create 1 rle with old method : 0.02535223960876465 length of segment : 284 time for calcul the mask position with numpy : 0.0014209747314453125 nb_pixel_total : 35635 time to create 1 rle with old method : 0.03912925720214844 length of segment : 226 time for calcul the mask position with numpy : 0.0006952285766601562 nb_pixel_total : 12864 time to create 1 rle with old method : 0.014860391616821289 length of segment : 119 time for calcul the mask position with numpy : 0.0008940696716308594 nb_pixel_total : 18334 time to create 1 rle with old method : 0.020907878875732422 length of segment : 153 time for calcul the mask position with numpy : 0.0005116462707519531 nb_pixel_total : 15302 time to create 1 rle with old method : 0.01710653305053711 length of segment : 192 time for calcul the mask position with numpy : 0.0006489753723144531 nb_pixel_total : 18768 time to create 1 rle with old method : 0.02158975601196289 length of segment : 180 time for calcul the mask position with numpy : 0.000278472900390625 nb_pixel_total : 6800 time to create 1 rle with old method : 0.007792234420776367 length of segment : 81 time for calcul the mask position with numpy : 0.0009379386901855469 nb_pixel_total : 22797 time to create 1 rle with old method : 0.025510787963867188 length of segment : 236 time for calcul the mask position with numpy : 0.0006909370422363281 nb_pixel_total : 10201 time to create 1 rle with old method : 0.011858224868774414 length of segment : 196 time for calcul the mask position with numpy : 0.0017037391662597656 nb_pixel_total : 39179 time to create 1 rle with old method : 0.044046640396118164 length of segment : 234 time for calcul the mask position with numpy : 0.0013165473937988281 nb_pixel_total : 32301 time to create 1 rle with old method : 0.034688472747802734 length of segment : 235 time for calcul the mask position with numpy : 0.0011360645294189453 nb_pixel_total : 30373 time to create 1 rle with old method : 0.03204536437988281 length of segment : 320 time for calcul the mask position with numpy : 0.004466533660888672 nb_pixel_total : 121515 time to create 1 rle with old method : 0.13091135025024414 length of segment : 533 time for calcul the mask position with numpy : 0.0011188983917236328 nb_pixel_total : 29121 time to create 1 rle with old method : 0.03342318534851074 length of segment : 229 time for calcul the mask position with numpy : 0.0008251667022705078 nb_pixel_total : 10800 time to create 1 rle with old method : 0.012218952178955078 length of segment : 276 time for calcul the mask position with numpy : 0.0008130073547363281 nb_pixel_total : 21714 time to create 1 rle with old method : 0.024308443069458008 length of segment : 219 time for calcul the mask position with numpy : 0.0009477138519287109 nb_pixel_total : 24844 time to create 1 rle with old method : 0.027863740921020508 length of segment : 211 time for calcul the mask position with numpy : 0.0006842613220214844 nb_pixel_total : 25057 time to create 1 rle with old method : 0.027914762496948242 length of segment : 183 time for calcul the mask position with numpy : 0.0009677410125732422 nb_pixel_total : 27374 time to create 1 rle with old method : 0.03202414512634277 length of segment : 192 time for calcul the mask position with numpy : 0.0006124973297119141 nb_pixel_total : 18363 time to create 1 rle with old method : 0.024957656860351562 length of segment : 131 time for calcul the mask position with numpy : 0.0003056526184082031 nb_pixel_total : 9339 time to create 1 rle with old method : 0.01109457015991211 length of segment : 85 time for calcul the mask position with numpy : 0.0017702579498291016 nb_pixel_total : 51266 time to create 1 rle with old method : 0.05540728569030762 length of segment : 552 time for calcul the mask position with numpy : 0.001837015151977539 nb_pixel_total : 54760 time to create 1 rle with old method : 0.0591120719909668 length of segment : 387 time for calcul the mask position with numpy : 0.0014624595642089844 nb_pixel_total : 43485 time to create 1 rle with old method : 0.04704475402832031 length of segment : 270 time for calcul the mask position with numpy : 0.0009014606475830078 nb_pixel_total : 21699 time to create 1 rle with old method : 0.023424386978149414 length of segment : 173 time for calcul the mask position with numpy : 0.0005552768707275391 nb_pixel_total : 21041 time to create 1 rle with old method : 0.02199268341064453 length of segment : 148 time for calcul the mask position with numpy : 0.0005681514739990234 nb_pixel_total : 19488 time to create 1 rle with old method : 0.021747589111328125 length of segment : 169 time for calcul the mask position with numpy : 0.000804901123046875 nb_pixel_total : 32197 time to create 1 rle with old method : 0.03467273712158203 length of segment : 183 time for calcul the mask position with numpy : 0.0010406970977783203 nb_pixel_total : 45291 time to create 1 rle with old method : 0.04833102226257324 length of segment : 247 time for calcul the mask position with numpy : 0.0008928775787353516 nb_pixel_total : 15014 time to create 1 rle with old method : 0.016309022903442383 length of segment : 212 time for calcul the mask position with numpy : 0.0047876834869384766 nb_pixel_total : 146734 time to create 1 rle with old method : 0.15604424476623535 length of segment : 352 time for calcul the mask position with numpy : 0.0005805492401123047 nb_pixel_total : 9943 time to create 1 rle with old method : 0.010632753372192383 length of segment : 135 time for calcul the mask position with numpy : 0.002507448196411133 nb_pixel_total : 68388 time to create 1 rle with old method : 0.07090878486633301 length of segment : 446 time for calcul the mask position with numpy : 0.0006239414215087891 nb_pixel_total : 16740 time to create 1 rle with old method : 0.01787853240966797 length of segment : 187 time for calcul the mask position with numpy : 0.0006694793701171875 nb_pixel_total : 17950 time to create 1 rle with old method : 0.0191190242767334 length of segment : 162 time for calcul the mask position with numpy : 0.0017406940460205078 nb_pixel_total : 62127 time to create 1 rle with old method : 0.06511688232421875 length of segment : 361 time for calcul the mask position with numpy : 0.0010828971862792969 nb_pixel_total : 24943 time to create 1 rle with old method : 0.027273893356323242 length of segment : 352 time for calcul the mask position with numpy : 0.001283407211303711 nb_pixel_total : 30061 time to create 1 rle with old method : 0.03198981285095215 length of segment : 255 time for calcul the mask position with numpy : 0.0009772777557373047 nb_pixel_total : 22651 time to create 1 rle with old method : 0.02473902702331543 length of segment : 171 time for calcul the mask position with numpy : 0.0013284683227539062 nb_pixel_total : 40210 time to create 1 rle with old method : 0.04354572296142578 length of segment : 241 time for calcul the mask position with numpy : 0.0005543231964111328 nb_pixel_total : 12922 time to create 1 rle with old method : 0.014160633087158203 length of segment : 164 time for calcul the mask position with numpy : 0.00036835670471191406 nb_pixel_total : 8435 time to create 1 rle with old method : 0.009437322616577148 length of segment : 138 time for calcul the mask position with numpy : 0.0011975765228271484 nb_pixel_total : 36445 time to create 1 rle with old method : 0.039070844650268555 length of segment : 302 time for calcul the mask position with numpy : 0.00036454200744628906 nb_pixel_total : 6948 time to create 1 rle with old method : 0.007756233215332031 length of segment : 106 time for calcul the mask position with numpy : 0.0009665489196777344 nb_pixel_total : 24968 time to create 1 rle with old method : 0.02651071548461914 length of segment : 211 time for calcul the mask position with numpy : 0.0007910728454589844 nb_pixel_total : 13066 time to create 1 rle with old method : 0.014049291610717773 length of segment : 168 time for calcul the mask position with numpy : 0.0004718303680419922 nb_pixel_total : 13966 time to create 1 rle with old method : 0.015354633331298828 length of segment : 136 time for calcul the mask position with numpy : 0.00026488304138183594 nb_pixel_total : 5031 time to create 1 rle with old method : 0.0055255889892578125 length of segment : 86 time for calcul the mask position with numpy : 0.0006282329559326172 nb_pixel_total : 17452 time to create 1 rle with old method : 0.019071102142333984 length of segment : 177 time for calcul the mask position with numpy : 0.000308990478515625 nb_pixel_total : 7003 time to create 1 rle with old method : 0.007988452911376953 length of segment : 89 time for calcul the mask position with numpy : 0.0015263557434082031 nb_pixel_total : 43316 time to create 1 rle with old method : 0.04853081703186035 length of segment : 255 time for calcul the mask position with numpy : 0.0002677440643310547 nb_pixel_total : 6259 time to create 1 rle with old method : 0.0072841644287109375 length of segment : 77 time for calcul the mask position with numpy : 0.002424955368041992 nb_pixel_total : 71751 time to create 1 rle with old method : 0.08011174201965332 length of segment : 524 time for calcul the mask position with numpy : 0.0005047321319580078 nb_pixel_total : 14321 time to create 1 rle with old method : 0.015317916870117188 length of segment : 141 time for calcul the mask position with numpy : 0.0006582736968994141 nb_pixel_total : 19588 time to create 1 rle with old method : 0.021523475646972656 length of segment : 185 time for calcul the mask position with numpy : 0.0005276203155517578 nb_pixel_total : 11766 time to create 1 rle with old method : 0.013133764266967773 length of segment : 217 time for calcul the mask position with numpy : 0.002349853515625 nb_pixel_total : 67359 time to create 1 rle with old method : 0.07368898391723633 length of segment : 284 time for calcul the mask position with numpy : 0.0007836818695068359 nb_pixel_total : 20255 time to create 1 rle with old method : 0.021381616592407227 length of segment : 175 time for calcul the mask position with numpy : 0.0017876625061035156 nb_pixel_total : 56906 time to create 1 rle with old method : 0.06034588813781738 length of segment : 341 time for calcul the mask position with numpy : 0.00035762786865234375 nb_pixel_total : 7822 time to create 1 rle with old method : 0.008792638778686523 length of segment : 111 time for calcul the mask position with numpy : 0.001379251480102539 nb_pixel_total : 32762 time to create 1 rle with old method : 0.036362409591674805 length of segment : 224 time for calcul the mask position with numpy : 0.0006101131439208984 nb_pixel_total : 14464 time to create 1 rle with old method : 0.016906023025512695 length of segment : 190 time for calcul the mask position with numpy : 0.0008549690246582031 nb_pixel_total : 26098 time to create 1 rle with old method : 0.02962970733642578 length of segment : 142 time for calcul the mask position with numpy : 0.00035762786865234375 nb_pixel_total : 16502 time to create 1 rle with old method : 0.018622636795043945 length of segment : 142 time for calcul the mask position with numpy : 0.0006291866302490234 nb_pixel_total : 16127 time to create 1 rle with old method : 0.0181272029876709 length of segment : 267 time for calcul the mask position with numpy : 0.0006473064422607422 nb_pixel_total : 22178 time to create 1 rle with old method : 0.024538278579711914 length of segment : 175 time for calcul the mask position with numpy : 0.0004215240478515625 nb_pixel_total : 8755 time to create 1 rle with old method : 0.009947061538696289 length of segment : 154 time for calcul the mask position with numpy : 0.0003066062927246094 nb_pixel_total : 5041 time to create 1 rle with old method : 0.005730628967285156 length of segment : 109 time for calcul the mask position with numpy : 0.0008466243743896484 nb_pixel_total : 14614 time to create 1 rle with old method : 0.016752004623413086 length of segment : 225 time for calcul the mask position with numpy : 0.000797271728515625 nb_pixel_total : 25127 time to create 1 rle with old method : 0.02816915512084961 length of segment : 197 time for calcul the mask position with numpy : 0.0019347667694091797 nb_pixel_total : 59228 time to create 1 rle with old method : 0.06388592720031738 length of segment : 327 time for calcul the mask position with numpy : 0.0024788379669189453 nb_pixel_total : 90056 time to create 1 rle with old method : 0.09715962409973145 length of segment : 218 time for calcul the mask position with numpy : 0.002839803695678711 nb_pixel_total : 95126 time to create 1 rle with old method : 0.10310864448547363 length of segment : 277 time for calcul the mask position with numpy : 0.0006871223449707031 nb_pixel_total : 18710 time to create 1 rle with old method : 0.02020859718322754 length of segment : 196 time for calcul the mask position with numpy : 0.02032947540283203 nb_pixel_total : 649813 time to create 1 rle with new method : 0.05813407897949219 length of segment : 952 time for calcul the mask position with numpy : 0.0011334419250488281 nb_pixel_total : 26248 time to create 1 rle with old method : 0.028839826583862305 length of segment : 255 time for calcul the mask position with numpy : 0.0033943653106689453 nb_pixel_total : 102345 time to create 1 rle with old method : 0.1159517765045166 length of segment : 419 time for calcul the mask position with numpy : 0.0005190372467041016 nb_pixel_total : 14338 time to create 1 rle with old method : 0.016065120697021484 length of segment : 270 time for calcul the mask position with numpy : 0.0009114742279052734 nb_pixel_total : 28006 time to create 1 rle with old method : 0.029653072357177734 length of segment : 230 time for calcul the mask position with numpy : 0.0018541812896728516 nb_pixel_total : 55109 time to create 1 rle with old method : 0.059783220291137695 length of segment : 255 time for calcul the mask position with numpy : 0.0004200935363769531 nb_pixel_total : 8676 time to create 1 rle with old method : 0.00943756103515625 length of segment : 117 time for calcul the mask position with numpy : 0.000667572021484375 nb_pixel_total : 30568 time to create 1 rle with old method : 0.032827138900756836 length of segment : 197 time for calcul the mask position with numpy : 0.0021562576293945312 nb_pixel_total : 83157 time to create 1 rle with old method : 0.09108233451843262 length of segment : 248 time for calcul the mask position with numpy : 0.0005192756652832031 nb_pixel_total : 13564 time to create 1 rle with old method : 0.01589059829711914 length of segment : 215 time for calcul the mask position with numpy : 0.0008199214935302734 nb_pixel_total : 20522 time to create 1 rle with old method : 0.023981332778930664 length of segment : 143 time for calcul the mask position with numpy : 0.00035834312438964844 nb_pixel_total : 7159 time to create 1 rle with old method : 0.008322715759277344 length of segment : 117 time for calcul the mask position with numpy : 0.0003218650817871094 nb_pixel_total : 9660 time to create 1 rle with old method : 0.010869026184082031 length of segment : 110 time for calcul the mask position with numpy : 0.0005433559417724609 nb_pixel_total : 16057 time to create 1 rle with old method : 0.01779341697692871 length of segment : 160 time for calcul the mask position with numpy : 0.0019049644470214844 nb_pixel_total : 42387 time to create 1 rle with old method : 0.045824289321899414 length of segment : 298 time for calcul the mask position with numpy : 0.0006406307220458984 nb_pixel_total : 22527 time to create 1 rle with old method : 0.024465084075927734 length of segment : 182 time for calcul the mask position with numpy : 0.0009522438049316406 nb_pixel_total : 31155 time to create 1 rle with old method : 0.03378129005432129 length of segment : 199 time for calcul the mask position with numpy : 0.0005719661712646484 nb_pixel_total : 23689 time to create 1 rle with old method : 0.02571892738342285 length of segment : 184 time for calcul the mask position with numpy : 0.0004506111145019531 nb_pixel_total : 11521 time to create 1 rle with old method : 0.012690305709838867 length of segment : 135 time for calcul the mask position with numpy : 0.00031280517578125 nb_pixel_total : 7189 time to create 1 rle with old method : 0.007962942123413086 length of segment : 108 time for calcul the mask position with numpy : 0.0007007122039794922 nb_pixel_total : 21106 time to create 1 rle with old method : 0.023118972778320312 length of segment : 165 time for calcul the mask position with numpy : 0.0004239082336425781 nb_pixel_total : 12301 time to create 1 rle with old method : 0.014052867889404297 length of segment : 136 time for calcul the mask position with numpy : 0.0018720626831054688 nb_pixel_total : 66742 time to create 1 rle with old method : 0.07217121124267578 length of segment : 383 time for calcul the mask position with numpy : 0.0006577968597412109 nb_pixel_total : 26113 time to create 1 rle with old method : 0.02892899513244629 length of segment : 175 time for calcul the mask position with numpy : 0.0013904571533203125 nb_pixel_total : 61855 time to create 1 rle with old method : 0.08721661567687988 length of segment : 415 time for calcul the mask position with numpy : 0.0003933906555175781 nb_pixel_total : 10049 time to create 1 rle with old method : 0.01092219352722168 length of segment : 130 time for calcul the mask position with numpy : 0.0021305084228515625 nb_pixel_total : 111173 time to create 1 rle with old method : 0.11563444137573242 length of segment : 286 time for calcul the mask position with numpy : 0.0022246837615966797 nb_pixel_total : 64994 time to create 1 rle with old method : 0.07126259803771973 length of segment : 282 time for calcul the mask position with numpy : 0.35100746154785156 nb_pixel_total : 1355262 time to create 1 rle with new method : 0.2459108829498291 length of segment : 3028 time for calcul the mask position with numpy : 0.0006549358367919922 nb_pixel_total : 38439 time to create 1 rle with old method : 0.041060447692871094 length of segment : 567 time for calcul the mask position with numpy : 0.0004673004150390625 nb_pixel_total : 14298 time to create 1 rle with old method : 0.01746964454650879 length of segment : 227 time for calcul the mask position with numpy : 0.0002243518829345703 nb_pixel_total : 11154 time to create 1 rle with old method : 0.012569427490234375 length of segment : 187 time for calcul the mask position with numpy : 0.0006182193756103516 nb_pixel_total : 23838 time to create 1 rle with old method : 0.0269925594329834 length of segment : 133 time for calcul the mask position with numpy : 0.0018131732940673828 nb_pixel_total : 39649 time to create 1 rle with old method : 0.045243263244628906 length of segment : 236 time spent for convertir_results : 13.509933471679688 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 163 chid ids of type : 3594 Number RLEs to save : 45691 save missing photos in datou_result : time spend for datou_step_exec : 69.14456152915955 time spend to save output : 357.0296449661255 total time spend for step 1 : 426.17420649528503 step2:crop_condition Tue May 27 01:57:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 163 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 103 About to insert : list_path_to_insert length 103 new photo from crops ! About to upload 103 photos upload in portfolio : 3736932 init cache_photo without model_param we have 103 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748303879_2420083 we have uploaded 103 photos in the portfolio 3736932 time of upload the photos Elapsed time : 22.937774181365967 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 13 About to insert : list_path_to_insert length 13 new photo from crops ! About to upload 13 photos upload in portfolio : 3736932 init cache_photo without model_param we have 13 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748303905_2420083 we have uploaded 13 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.23712944984436 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748303911_2420083 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8164174556732178 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 39 About to insert : list_path_to_insert length 39 new photo from crops ! About to upload 39 photos upload in portfolio : 3736932 init cache_photo without model_param we have 39 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748303929_2420083 we have uploaded 39 photos in the portfolio 3736932 time of upload the photos Elapsed time : 11.413785219192505 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748303942_2420083 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.02126145362854 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748303945_2420083 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5349011421203613 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748303947_2420083 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.079439401626587 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1360650917, 1360650860, 1360650811, 1360650745, 1360650697, 1360650355, 1360619057, 1360619053, 1360618995, 1360618963] Looping around the photos to save general results len do output : 163 /1361196713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361196892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650917', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650860', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650811', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650745', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650697', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650355', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360619057', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360619053', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360618995', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360618963', None, None, None, None, None, '2961020') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 499 time used for this insertion : 1.9260921478271484 save_final save missing photos in datou_result : time spend for datou_step_exec : 92.78015232086182 time spend to save output : 1.9312732219696045 total time spend for step 2 : 94.71142554283142 step3:rle_unique_nms_with_priority Tue May 27 01:59:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 163 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 24 nb_hashtags : 5 time to prepare the origin masks : 5.903127431869507 time for calcul the mask position with numpy : 0.38127613067626953 nb_pixel_total : 6106804 time to create 1 rle with new method : 0.4148688316345215 time for calcul the mask position with numpy : 0.019932985305786133 nb_pixel_total : 92173 time to create 1 rle with old method : 0.0971217155456543 time for calcul the mask position with numpy : 0.020077943801879883 nb_pixel_total : 15236 time to create 1 rle with old method : 0.01619124412536621 time for calcul the mask position with numpy : 0.01995110511779785 nb_pixel_total : 69994 time to create 1 rle with old method : 0.07194781303405762 time for calcul the mask position with numpy : 0.02028489112854004 nb_pixel_total : 46410 time to create 1 rle with old method : 0.051958560943603516 time for calcul the mask position with numpy : 0.023144960403442383 nb_pixel_total : 17221 time to create 1 rle with old method : 0.019004106521606445 time for calcul the mask position with numpy : 0.02239513397216797 nb_pixel_total : 18922 time to create 1 rle with old method : 0.024019956588745117 time for calcul the mask position with numpy : 0.02446460723876953 nb_pixel_total : 31115 time to create 1 rle with old method : 0.03932332992553711 time for calcul the mask position with numpy : 0.022802114486694336 nb_pixel_total : 45442 time to create 1 rle with old method : 0.057520151138305664 time for calcul the mask position with numpy : 0.025000572204589844 nb_pixel_total : 52252 time to create 1 rle with old method : 0.06475090980529785 time for calcul the mask position with numpy : 0.019937753677368164 nb_pixel_total : 18714 time to create 1 rle with old method : 0.02007269859313965 time for calcul the mask position with numpy : 0.01951146125793457 nb_pixel_total : 10583 time to create 1 rle with old method : 0.011180639266967773 time for calcul the mask position with numpy : 0.0191342830657959 nb_pixel_total : 51212 time to create 1 rle with old method : 0.05434536933898926 time for calcul the mask position with numpy : 0.01943683624267578 nb_pixel_total : 26476 time to create 1 rle with old method : 0.028165102005004883 time for calcul the mask position with numpy : 0.01913595199584961 nb_pixel_total : 16463 time to create 1 rle with old method : 0.017414569854736328 time for calcul the mask position with numpy : 0.019088268280029297 nb_pixel_total : 11206 time to create 1 rle with old method : 0.012234926223754883 time for calcul the mask position with numpy : 0.02010512351989746 nb_pixel_total : 83528 time to create 1 rle with old method : 0.09058022499084473 time for calcul the mask position with numpy : 0.021078109741210938 nb_pixel_total : 30210 time to create 1 rle with old method : 0.03320622444152832 time for calcul the mask position with numpy : 0.020544767379760742 nb_pixel_total : 60254 time to create 1 rle with old method : 0.06550049781799316 time for calcul the mask position with numpy : 0.01997661590576172 nb_pixel_total : 10643 time to create 1 rle with old method : 0.011580228805541992 time for calcul the mask position with numpy : 0.019509553909301758 nb_pixel_total : 8452 time to create 1 rle with old method : 0.009182214736938477 time for calcul the mask position with numpy : 0.01960301399230957 nb_pixel_total : 21995 time to create 1 rle with old method : 0.023580074310302734 time for calcul the mask position with numpy : 0.020912885665893555 nb_pixel_total : 163983 time to create 1 rle with new method : 0.4647853374481201 time for calcul the mask position with numpy : 0.019330263137817383 nb_pixel_total : 33208 time to create 1 rle with old method : 0.03563690185546875 time for calcul the mask position with numpy : 0.019304275512695312 nb_pixel_total : 7744 time to create 1 rle with old method : 0.008254766464233398 create new chi : 2.672297239303589 time to delete rle : 0.016252517700195312 batch 1 Loaded 49 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 14736 TO DO : save crop sub photo not yet done ! save time : 93.4779314994812 nb_obj : 16 nb_hashtags : 2 time to prepare the origin masks : 6.818433046340942 time for calcul the mask position with numpy : 0.5262632369995117 nb_pixel_total : 5880503 time to create 1 rle with new method : 0.7243130207061768 time for calcul the mask position with numpy : 0.040494680404663086 nb_pixel_total : 107677 time to create 1 rle with old method : 0.12087535858154297 time for calcul the mask position with numpy : 0.043209075927734375 nb_pixel_total : 41521 time to create 1 rle with old method : 0.04654717445373535 time for calcul the mask position with numpy : 0.03694868087768555 nb_pixel_total : 43556 time to create 1 rle with old method : 0.04881167411804199 time for calcul the mask position with numpy : 0.04211592674255371 nb_pixel_total : 100344 time to create 1 rle with old method : 0.11031746864318848 time for calcul the mask position with numpy : 0.03487420082092285 nb_pixel_total : 20912 time to create 1 rle with old method : 0.024693012237548828 time for calcul the mask position with numpy : 0.03681325912475586 nb_pixel_total : 92568 time to create 1 rle with old method : 0.10290265083312988 time for calcul the mask position with numpy : 0.03827953338623047 nb_pixel_total : 105651 time to create 1 rle with old method : 0.12394881248474121 time for calcul the mask position with numpy : 0.045729637145996094 nb_pixel_total : 79974 time to create 1 rle with old method : 0.09072113037109375 time for calcul the mask position with numpy : 0.04657411575317383 nb_pixel_total : 14436 time to create 1 rle with old method : 0.016371726989746094 time for calcul the mask position with numpy : 0.042572021484375 nb_pixel_total : 65419 time to create 1 rle with old method : 0.07339954376220703 time for calcul the mask position with numpy : 0.04424452781677246 nb_pixel_total : 95021 time to create 1 rle with old method : 0.1118631362915039 time for calcul the mask position with numpy : 0.042406320571899414 nb_pixel_total : 80636 time to create 1 rle with old method : 0.08974575996398926 time for calcul the mask position with numpy : 0.03729081153869629 nb_pixel_total : 31389 time to create 1 rle with old method : 0.036672353744506836 time for calcul the mask position with numpy : 0.03656601905822754 nb_pixel_total : 202465 time to create 1 rle with new method : 0.6889045238494873 time for calcul the mask position with numpy : 0.035379648208618164 nb_pixel_total : 56499 time to create 1 rle with old method : 0.06862497329711914 time for calcul the mask position with numpy : 0.032839298248291016 nb_pixel_total : 31669 time to create 1 rle with old method : 0.03554534912109375 create new chi : 3.9400718212127686 time to delete rle : 0.0035724639892578125 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 13586 TO DO : save crop sub photo not yet done ! save time : 75.17797350883484 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 5.059006929397583 time for calcul the mask position with numpy : 0.40933823585510254 nb_pixel_total : 5315244 time to create 1 rle with new method : 1.0062382221221924 time for calcul the mask position with numpy : 0.025371551513671875 nb_pixel_total : 34328 time to create 1 rle with old method : 0.03725886344909668 time for calcul the mask position with numpy : 0.02124810218811035 nb_pixel_total : 25848 time to create 1 rle with old method : 0.028430700302124023 time for calcul the mask position with numpy : 0.022939443588256836 nb_pixel_total : 195088 time to create 1 rle with new method : 1.7040181159973145 time for calcul the mask position with numpy : 0.028937578201293945 nb_pixel_total : 196629 time to create 1 rle with new method : 0.6019628047943115 time for calcul the mask position with numpy : 0.024847984313964844 nb_pixel_total : 80117 time to create 1 rle with old method : 0.1156473159790039 time for calcul the mask position with numpy : 0.027698516845703125 nb_pixel_total : 172388 time to create 1 rle with new method : 0.6334447860717773 time for calcul the mask position with numpy : 0.03549504280090332 nb_pixel_total : 39820 time to create 1 rle with old method : 0.043508291244506836 time for calcul the mask position with numpy : 0.035070180892944336 nb_pixel_total : 26655 time to create 1 rle with old method : 0.030678272247314453 time for calcul the mask position with numpy : 0.0375676155090332 nb_pixel_total : 14452 time to create 1 rle with old method : 0.016553163528442383 time for calcul the mask position with numpy : 0.03576397895812988 nb_pixel_total : 60256 time to create 1 rle with old method : 0.06778740882873535 time for calcul the mask position with numpy : 0.034754037857055664 nb_pixel_total : 26772 time to create 1 rle with old method : 0.029268980026245117 time for calcul the mask position with numpy : 0.03404092788696289 nb_pixel_total : 13648 time to create 1 rle with old method : 0.014804840087890625 time for calcul the mask position with numpy : 0.03427886962890625 nb_pixel_total : 144577 time to create 1 rle with old method : 0.16098475456237793 time for calcul the mask position with numpy : 0.028816699981689453 nb_pixel_total : 704418 time to create 1 rle with new method : 0.6272766590118408 create new chi : 6.097336292266846 time to delete rle : 0.0022482872009277344 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 13699 TO DO : save crop sub photo not yet done ! save time : 35.38786220550537 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 4.7239086627960205 time for calcul the mask position with numpy : 0.4339914321899414 nb_pixel_total : 6584199 time to create 1 rle with new method : 0.44159364700317383 time for calcul the mask position with numpy : 0.02356243133544922 nb_pixel_total : 10800 time to create 1 rle with old method : 0.012267351150512695 time for calcul the mask position with numpy : 0.0210723876953125 nb_pixel_total : 29121 time to create 1 rle with old method : 0.032582759857177734 time for calcul the mask position with numpy : 0.023023605346679688 nb_pixel_total : 121515 time to create 1 rle with old method : 0.1589057445526123 time for calcul the mask position with numpy : 0.02260303497314453 nb_pixel_total : 30373 time to create 1 rle with old method : 0.03403925895690918 time for calcul the mask position with numpy : 0.022696256637573242 nb_pixel_total : 32301 time to create 1 rle with old method : 0.03608059883117676 time for calcul the mask position with numpy : 0.024002552032470703 nb_pixel_total : 39179 time to create 1 rle with old method : 0.04415154457092285 time for calcul the mask position with numpy : 0.02152109146118164 nb_pixel_total : 10201 time to create 1 rle with old method : 0.011460542678833008 time for calcul the mask position with numpy : 0.021419048309326172 nb_pixel_total : 22797 time to create 1 rle with old method : 0.025335311889648438 time for calcul the mask position with numpy : 0.021380186080932617 nb_pixel_total : 6800 time to create 1 rle with old method : 0.007703065872192383 time for calcul the mask position with numpy : 0.02170252799987793 nb_pixel_total : 18768 time to create 1 rle with old method : 0.020479917526245117 time for calcul the mask position with numpy : 0.021665096282958984 nb_pixel_total : 15302 time to create 1 rle with old method : 0.017093420028686523 time for calcul the mask position with numpy : 0.021902084350585938 nb_pixel_total : 18334 time to create 1 rle with old method : 0.020474910736083984 time for calcul the mask position with numpy : 0.022040843963623047 nb_pixel_total : 12864 time to create 1 rle with old method : 0.014456748962402344 time for calcul the mask position with numpy : 0.02129960060119629 nb_pixel_total : 35635 time to create 1 rle with old method : 0.03886556625366211 time for calcul the mask position with numpy : 0.020513534545898438 nb_pixel_total : 23320 time to create 1 rle with old method : 0.02452874183654785 time for calcul the mask position with numpy : 0.020331382751464844 nb_pixel_total : 38731 time to create 1 rle with old method : 0.042018890380859375 create new chi : 1.807251214981079 time to delete rle : 0.001478433609008789 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 9884 TO DO : save crop sub photo not yet done ! save time : 1.499089241027832 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 3.9814815521240234 time for calcul the mask position with numpy : 0.4429306983947754 nb_pixel_total : 6634322 time to create 1 rle with new method : 0.6085498332977295 time for calcul the mask position with numpy : 0.03542470932006836 nb_pixel_total : 45291 time to create 1 rle with old method : 0.0504298210144043 time for calcul the mask position with numpy : 0.0240323543548584 nb_pixel_total : 32197 time to create 1 rle with old method : 0.03587603569030762 time for calcul the mask position with numpy : 0.021974802017211914 nb_pixel_total : 19488 time to create 1 rle with old method : 0.021787166595458984 time for calcul the mask position with numpy : 0.021413087844848633 nb_pixel_total : 21041 time to create 1 rle with old method : 0.02353358268737793 time for calcul the mask position with numpy : 0.021407365798950195 nb_pixel_total : 21699 time to create 1 rle with old method : 0.023957014083862305 time for calcul the mask position with numpy : 0.021299362182617188 nb_pixel_total : 43485 time to create 1 rle with old method : 0.04875016212463379 time for calcul the mask position with numpy : 0.021459579467773438 nb_pixel_total : 54760 time to create 1 rle with old method : 0.0618133544921875 time for calcul the mask position with numpy : 0.0213775634765625 nb_pixel_total : 51266 time to create 1 rle with old method : 0.05682969093322754 time for calcul the mask position with numpy : 0.023491859436035156 nb_pixel_total : 9339 time to create 1 rle with old method : 0.010498523712158203 time for calcul the mask position with numpy : 0.024386882781982422 nb_pixel_total : 18363 time to create 1 rle with old method : 0.020489215850830078 time for calcul the mask position with numpy : 0.02170419692993164 nb_pixel_total : 27374 time to create 1 rle with old method : 0.03816938400268555 time for calcul the mask position with numpy : 0.02345561981201172 nb_pixel_total : 25057 time to create 1 rle with old method : 0.039670705795288086 time for calcul the mask position with numpy : 0.021486997604370117 nb_pixel_total : 24844 time to create 1 rle with old method : 0.027668237686157227 time for calcul the mask position with numpy : 0.022106647491455078 nb_pixel_total : 21714 time to create 1 rle with old method : 0.024335384368896484 create new chi : 1.9842193126678467 time to delete rle : 0.0014564990997314453 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 8460 TO DO : save crop sub photo not yet done ! save time : 0.5578024387359619 nb_obj : 24 nb_hashtags : 3 time to prepare the origin masks : 9.023942232131958 time for calcul the mask position with numpy : 1.1512463092803955 nb_pixel_total : 6327917 time to create 1 rle with new method : 1.0870261192321777 time for calcul the mask position with numpy : 0.022238731384277344 nb_pixel_total : 71751 time to create 1 rle with old method : 0.08402371406555176 time for calcul the mask position with numpy : 0.025791406631469727 nb_pixel_total : 6259 time to create 1 rle with old method : 0.007075309753417969 time for calcul the mask position with numpy : 0.022873878479003906 nb_pixel_total : 43316 time to create 1 rle with old method : 0.05237627029418945 time for calcul the mask position with numpy : 0.022963762283325195 nb_pixel_total : 7003 time to create 1 rle with old method : 0.008055448532104492 time for calcul the mask position with numpy : 0.02333545684814453 nb_pixel_total : 17452 time to create 1 rle with old method : 0.01950979232788086 time for calcul the mask position with numpy : 0.0225980281829834 nb_pixel_total : 5031 time to create 1 rle with old method : 0.005652189254760742 time for calcul the mask position with numpy : 0.022269248962402344 nb_pixel_total : 13966 time to create 1 rle with old method : 0.015601634979248047 time for calcul the mask position with numpy : 0.021605253219604492 nb_pixel_total : 13066 time to create 1 rle with old method : 0.01879715919494629 time for calcul the mask position with numpy : 0.0240170955657959 nb_pixel_total : 24968 time to create 1 rle with old method : 0.027705669403076172 time for calcul the mask position with numpy : 0.034384727478027344 nb_pixel_total : 6948 time to create 1 rle with old method : 0.007776498794555664 time for calcul the mask position with numpy : 0.034748077392578125 nb_pixel_total : 36445 time to create 1 rle with old method : 0.040628910064697266 time for calcul the mask position with numpy : 0.034546613693237305 nb_pixel_total : 8435 time to create 1 rle with old method : 0.009511947631835938 time for calcul the mask position with numpy : 0.035024404525756836 nb_pixel_total : 12922 time to create 1 rle with old method : 0.014459848403930664 time for calcul the mask position with numpy : 0.03966832160949707 nb_pixel_total : 40210 time to create 1 rle with old method : 0.044547080993652344 time for calcul the mask position with numpy : 0.03470802307128906 nb_pixel_total : 22651 time to create 1 rle with old method : 0.025348424911499023 time for calcul the mask position with numpy : 0.03455352783203125 nb_pixel_total : 30061 time to create 1 rle with old method : 0.03366875648498535 time for calcul the mask position with numpy : 0.03650641441345215 nb_pixel_total : 24943 time to create 1 rle with old method : 0.02812647819519043 time for calcul the mask position with numpy : 0.03498530387878418 nb_pixel_total : 62127 time to create 1 rle with old method : 0.07356524467468262 time for calcul the mask position with numpy : 0.03518843650817871 nb_pixel_total : 17950 time to create 1 rle with old method : 0.01998162269592285 time for calcul the mask position with numpy : 0.03437352180480957 nb_pixel_total : 16740 time to create 1 rle with old method : 0.01888728141784668 time for calcul the mask position with numpy : 0.03447580337524414 nb_pixel_total : 68388 time to create 1 rle with old method : 0.07612752914428711 time for calcul the mask position with numpy : 0.036205291748046875 nb_pixel_total : 9943 time to create 1 rle with old method : 0.011517524719238281 time for calcul the mask position with numpy : 0.03768491744995117 nb_pixel_total : 146734 time to create 1 rle with old method : 0.16409826278686523 time for calcul the mask position with numpy : 0.035811424255371094 nb_pixel_total : 15014 time to create 1 rle with old method : 0.016794919967651367 create new chi : 3.847292900085449 time to delete rle : 0.0027313232421875 batch 1 Loaded 49 chid ids of type : 3594 ++++++++++++++++++++++++++Number RLEs to save : 12774 TO DO : save crop sub photo not yet done ! save time : 4.216200113296509 nb_obj : 15 nb_hashtags : 4 time to prepare the origin masks : 7.84714674949646 time for calcul the mask position with numpy : 0.46081089973449707 nb_pixel_total : 6710296 time to create 1 rle with new method : 0.5086991786956787 time for calcul the mask position with numpy : 0.03377485275268555 nb_pixel_total : 5041 time to create 1 rle with old method : 0.005622148513793945 time for calcul the mask position with numpy : 0.032835960388183594 nb_pixel_total : 8755 time to create 1 rle with old method : 0.009477376937866211 time for calcul the mask position with numpy : 0.033663034439086914 nb_pixel_total : 22178 time to create 1 rle with old method : 0.026810884475708008 time for calcul the mask position with numpy : 0.03642725944519043 nb_pixel_total : 16127 time to create 1 rle with old method : 0.017588376998901367 time for calcul the mask position with numpy : 0.034493446350097656 nb_pixel_total : 16502 time to create 1 rle with old method : 0.01806497573852539 time for calcul the mask position with numpy : 0.021780014038085938 nb_pixel_total : 26098 time to create 1 rle with old method : 0.02807164192199707 time for calcul the mask position with numpy : 0.02025127410888672 nb_pixel_total : 14464 time to create 1 rle with old method : 0.015911340713500977 time for calcul the mask position with numpy : 0.02061939239501953 nb_pixel_total : 32762 time to create 1 rle with old method : 0.03592324256896973 time for calcul the mask position with numpy : 0.021209716796875 nb_pixel_total : 7822 time to create 1 rle with old method : 0.008934974670410156 time for calcul the mask position with numpy : 0.021780729293823242 nb_pixel_total : 56906 time to create 1 rle with old method : 0.06248903274536133 time for calcul the mask position with numpy : 0.020901203155517578 nb_pixel_total : 20255 time to create 1 rle with old method : 0.021033287048339844 time for calcul the mask position with numpy : 0.021134138107299805 nb_pixel_total : 67359 time to create 1 rle with old method : 0.0726468563079834 time for calcul the mask position with numpy : 0.02123713493347168 nb_pixel_total : 11766 time to create 1 rle with old method : 0.012958526611328125 time for calcul the mask position with numpy : 0.034015655517578125 nb_pixel_total : 19588 time to create 1 rle with old method : 0.02052593231201172 time for calcul the mask position with numpy : 0.0348968505859375 nb_pixel_total : 14321 time to create 1 rle with old method : 0.015442371368408203 create new chi : 1.7884044647216797 time to delete rle : 0.0013589859008789062 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 7874 TO DO : save crop sub photo not yet done ! save time : 1.9544999599456787 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 6.177555799484253 time for calcul the mask position with numpy : 0.5266773700714111 nb_pixel_total : 5745300 time to create 1 rle with new method : 0.6781735420227051 time for calcul the mask position with numpy : 0.022048234939575195 nb_pixel_total : 20522 time to create 1 rle with old method : 0.023094654083251953 time for calcul the mask position with numpy : 0.023787736892700195 nb_pixel_total : 2528 time to create 1 rle with old method : 0.0031785964965820312 time for calcul the mask position with numpy : 0.02315831184387207 nb_pixel_total : 83157 time to create 1 rle with old method : 0.09264564514160156 time for calcul the mask position with numpy : 0.022847414016723633 nb_pixel_total : 11389 time to create 1 rle with old method : 0.012849569320678711 time for calcul the mask position with numpy : 0.022793054580688477 nb_pixel_total : 8676 time to create 1 rle with old method : 0.0096435546875 time for calcul the mask position with numpy : 0.02201366424560547 nb_pixel_total : 55109 time to create 1 rle with old method : 0.0619661808013916 time for calcul the mask position with numpy : 0.02081751823425293 nb_pixel_total : 28006 time to create 1 rle with old method : 0.032865285873413086 time for calcul the mask position with numpy : 0.02126908302307129 nb_pixel_total : 14286 time to create 1 rle with old method : 0.015424013137817383 time for calcul the mask position with numpy : 0.021454334259033203 nb_pixel_total : 102345 time to create 1 rle with old method : 0.10863256454467773 time for calcul the mask position with numpy : 0.020285844802856445 nb_pixel_total : 26248 time to create 1 rle with old method : 0.027343034744262695 time for calcul the mask position with numpy : 0.026833295822143555 nb_pixel_total : 649813 time to create 1 rle with new method : 0.4175717830657959 time for calcul the mask position with numpy : 0.0206146240234375 nb_pixel_total : 18710 time to create 1 rle with old method : 0.019907236099243164 time for calcul the mask position with numpy : 0.021123170852661133 nb_pixel_total : 95126 time to create 1 rle with old method : 0.1020050048828125 time for calcul the mask position with numpy : 0.021494150161743164 nb_pixel_total : 90056 time to create 1 rle with old method : 0.09635663032531738 time for calcul the mask position with numpy : 0.021475791931152344 nb_pixel_total : 59228 time to create 1 rle with old method : 0.06297731399536133 time for calcul the mask position with numpy : 0.019952774047851562 nb_pixel_total : 25127 time to create 1 rle with old method : 0.026554346084594727 time for calcul the mask position with numpy : 0.02020883560180664 nb_pixel_total : 14614 time to create 1 rle with old method : 0.015325546264648438 create new chi : 2.7709286212921143 time to delete rle : 0.0016951560974121094 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 11207 TO DO : save crop sub photo not yet done ! save time : 16.1196186542511 nb_obj : 10 nb_hashtags : 2 time to prepare the origin masks : 5.679758787155151 time for calcul the mask position with numpy : 0.6647756099700928 nb_pixel_total : 6857790 time to create 1 rle with new method : 0.7048676013946533 time for calcul the mask position with numpy : 0.021162986755371094 nb_pixel_total : 21106 time to create 1 rle with old method : 0.022584915161132812 time for calcul the mask position with numpy : 0.02190423011779785 nb_pixel_total : 7189 time to create 1 rle with old method : 0.007981300354003906 time for calcul the mask position with numpy : 0.021416902542114258 nb_pixel_total : 11521 time to create 1 rle with old method : 0.012701749801635742 time for calcul the mask position with numpy : 0.020264863967895508 nb_pixel_total : 23689 time to create 1 rle with old method : 0.025514841079711914 time for calcul the mask position with numpy : 0.01996779441833496 nb_pixel_total : 31155 time to create 1 rle with old method : 0.03366971015930176 time for calcul the mask position with numpy : 0.020525217056274414 nb_pixel_total : 22527 time to create 1 rle with old method : 0.023922204971313477 time for calcul the mask position with numpy : 0.020117759704589844 nb_pixel_total : 42387 time to create 1 rle with old method : 0.04620766639709473 time for calcul the mask position with numpy : 0.021274328231811523 nb_pixel_total : 16057 time to create 1 rle with old method : 0.018018007278442383 time for calcul the mask position with numpy : 0.022871971130371094 nb_pixel_total : 9660 time to create 1 rle with old method : 0.011142253875732422 time for calcul the mask position with numpy : 0.02615666389465332 nb_pixel_total : 7159 time to create 1 rle with old method : 0.00931859016418457 create new chi : 1.8334846496582031 time to delete rle : 0.0011699199676513672 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++Number RLEs to save : 5476 TO DO : save crop sub photo not yet done ! save time : 0.39560461044311523 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 5.827761888504028 time for calcul the mask position with numpy : 0.5789177417755127 nb_pixel_total : 5325174 time to create 1 rle with new method : 0.909991979598999 time for calcul the mask position with numpy : 0.02278590202331543 nb_pixel_total : 39649 time to create 1 rle with old method : 0.04419422149658203 time for calcul the mask position with numpy : 0.029572248458862305 nb_pixel_total : 23838 time to create 1 rle with old method : 0.026824951171875 time for calcul the mask position with numpy : 0.040369272232055664 nb_pixel_total : 13238 time to create 1 rle with old method : 0.01504826545715332 time for calcul the mask position with numpy : 0.038143157958984375 nb_pixel_total : 1707 time to create 1 rle with old method : 0.0019588470458984375 time for calcul the mask position with numpy : 0.047453880310058594 nb_pixel_total : 1293407 time to create 1 rle with new method : 0.6030516624450684 time for calcul the mask position with numpy : 0.031314849853515625 nb_pixel_total : 64994 time to create 1 rle with old method : 0.06933283805847168 time for calcul the mask position with numpy : 0.03622102737426758 nb_pixel_total : 111173 time to create 1 rle with old method : 0.13697004318237305 time for calcul the mask position with numpy : 0.029260873794555664 nb_pixel_total : 10049 time to create 1 rle with old method : 0.011351823806762695 time for calcul the mask position with numpy : 0.029991626739501953 nb_pixel_total : 61855 time to create 1 rle with old method : 0.0668942928314209 time for calcul the mask position with numpy : 0.021100282669067383 nb_pixel_total : 26113 time to create 1 rle with old method : 0.028728961944580078 time for calcul the mask position with numpy : 0.0216219425201416 nb_pixel_total : 66742 time to create 1 rle with old method : 0.07242941856384277 time for calcul the mask position with numpy : 0.02151322364807129 nb_pixel_total : 12301 time to create 1 rle with old method : 0.013474464416503906 create new chi : 3.012805461883545 time to delete rle : 0.0021505355834960938 batch 1 Loaded 26 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 12985 TO DO : save crop sub photo not yet done ! save time : 3.3236517906188965 map_output_result : {1360650917: (0.0, 'Should be the crop_list due to order', 0), 1360650860: (0.0, 'Should be the crop_list due to order', 0), 1360650811: (0.0, 'Should be the crop_list due to order', 0), 1360650745: (0.0, 'Should be the crop_list due to order', 0), 1360650697: (0.0, 'Should be the crop_list due to order', 0), 1360650355: (0.0, 'Should be the crop_list due to order', 0), 1360619057: (0.0, 'Should be the crop_list due to order', 0), 1360619053: (0.0, 'Should be the crop_list due to order', 0), 1360618995: (0.0, 'Should be the crop_list due to order', 0), 1360618963: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1360650917, 1360650860, 1360650811, 1360650745, 1360650697, 1360650355, 1360619057, 1360619053, 1360618995, 1360618963] Looping around the photos to save general results len do output : 10 /1360650917.Didn't retrieve data . /1360650860.Didn't retrieve data . /1360650811.Didn't retrieve data . /1360650745.Didn't retrieve data . /1360650697.Didn't retrieve data . /1360650355.Didn't retrieve data . /1360619057.Didn't retrieve data . /1360619053.Didn't retrieve data . /1360618995.Didn't retrieve data . /1360618963.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650917', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650860', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650811', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650745', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650697', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650355', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360619057', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360619053', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360618995', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360618963', None, None, None, None, None, '2961020') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.01784658432006836 save_final save missing photos in datou_result : time spend for datou_step_exec : 324.2362036705017 time spend to save output : 0.0207669734954834 total time spend for step 3 : 324.2569706439972 step4:ventilate_hashtags_in_portfolio Tue May 27 02:04:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23360447 get user id for portfolio 23360447 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23360447 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','metal','carton','pehd','pet_clair','mal_croppe','flou','papier','autre','background','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23360447 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','metal','carton','pehd','pet_clair','mal_croppe','flou','papier','autre','background','environnement')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23360447 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','metal','carton','pehd','pet_clair','mal_croppe','flou','papier','autre','background','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23362531,23362532,23362533,23362534,23362535,23362536,23362537,23362538,23362539,23362540,23362541?tags=pet_fonce,metal,carton,pehd,pet_clair,mal_croppe,flou,papier,autre,background,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1360650917, 1360650860, 1360650811, 1360650745, 1360650697, 1360650355, 1360619057, 1360619053, 1360618995, 1360618963] Looping around the photos to save general results len do output : 1 /23360447. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650917', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650860', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650811', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650745', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650697', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650355', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360619057', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360619053', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360618995', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360618963', None, None, None, None, None, '2961020') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.016932249069213867 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.8364663124084473 time spend to save output : 0.04845833778381348 total time spend for step 4 : 1.8849246501922607 step5:final Tue May 27 02:04:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1360650917: ('0.12786587406953517',), 1360650860: ('0.12786587406953517',), 1360650811: ('0.12786587406953517',), 1360650745: ('0.12786587406953517',), 1360650697: ('0.12786587406953517',), 1360650355: ('0.12786587406953517',), 1360619057: ('0.12786587406953517',), 1360619053: ('0.12786587406953517',), 1360618995: ('0.12786587406953517',), 1360618963: ('0.12786587406953517',)} new output for save of step final : {1360650917: ('0.12786587406953517',), 1360650860: ('0.12786587406953517',), 1360650811: ('0.12786587406953517',), 1360650745: ('0.12786587406953517',), 1360650697: ('0.12786587406953517',), 1360650355: ('0.12786587406953517',), 1360619057: ('0.12786587406953517',), 1360619053: ('0.12786587406953517',), 1360618995: ('0.12786587406953517',), 1360618963: ('0.12786587406953517',)} [1360650917, 1360650860, 1360650811, 1360650745, 1360650697, 1360650355, 1360619057, 1360619053, 1360618995, 1360618963] Looping around the photos to save general results len do output : 10 /1360650917.Didn't retrieve data . /1360650860.Didn't retrieve data . /1360650811.Didn't retrieve data . /1360650745.Didn't retrieve data . /1360650697.Didn't retrieve data . /1360650355.Didn't retrieve data . /1360619057.Didn't retrieve data . /1360619053.Didn't retrieve data . /1360618995.Didn't retrieve data . /1360618963.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650917', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650860', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650811', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650745', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650697', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650355', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360619057', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360619053', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360618995', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360618963', None, None, None, None, None, '2961020') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.015927553176879883 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11728692054748535 time spend to save output : 0.016642093658447266 total time spend for step 5 : 0.13392901420593262 step6:blur_detection Tue May 27 02:04:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6.jpg resize: (2160, 3264) 1360650917 -2.0591786893726165 treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff.jpg resize: (2160, 3264) 1360650860 -0.8254158477366437 treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df.jpg resize: (2160, 3264) 1360650811 -1.5440270484828134 treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1.jpg resize: (2160, 3264) 1360650745 -3.3710868745208664 treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051.jpg resize: (2160, 3264) 1360650697 2.708812850250153 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654.jpg resize: (2160, 3264) 1360650355 -2.0376567980790647 treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859.jpg resize: (2160, 3264) 1360619057 -3.656345260481571 treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea.jpg resize: (2160, 3264) 1360619053 -2.6541935312560563 treat image : temp/1748303427_2420083_1360618995_9de072533654e630c957f021fac39dab.jpg resize: (2160, 3264) 1360618995 -3.1753711714811326 treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25.jpg resize: (2160, 3264) 1360618963 -0.0633206511903287 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647153_0.png resize: (452, 283) 1361196713 -2.401145217436205 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647148_0.png resize: (175, 219) 1361196714 -2.3054109626494506 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647149_0.png resize: (91, 115) 1361196715 0.3852874459838339 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647156_0.png resize: (248, 149) 1361196716 -0.9034071535744914 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647159_0.png resize: (145, 193) 1361196717 -1.9148453959579361 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647164_0.png resize: (201, 101) 1361196718 -1.0739116248106013 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647161_0.png resize: (194, 334) 1361196719 -1.32271200900604 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647168_0.png resize: (424, 302) 1361196720 -0.9153384107738624 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647158_0.png resize: (83, 153) 1361196721 1.0279109461432503 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647163_0.png resize: (224, 248) 1361196722 -2.490121352512058 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647155_0.png resize: (281, 89) 1361196723 -1.1545232407397705 treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647170_0.png resize: (358, 278) 1361196724 -1.90105918415172 treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647179_0.png resize: (353, 632) 1361196725 -1.755929864959858 treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647176_0.png resize: (104, 213) 1361196726 -2.9633022786478453 treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647169_0.png resize: (211, 238) 1361196727 -1.6465611486685892 treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647184_0.png resize: (274, 594) 1361196728 -1.5624341031250715 treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647172_0.png resize: (132, 361) 1361196729 -1.411209975260842 treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647177_0.png resize: (476, 321) 1361196730 -1.6643797111650172 treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647183_0.png resize: (186, 387) 1361196731 -0.7988592187643468 treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647174_0.png resize: (433, 372) 1361196733 -1.7871949021263693 treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647189_0.png resize: (378, 329) 1361196734 -1.6760484787010566 treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647196_0.png resize: (660, 673) 1361196735 -2.1979336075240394 treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647190_0.png resize: (153, 121) 1361196736 -1.006613512092088 treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647197_0.png resize: (276, 232) 1361196737 -1.7783565638515866 treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647187_0.png resize: (196, 95) 1361196738 -1.2013796638500436 treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647191_0.png resize: (280, 166) 1361196739 -2.145864525609882 treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647198_0.png resize: (260, 215) 1361196740 -1.9888384344445065 treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647186_0.png resize: (565, 448) 1361196741 -2.9042704905481664 treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647185_0.png resize: (893, 1174) 1361196742 0.22468742383998846 treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647188_0.png resize: (267, 175) 1361196743 -0.6993404740949576 treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647199_0.png resize: (353, 190) 1361196744 -2.0138368004315232 treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647205_0.png resize: (162, 224) 1361196745 -2.369584706172184 treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647207_0.png resize: (213, 179) 1361196746 -2.9772220567505006 treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647202_0.png resize: (118, 156) 1361196747 -0.1513655996939083 treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647200_0.png resize: (279, 132) 1361196748 -2.89644685412604 treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647213_0.png resize: (229, 182) 1361196749 2.085809835839206 treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647208_0.png resize: (195, 113) 1361196750 -2.263425346666979 treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647201_0.png resize: (212, 281) 1361196751 -0.9228910405571097 treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647211_0.png resize: (297, 169) 1361196752 -2.0866511993680548 treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647206_0.png resize: (81, 98) 1361196753 -0.9037717551698815 treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647218_0.png resize: (190, 212) 1361196754 -1.2023403515075035 treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647216_0.png resize: (211, 199) 1361196755 -1.3555248687506543 treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647222_0.png resize: (304, 274) 1361196756 0.35665232421269955 treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647221_0.png resize: (424, 168) 1361196757 -1.0286977276570413 treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647215_0.png resize: (219, 156) 1361196758 0.38671913878861547 treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647219_0.png resize: (127, 196) 1361196759 -0.057316871187771144 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647232_0.png resize: (446, 220) 1361196760 -1.054986805975744 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647241_0.png resize: (135, 97) 1361196761 -2.1069459416270604 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647236_0.png resize: (277, 232) 1361196762 -2.2924724477923824 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647247_0.png resize: (86, 76) 1361196763 -0.3768525976009326 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647249_0.png resize: (89, 92) 1361196764 2.447845029342712 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647240_0.png resize: (163, 112) 1361196765 -1.3105090977124967 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647245_0.png resize: (168, 111) 1361196766 -1.3524441392670552 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647251_0.png resize: (77, 94) 1361196767 -0.7075091509619579 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647233_0.png resize: (187, 101) 1361196768 0.0786420531974696 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647243_0.png resize: (105, 88) 1361196769 0.1705221709399821 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647244_0.png resize: (211, 165) 1361196770 -1.0524978997646446 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647234_0.png resize: (162, 147) 1361196771 -0.4471847361374533 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647242_0.png resize: (301, 148) 1361196772 0.11349974447074437 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647235_0.png resize: (327, 246) 1361196773 -0.29212430019711727 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647231_0.png resize: (133, 116) 1361196774 -0.3613412987716285 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647229_0.png resize: (212, 142) 1361196775 -0.6490871388791856 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647248_0.png resize: (158, 160) 1361196776 -1.4608407996156842 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647246_0.png resize: (122, 167) 1361196777 -0.8986634643166768 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647237_0.png resize: (251, 201) 1361196778 -0.8027238101710844 treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647253_0.png resize: (139, 124) 1361196779 -0.14605941476501297 treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647257_0.png resize: (171, 175) 1361196780 -1.8559571490285145 treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647261_0.png resize: (188, 126) 1361196781 -1.845866616368037 treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647265_0.png resize: (175, 154) 1361196782 -0.058372370049130075 treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647255_0.png resize: (216, 69) 1361196783 -3.337372245509479 treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647266_0.png resize: (153, 79) 1361196784 -1.27677165880224 treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647264_0.png resize: (257, 98) 1361196785 -1.5608270168024245 treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647258_0.png resize: (332, 274) 1361196786 -2.4049200758396734 treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647259_0.png resize: (111, 126) 1361196787 -1.6017839188536847 treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647262_0.png resize: (142, 267) 1361196788 -2.1173661295887354 treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647254_0.png resize: (183, 141) 1361196789 1.122317704804983 treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647276_0.png resize: (362, 495) 1361196790 -2.112955121953937 treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647281_0.png resize: (197, 301) 1361196791 -1.3894633817780642 treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647272_0.png resize: (277, 457) 1361196792 -1.3379919697008515 treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647283_0.png resize: (214, 186) 1361196793 -2.3094902566142643 treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647273_0.png resize: (191, 137) 1361196794 -1.9633557452259196 treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647277_0.png resize: (177, 207) 1361196795 -3.242612105458001 treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647269_0.png resize: (189, 228) 1361196796 -2.3707999297029803 treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647270_0.png resize: (292, 318) 1361196797 -2.4316238108686625 treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647279_0.png resize: (239, 346) 1361196798 -0.9408879845028698 treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647268_0.png resize: (219, 135) 1361196799 -1.7413735392642322 treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647274_0.png resize: (866, 1154) 1361196800 -2.5373750074690093 treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647275_0.png resize: (253, 171) 1361196801 -1.611451064316129 treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647280_0.png resize: (117, 96) 1361196802 -1.4328633394527999 treat image : temp/1748303427_2420083_1360618995_9de072533654e630c957f021fac39dab_rle_crop_3813647292_0.png resize: (135, 130) 1361196803 -1.691550990018664 treat image : temp/1748303427_2420083_1360618995_9de072533654e630c957f021fac39dab_rle_crop_3813647286_0.png resize: (109, 104) 1361196804 2.764427657257759 treat image : temp/1748303427_2420083_1360618995_9de072533654e630c957f021fac39dab_rle_crop_3813647293_0.png resize: (108, 97) 1361196805 -0.43859500464463574 treat image : temp/1748303427_2420083_1360618995_9de072533654e630c957f021fac39dab_rle_crop_3813647288_0.png resize: (262, 250) 1361196806 -1.0154100271708875 treat image : temp/1748303427_2420083_1360618995_9de072533654e630c957f021fac39dab_rle_crop_3813647294_0.png resize: (150, 215) 1361196807 -2.4677457726479233 treat image : temp/1748303427_2420083_1360618995_9de072533654e630c957f021fac39dab_rle_crop_3813647291_0.png resize: (175, 159) 1361196808 -0.6427396686624197 treat image : temp/1748303427_2420083_1360618995_9de072533654e630c957f021fac39dab_rle_crop_3813647290_0.png resize: (188, 268) 1361196809 -1.0651576331628831 treat image : temp/1748303427_2420083_1360618995_9de072533654e630c957f021fac39dab_rle_crop_3813647285_0.png resize: (117, 96) 1361196810 -2.2739366145985254 treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647305_0.png resize: (186, 90) 1361196811 -1.8956076330623706 treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647304_0.png resize: (147, 221) 1361196812 -2.282035234590804 treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647296_0.png resize: (383, 236) 1361196813 -0.6994785799138162 treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647299_0.png resize: (130, 134) 1361196814 -0.8987355696469421 treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647297_0.png resize: (155, 206) 1361196815 1.1893368147557202 treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647295_0.png resize: (136, 118) 1361196816 -0.6947841825150172 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647145_0.png resize: (69, 158) 1361196821 -1.6352158432192754 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647167_0.png resize: (190, 190) 1361196822 -2.010218468642527 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647146_0.png resize: (208, 226) 1361196823 -0.8686100670790204 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647154_0.png resize: (153, 131) 1361196824 -0.4701531208810857 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647151_0.png resize: (357, 266) 1361196825 -0.8563671168525595 treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647195_0.png resize: (366, 827) 1361196826 -1.6053691243866384 treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647204_0.png resize: (187, 111) 1361196827 -2.1228826835310257 treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647203_0.png resize: (151, 203) 1361196828 -1.5089090672468481 treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647210_0.png resize: (201, 282) 1361196829 -1.4329111354667223 treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647209_0.png resize: (219, 265) 1361196830 -1.9263752038152413 treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647225_0.png resize: (144, 202) 1361196831 0.20782922247207405 treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647226_0.png resize: (149, 187) 1361196832 -0.25297700747614477 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647238_0.png resize: (171, 180) 1361196833 -1.0558037711062669 treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647263_0.png resize: (142, 146) 1361196836 -3.050914501464585 treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647284_0.png resize: (143, 169) 1361196837 -1.1359106691082783 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647160_0.png resize: (304, 220) 1361196847 -1.5170389394203359 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647157_0.png resize: (222, 396) 1361196848 -2.09315713245487 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647165_0.png resize: (234, 332) 1361196849 -2.8251900157893477 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647166_0.png resize: (322, 343) 1361196850 -1.3456283596027228 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647152_0.png resize: (204, 181) 1361196851 -3.3835070151740867 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647147_0.png resize: (710, 279) 1361196852 -1.245709043807754 treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647178_0.png resize: (483, 321) 1361196853 -3.1966895150065455 treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647180_0.png resize: (176, 137) 1361196854 -2.748246147321609 treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647171_0.png resize: (475, 660) 1361196855 -0.82043087757398 treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647173_0.png resize: (357, 310) 1361196856 -1.83046487660848 treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647182_0.png resize: (264, 268) 1361196857 -2.2200960205642746 treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647181_0.png resize: (647, 199) 1361196858 -0.22175477040040498 treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647175_0.png resize: (428, 175) 1361196859 -1.2410048744946967 treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647194_0.png resize: (322, 358) 1361196860 -1.219207096334992 treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647193_0.png resize: (299, 1021) 1361196861 -1.1538893368743206 treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647192_0.png resize: (245, 222) 1361196862 -1.5257254149446973 treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647214_0.png resize: (271, 55) 1361196863 -1.5507624881402664 treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647212_0.png resize: (389, 525) 1361196864 -1.4958697655222473 treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647223_0.png resize: (250, 280) 1361196865 -1.0326647457687184 treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647220_0.png resize: (84, 142) 1361196866 -0.6477860403335096 treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647227_0.png resize: (178, 282) 1361196867 -1.551935386519094 treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647224_0.png resize: (149, 249) 1361196868 -1.3943113719400126 treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647228_0.png resize: (247, 246) 1361196869 -0.4137257271212445 treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647217_0.png resize: (183, 155) 1361196870 -1.39798800493701 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647239_0.png resize: (224, 249) 1361196871 -2.8220600275090857 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647252_0.png resize: (514, 175) 1361196872 -2.7510228020911573 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647230_0.png resize: (331, 568) 1361196873 -2.1042390800624275 treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647250_0.png resize: (254, 243) 1361196874 -0.6175179794987419 treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647256_0.png resize: (254, 375) 1361196875 -3.53084498472148 treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647260_0.png resize: (190, 324) 1361196876 -1.4329689206773077 treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647282_0.png resize: (241, 502) 1361196877 -1.532401930521976 treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647271_0.png resize: (216, 564) 1361196878 -0.2601014471306719 treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647278_0.png resize: (228, 147) 1361196879 -4.086645867877223 treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647302_0.png resize: (1991, 961) 1361196880 -1.3477554789377495 treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647303_0.png resize: (239, 216) 1361196881 -3.0407152270456774 treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647298_0.png resize: (412, 167) 1361196882 -0.46830340792287306 treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647301_0.png resize: (254, 559) 1361196883 -1.3583957225012269 treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647307_0.png resize: (190, 511) 1361196884 -1.1732947264760327 treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647306_0.png resize: (132, 216) 1361196885 -1.8846217677376118 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647162_0.png resize: (171, 210) 1361196887 0.24442426256662153 treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647267_0.png resize: (108, 76) 1361196888 -3.9404672946892014 treat image : temp/1748303427_2420083_1360618995_9de072533654e630c957f021fac39dab_rle_crop_3813647287_0.png resize: (160, 126) 1361196889 -2.970335970365921 treat image : temp/1748303427_2420083_1360618995_9de072533654e630c957f021fac39dab_rle_crop_3813647289_0.png resize: (182, 157) 1361196890 -0.8427927841445699 treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647150_0.png resize: (113, 117) 1361196891 1.1134901146477998 treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647300_0.png resize: (284, 426) 1361196892 2.081126377576158 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 173 time used for this insertion : 0.02280879020690918 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 173 time used for this insertion : 0.03865480422973633 save missing photos in datou_result : time spend for datou_step_exec : 40.301594257354736 time spend to save output : 0.06766700744628906 total time spend for step 6 : 40.369261264801025 step7:brightness Tue May 27 02:05:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6.jpg treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff.jpg treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df.jpg treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1.jpg treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051.jpg treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654.jpg treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859.jpg treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea.jpg treat image : temp/1748303427_2420083_1360618995_9de072533654e630c957f021fac39dab.jpg treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25.jpg treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647153_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647148_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647149_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647156_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647159_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647164_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647161_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647168_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647158_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647163_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647155_0.png treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647170_0.png treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647179_0.png treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647176_0.png treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647169_0.png treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647184_0.png treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647172_0.png treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647177_0.png treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647183_0.png treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647174_0.png treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647189_0.png treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647196_0.png treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647190_0.png treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647197_0.png treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647187_0.png treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647191_0.png treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647198_0.png treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647186_0.png treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647185_0.png treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647188_0.png treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647199_0.png treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647205_0.png treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647207_0.png treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647202_0.png treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647200_0.png treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647213_0.png treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647208_0.png treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647201_0.png treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647211_0.png treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647206_0.png treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647218_0.png treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647216_0.png treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647222_0.png treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647221_0.png treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647215_0.png treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647219_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647232_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647241_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647236_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647247_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647249_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647240_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647245_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647251_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647233_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647243_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647244_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647234_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647242_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647235_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647231_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647229_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647248_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647246_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647237_0.png treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647253_0.png treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647257_0.png treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647261_0.png treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647265_0.png treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647255_0.png treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647266_0.png treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647264_0.png treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647258_0.png treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647259_0.png treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647262_0.png treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647254_0.png treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647276_0.png treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647281_0.png treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647272_0.png treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647283_0.png treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647273_0.png treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647277_0.png treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647269_0.png treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647270_0.png treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647279_0.png treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647268_0.png treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647274_0.png treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647275_0.png treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647280_0.png treat image : temp/1748303427_2420083_1360618995_9de072533654e630c957f021fac39dab_rle_crop_3813647292_0.png treat image : temp/1748303427_2420083_1360618995_9de072533654e630c957f021fac39dab_rle_crop_3813647286_0.png treat image : temp/1748303427_2420083_1360618995_9de072533654e630c957f021fac39dab_rle_crop_3813647293_0.png treat image : temp/1748303427_2420083_1360618995_9de072533654e630c957f021fac39dab_rle_crop_3813647288_0.png treat image : temp/1748303427_2420083_1360618995_9de072533654e630c957f021fac39dab_rle_crop_3813647294_0.png treat image : temp/1748303427_2420083_1360618995_9de072533654e630c957f021fac39dab_rle_crop_3813647291_0.png treat image : temp/1748303427_2420083_1360618995_9de072533654e630c957f021fac39dab_rle_crop_3813647290_0.png treat image : temp/1748303427_2420083_1360618995_9de072533654e630c957f021fac39dab_rle_crop_3813647285_0.png treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647305_0.png treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647304_0.png treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647296_0.png treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647299_0.png treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647297_0.png treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647295_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647145_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647167_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647146_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647154_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647151_0.png treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647195_0.png treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647204_0.png treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647203_0.png treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647210_0.png treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647209_0.png treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647225_0.png treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647226_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647238_0.png treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647263_0.png treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647284_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647160_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647157_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647165_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647166_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647152_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647147_0.png treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647178_0.png treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647180_0.png treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647171_0.png treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647173_0.png treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647182_0.png treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647181_0.png treat image : temp/1748303427_2420083_1360650860_ae8817af23c7409d11cfa361b7a1ddff_rle_crop_3813647175_0.png treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647194_0.png treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647193_0.png treat image : temp/1748303427_2420083_1360650811_5643d0bb5e4b8f6b059d5c3c537d38df_rle_crop_3813647192_0.png treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647214_0.png treat image : temp/1748303427_2420083_1360650745_96743becee64a999935e8466e58a15e1_rle_crop_3813647212_0.png treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647223_0.png treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647220_0.png treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647227_0.png treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647224_0.png treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647228_0.png treat image : temp/1748303427_2420083_1360650697_e250d2e3d093bac62e877451af83e051_rle_crop_3813647217_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647239_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647252_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647230_0.png treat image : temp/1748303427_2420083_1360650355_f0dc9c7a5494190f68dc63915b0c0654_rle_crop_3813647250_0.png treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647256_0.png treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647260_0.png treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647282_0.png treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647271_0.png treat image : temp/1748303427_2420083_1360619053_5fccd141a991d349c922b5670d54ddea_rle_crop_3813647278_0.png treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647302_0.png treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647303_0.png treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647298_0.png treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647301_0.png treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647307_0.png treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647306_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647162_0.png treat image : temp/1748303427_2420083_1360619057_429e42035cb6122b117fc9ff77030859_rle_crop_3813647267_0.png treat image : temp/1748303427_2420083_1360618995_9de072533654e630c957f021fac39dab_rle_crop_3813647287_0.png treat image : temp/1748303427_2420083_1360618995_9de072533654e630c957f021fac39dab_rle_crop_3813647289_0.png treat image : temp/1748303427_2420083_1360650917_c50faa6c54fd629b4115c1d686c48da6_rle_crop_3813647150_0.png treat image : temp/1748303427_2420083_1360618963_ba35b8a9aebf6c3d343567eb135efc25_rle_crop_3813647300_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 173 time used for this insertion : 0.02675032615661621 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 173 time used for this insertion : 0.03647160530090332 save missing photos in datou_result : time spend for datou_step_exec : 9.59187388420105 time spend to save output : 0.06875753402709961 total time spend for step 7 : 9.66063141822815 step8:velours_tree Tue May 27 02:05:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.5552115440368652 time spend to save output : 4.76837158203125e-05 total time spend for step 8 : 1.5552592277526855 step9:send_mail_cod Tue May 27 02:05:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23360447_27-05-2025_02_05_28.pdf 23362531 change filename to text .imagette233625311748304328 23362532 change filename to text .change filename to text .imagette233625321748304328 23362533 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233625331748304328 23362534 change filename to text .imagette233625341748304329 23362535 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233625351748304329 23362536 imagette233625361748304330 23362537 imagette233625371748304330 23362538 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233625381748304330 23362539 change filename to text .change filename to text .change filename to text .change filename to text .imagette233625391748304332 23362540 imagette233625401748304332 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23360447 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23362531,23362532,23362533,23362534,23362535,23362536,23362537,23362538,23362539,23362540,23362541?tags=pet_fonce,metal,carton,pehd,pet_clair,mal_croppe,flou,papier,autre,background,environnement args[1360650917] : ((1360650917, -2.0591786893726165, 492609224), (1360650917, -0.05242610864285654, 2107752395), '0.12786587406953517') We are sending mail with results at report@fotonower.com args[1360650860] : ((1360650860, -0.8254158477366437, 492688767), (1360650860, 0.03153844923298671, 2107752395), '0.12786587406953517') We are sending mail with results at report@fotonower.com args[1360650811] : ((1360650811, -1.5440270484828134, 492688767), (1360650811, -0.1964906352644761, 496442774), '0.12786587406953517') We are sending mail with results at report@fotonower.com args[1360650745] : ((1360650745, -3.3710868745208664, 492609224), (1360650745, 0.07319863570269984, 2107752395), '0.12786587406953517') We are sending mail with results at report@fotonower.com args[1360650697] : ((1360650697, 2.708812850250153, 492688767), (1360650697, 0.18830662552829883, 2107752395), '0.12786587406953517') We are sending mail with results at report@fotonower.com args[1360650355] : ((1360650355, -2.0376567980790647, 492609224), (1360650355, -0.17065158237028483, 496442774), '0.12786587406953517') We are sending mail with results at report@fotonower.com args[1360619057] : ((1360619057, -3.656345260481571, 492609224), (1360619057, 0.043559322169402115, 2107752395), '0.12786587406953517') We are sending mail with results at report@fotonower.com args[1360619053] : ((1360619053, -2.6541935312560563, 492609224), (1360619053, -0.33248352969927425, 496442774), '0.12786587406953517') We are sending mail with results at report@fotonower.com args[1360618995] : ((1360618995, -3.1753711714811326, 492609224), (1360618995, 0.11474501087853399, 2107752395), '0.12786587406953517') We are sending mail with results at report@fotonower.com args[1360618963] : ((1360618963, -0.0633206511903287, 492688767), (1360618963, -0.10453075566864149, 496442774), '0.12786587406953517') We are sending mail with results at report@fotonower.com refus_total : 0.12786587406953517 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23360447 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23360447_27-05-2025_02_05_28.pdf results_Auto_P23360447_27-05-2025_02_05_28.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23360447_27-05-2025_02_05_28.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23360447','results_Auto_P23360447_27-05-2025_02_05_28.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23360447_27-05-2025_02_05_28.pdf','pdf','','0.7','0.12786587406953517') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23360447

https://www.fotonower.com/image?json=false&list_photos_id=1360650917
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360650860
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360650811
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360650745
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360650697
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.708812850250153)
https://www.fotonower.com/image?json=false&list_photos_id=1360650355
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360619057
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360619053
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360618995
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360618963
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 12.79%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23362531?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/23362532?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23362533?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/23362534?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23362535?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23362538?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23362539?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23360447_27-05-2025_02_05_28.pdf.

Lien vers velours :https://www.fotonower.com/velours/23362531,23362532,23362533,23362534,23362535,23362536,23362537,23362538,23362539,23362540,23362541?tags=pet_fonce,metal,carton,pehd,pet_clair,mal_croppe,flou,papier,autre,background,environnement.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 27 May 2025 00:05:35 GMT Content-Length: 0 Connection: close X-Message-Id: A3wV5zjiSu6IJIrVGJzdAQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1360650917, 1360650860, 1360650811, 1360650745, 1360650697, 1360650355, 1360619057, 1360619053, 1360618995, 1360618963] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650917', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650860', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650811', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650745', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650697', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650355', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360619057', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360619053', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360618995', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360618963', None, None, None, None, None, '2961020') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.016551733016967773 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.83448052406311 time spend to save output : 0.01683807373046875 total time spend for step 9 : 6.851318597793579 step10:split_time_score Tue May 27 02:05:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('19', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 22052025 23360447 Nombre de photos uploadées : 10 / 23040 (0%) 22052025 23360447 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 22052025 23360447 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 3.337860107421875e-06 elapsed_time : order_list_meta_photo_and_scores 1.2159347534179688e-05 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005667209625244141 elapsed_time : insert_dashboard_record_day_entry 0.03672480583190918 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.12898913724922847 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23263226_22-05-2025_11_15_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23263226 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23263226 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23360420 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23267925 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23265122 order by id desc limit 1 Qualite : 0.1383823290524787 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23269440_26-05-2025_11_33_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23269440 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23269440 AND mptpi.`type`=3594 To do Qualite : 0.156928577372307 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23267928_22-05-2025_13_48_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23267928 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23267928 AND mptpi.`type`=3594 To do Qualite : 0.13890153030251456 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23267932_22-05-2025_13_34_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23267932 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23267932 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23360434 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23360436 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23360438 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23360445 order by id desc limit 1 Qualite : 0.12786587406953517 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23360447_27-05-2025_02_05_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23360447 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23360447 AND mptpi.`type`=3594 To do Qualite : 0.12451613349332791 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23360449_27-05-2025_01_34_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23360449 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23360449 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'22052025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1360650917, 1360650860, 1360650811, 1360650745, 1360650697, 1360650355, 1360619057, 1360619053, 1360618995, 1360618963] Looping around the photos to save general results len do output : 1 /23360447Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650917', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650860', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650811', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650745', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650697', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360650355', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360619057', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360619053', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360618995', None, None, None, None, None, '2961020') ('3318', None, None, None, None, None, None, None, '2961020') ('3318', '23360447', '1360618963', None, None, None, None, None, '2961020') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.015677690505981445 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.741278409957886 time spend to save output : 0.015912294387817383 total time spend for step 10 : 6.757190704345703 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 145.29user 119.87system 15:16.65elapsed 28%CPU (0avgtext+0avgdata 5562336maxresident)k 777296inputs+88456outputs (15505major+14052817minor)pagefaults 0swaps