python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1222436 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2856068'] with mtr_portfolio_ids : ['22989039'] and first list_photo_ids : [] new path : /proc/1222436/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 13 ; length of list_pids : 13 ; length of list_args : 13 time to download the photos : 2.139035701751709 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu May 15 02:20:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 9621 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-15 02:20:33.554715: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-15 02:20:33.583062: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-15 02:20:33.585173: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fd96c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-15 02:20:33.585230: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-15 02:20:33.589387: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-15 02:20:33.835069: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2b0758a0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-15 02:20:33.835130: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-15 02:20:33.836390: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-15 02:20:33.836865: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-15 02:20:33.841574: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-15 02:20:33.844682: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-15 02:20:33.845460: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-15 02:20:33.848423: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-15 02:20:33.849962: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-15 02:20:33.855089: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-15 02:20:33.856624: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-15 02:20:33.856729: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-15 02:20:33.857469: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-15 02:20:33.857486: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-15 02:20:33.857495: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-15 02:20:33.858784: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8901 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-15 02:20:34.173551: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-15 02:20:34.173686: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-15 02:20:34.173717: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-15 02:20:34.173746: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-15 02:20:34.173773: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-15 02:20:34.173799: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-15 02:20:34.173824: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-15 02:20:34.173851: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-15 02:20:34.176077: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-15 02:20:34.177305: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-15 02:20:34.177338: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-15 02:20:34.177357: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-15 02:20:34.177371: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-15 02:20:34.177385: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-15 02:20:34.177399: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-15 02:20:34.177413: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-15 02:20:34.177427: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-15 02:20:34.178613: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-15 02:20:34.178646: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-15 02:20:34.178654: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-15 02:20:34.178661: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-15 02:20:34.179852: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8901 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-15 02:20:45.329132: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-15 02:20:45.544145: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 13 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 48 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 10.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 Detection mask done ! Trying to reset tf kernel 1223031 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3139 tf kernel not reseted sub process len(results) : 13 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 13 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 8428 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0031707286834716797 nb_pixel_total : 101546 time to create 1 rle with old method : 0.15723609924316406 length of segment : 297 time for calcul the mask position with numpy : 0.0007610321044921875 nb_pixel_total : 49164 time to create 1 rle with old method : 0.05570077896118164 length of segment : 229 time for calcul the mask position with numpy : 0.0017600059509277344 nb_pixel_total : 81533 time to create 1 rle with old method : 0.09880995750427246 length of segment : 307 time for calcul the mask position with numpy : 0.0023140907287597656 nb_pixel_total : 99552 time to create 1 rle with old method : 0.11426353454589844 length of segment : 609 time for calcul the mask position with numpy : 0.0004737377166748047 nb_pixel_total : 18287 time to create 1 rle with old method : 0.021546125411987305 length of segment : 229 time for calcul the mask position with numpy : 0.000316619873046875 nb_pixel_total : 11956 time to create 1 rle with old method : 0.013927936553955078 length of segment : 142 time for calcul the mask position with numpy : 0.0002837181091308594 nb_pixel_total : 9756 time to create 1 rle with old method : 0.011793136596679688 length of segment : 123 time for calcul the mask position with numpy : 0.0001895427703857422 nb_pixel_total : 10159 time to create 1 rle with old method : 0.012308359146118164 length of segment : 86 time for calcul the mask position with numpy : 0.0002028942108154297 nb_pixel_total : 9645 time to create 1 rle with old method : 0.011815786361694336 length of segment : 90 time for calcul the mask position with numpy : 0.00021600723266601562 nb_pixel_total : 10561 time to create 1 rle with old method : 0.012454986572265625 length of segment : 180 time for calcul the mask position with numpy : 0.024272680282592773 nb_pixel_total : 383288 time to create 1 rle with new method : 0.03210926055908203 length of segment : 744 time for calcul the mask position with numpy : 0.003761768341064453 nb_pixel_total : 180944 time to create 1 rle with new method : 0.016100168228149414 length of segment : 603 time for calcul the mask position with numpy : 0.003303050994873047 nb_pixel_total : 164586 time to create 1 rle with new method : 0.013811349868774414 length of segment : 762 time for calcul the mask position with numpy : 0.002734661102294922 nb_pixel_total : 143209 time to create 1 rle with old method : 0.16614770889282227 length of segment : 630 time for calcul the mask position with numpy : 0.0014040470123291016 nb_pixel_total : 69760 time to create 1 rle with old method : 0.08657670021057129 length of segment : 327 time for calcul the mask position with numpy : 0.00047779083251953125 nb_pixel_total : 22229 time to create 1 rle with old method : 0.026189088821411133 length of segment : 132 time for calcul the mask position with numpy : 0.0035648345947265625 nb_pixel_total : 210344 time to create 1 rle with new method : 0.013116598129272461 length of segment : 337 time for calcul the mask position with numpy : 0.0009770393371582031 nb_pixel_total : 40004 time to create 1 rle with old method : 0.05256009101867676 length of segment : 178 time for calcul the mask position with numpy : 0.00558781623840332 nb_pixel_total : 268273 time to create 1 rle with new method : 0.020303726196289062 length of segment : 739 time for calcul the mask position with numpy : 0.0006101131439208984 nb_pixel_total : 24813 time to create 1 rle with old method : 0.02887272834777832 length of segment : 182 time for calcul the mask position with numpy : 0.0023059844970703125 nb_pixel_total : 137499 time to create 1 rle with old method : 0.1537642478942871 length of segment : 464 time for calcul the mask position with numpy : 0.0013227462768554688 nb_pixel_total : 82780 time to create 1 rle with old method : 0.09921789169311523 length of segment : 470 time for calcul the mask position with numpy : 0.0007283687591552734 nb_pixel_total : 46818 time to create 1 rle with old method : 0.05408191680908203 length of segment : 223 time for calcul the mask position with numpy : 0.004957675933837891 nb_pixel_total : 287201 time to create 1 rle with new method : 0.054225921630859375 length of segment : 330 time for calcul the mask position with numpy : 0.007022857666015625 nb_pixel_total : 248711 time to create 1 rle with new method : 0.02244424819946289 length of segment : 735 time for calcul the mask position with numpy : 0.0019598007202148438 nb_pixel_total : 22087 time to create 1 rle with old method : 0.027523279190063477 length of segment : 356 time for calcul the mask position with numpy : 0.006258487701416016 nb_pixel_total : 122015 time to create 1 rle with old method : 0.13959622383117676 length of segment : 655 time for calcul the mask position with numpy : 0.010771036148071289 nb_pixel_total : 292517 time to create 1 rle with new method : 0.04322624206542969 length of segment : 796 time for calcul the mask position with numpy : 0.0005984306335449219 nb_pixel_total : 30013 time to create 1 rle with old method : 0.04655265808105469 length of segment : 193 time for calcul the mask position with numpy : 0.001352548599243164 nb_pixel_total : 51049 time to create 1 rle with old method : 0.06174039840698242 length of segment : 277 time for calcul the mask position with numpy : 0.0023953914642333984 nb_pixel_total : 80727 time to create 1 rle with old method : 0.0915076732635498 length of segment : 341 time for calcul the mask position with numpy : 0.007444620132446289 nb_pixel_total : 173194 time to create 1 rle with new method : 0.017703533172607422 length of segment : 670 time for calcul the mask position with numpy : 0.0008194446563720703 nb_pixel_total : 18268 time to create 1 rle with old method : 0.023825407028198242 length of segment : 135 time for calcul the mask position with numpy : 0.0015683174133300781 nb_pixel_total : 38585 time to create 1 rle with old method : 0.04505109786987305 length of segment : 258 time for calcul the mask position with numpy : 0.0012049674987792969 nb_pixel_total : 28613 time to create 1 rle with old method : 0.03248882293701172 length of segment : 232 time for calcul the mask position with numpy : 0.0036711692810058594 nb_pixel_total : 94215 time to create 1 rle with old method : 0.10661983489990234 length of segment : 447 time for calcul the mask position with numpy : 0.0021178722381591797 nb_pixel_total : 57631 time to create 1 rle with old method : 0.06549358367919922 length of segment : 303 time for calcul the mask position with numpy : 0.0029120445251464844 nb_pixel_total : 72141 time to create 1 rle with old method : 0.08457708358764648 length of segment : 278 time for calcul the mask position with numpy : 0.0004181861877441406 nb_pixel_total : 9258 time to create 1 rle with old method : 0.010878324508666992 length of segment : 90 time for calcul the mask position with numpy : 0.0005064010620117188 nb_pixel_total : 10403 time to create 1 rle with old method : 0.012173175811767578 length of segment : 139 time for calcul the mask position with numpy : 0.0006718635559082031 nb_pixel_total : 13958 time to create 1 rle with old method : 0.01658487319946289 length of segment : 146 time for calcul the mask position with numpy : 0.0010170936584472656 nb_pixel_total : 24104 time to create 1 rle with old method : 0.027727842330932617 length of segment : 199 time for calcul the mask position with numpy : 0.0011053085327148438 nb_pixel_total : 19243 time to create 1 rle with old method : 0.02200174331665039 length of segment : 258 time for calcul the mask position with numpy : 0.0012149810791015625 nb_pixel_total : 29657 time to create 1 rle with old method : 0.03476428985595703 length of segment : 220 time for calcul the mask position with numpy : 0.001325368881225586 nb_pixel_total : 27384 time to create 1 rle with old method : 0.032000064849853516 length of segment : 226 time for calcul the mask position with numpy : 0.0033054351806640625 nb_pixel_total : 59651 time to create 1 rle with old method : 0.06769418716430664 length of segment : 304 time for calcul the mask position with numpy : 0.0014278888702392578 nb_pixel_total : 27181 time to create 1 rle with old method : 0.031786441802978516 length of segment : 186 time for calcul the mask position with numpy : 0.0008475780487060547 nb_pixel_total : 14724 time to create 1 rle with old method : 0.017543315887451172 length of segment : 142 time for calcul the mask position with numpy : 0.0023784637451171875 nb_pixel_total : 35128 time to create 1 rle with old method : 0.04215550422668457 length of segment : 261 time for calcul the mask position with numpy : 0.0006589889526367188 nb_pixel_total : 10496 time to create 1 rle with old method : 0.012539863586425781 length of segment : 279 time for calcul the mask position with numpy : 0.0009033679962158203 nb_pixel_total : 19470 time to create 1 rle with old method : 0.022906064987182617 length of segment : 144 time for calcul the mask position with numpy : 0.003032684326171875 nb_pixel_total : 68270 time to create 1 rle with old method : 0.07771086692810059 length of segment : 458 time for calcul the mask position with numpy : 0.0032486915588378906 nb_pixel_total : 69133 time to create 1 rle with old method : 0.079315185546875 length of segment : 421 time for calcul the mask position with numpy : 0.001033782958984375 nb_pixel_total : 22682 time to create 1 rle with old method : 0.02663588523864746 length of segment : 227 time for calcul the mask position with numpy : 0.0021219253540039062 nb_pixel_total : 36953 time to create 1 rle with old method : 0.04307842254638672 length of segment : 262 time for calcul the mask position with numpy : 0.002036571502685547 nb_pixel_total : 42487 time to create 1 rle with old method : 0.04878687858581543 length of segment : 285 time for calcul the mask position with numpy : 0.003154277801513672 nb_pixel_total : 85405 time to create 1 rle with old method : 0.09936928749084473 length of segment : 347 time for calcul the mask position with numpy : 0.002362489700317383 nb_pixel_total : 44871 time to create 1 rle with old method : 0.05219531059265137 length of segment : 265 time for calcul the mask position with numpy : 0.0006928443908691406 nb_pixel_total : 19717 time to create 1 rle with old method : 0.02501678466796875 length of segment : 172 time for calcul the mask position with numpy : 0.0026412010192871094 nb_pixel_total : 47190 time to create 1 rle with old method : 0.05376696586608887 length of segment : 276 time for calcul the mask position with numpy : 0.0005326271057128906 nb_pixel_total : 9521 time to create 1 rle with old method : 0.01207876205444336 length of segment : 108 time for calcul the mask position with numpy : 0.0010561943054199219 nb_pixel_total : 16694 time to create 1 rle with old method : 0.022224903106689453 length of segment : 122 time for calcul the mask position with numpy : 0.0007109642028808594 nb_pixel_total : 11756 time to create 1 rle with old method : 0.013701200485229492 length of segment : 156 time for calcul the mask position with numpy : 0.001033782958984375 nb_pixel_total : 22204 time to create 1 rle with old method : 0.025568723678588867 length of segment : 196 time for calcul the mask position with numpy : 0.00141143798828125 nb_pixel_total : 21414 time to create 1 rle with old method : 0.0273129940032959 length of segment : 109 time for calcul the mask position with numpy : 0.0006113052368164062 nb_pixel_total : 10707 time to create 1 rle with old method : 0.012599468231201172 length of segment : 143 time for calcul the mask position with numpy : 0.0037751197814941406 nb_pixel_total : 75603 time to create 1 rle with old method : 0.08628129959106445 length of segment : 396 time for calcul the mask position with numpy : 0.0011782646179199219 nb_pixel_total : 20299 time to create 1 rle with old method : 0.02321910858154297 length of segment : 233 time for calcul the mask position with numpy : 0.001878499984741211 nb_pixel_total : 43203 time to create 1 rle with old method : 0.04894733428955078 length of segment : 284 time for calcul the mask position with numpy : 0.0008654594421386719 nb_pixel_total : 16813 time to create 1 rle with old method : 0.019526958465576172 length of segment : 196 time for calcul the mask position with numpy : 0.0007452964782714844 nb_pixel_total : 15462 time to create 1 rle with old method : 0.017831087112426758 length of segment : 207 time for calcul the mask position with numpy : 0.0008518695831298828 nb_pixel_total : 19541 time to create 1 rle with old method : 0.022230863571166992 length of segment : 191 time for calcul the mask position with numpy : 0.001621246337890625 nb_pixel_total : 47027 time to create 1 rle with old method : 0.05350637435913086 length of segment : 259 time for calcul the mask position with numpy : 0.00037384033203125 nb_pixel_total : 5664 time to create 1 rle with old method : 0.006846427917480469 length of segment : 93 time for calcul the mask position with numpy : 0.0010638236999511719 nb_pixel_total : 26385 time to create 1 rle with old method : 0.0439152717590332 length of segment : 216 time for calcul the mask position with numpy : 0.002185821533203125 nb_pixel_total : 64256 time to create 1 rle with old method : 0.07333040237426758 length of segment : 263 time for calcul the mask position with numpy : 0.0013575553894042969 nb_pixel_total : 26647 time to create 1 rle with old method : 0.031522274017333984 length of segment : 221 time for calcul the mask position with numpy : 0.0003533363342285156 nb_pixel_total : 3667 time to create 1 rle with old method : 0.004660367965698242 length of segment : 68 time for calcul the mask position with numpy : 0.0004742145538330078 nb_pixel_total : 10607 time to create 1 rle with old method : 0.012468099594116211 length of segment : 105 time for calcul the mask position with numpy : 0.00043892860412597656 nb_pixel_total : 10724 time to create 1 rle with old method : 0.013067483901977539 length of segment : 118 time for calcul the mask position with numpy : 0.0011789798736572266 nb_pixel_total : 20889 time to create 1 rle with old method : 0.02515697479248047 length of segment : 161 time for calcul the mask position with numpy : 0.0012710094451904297 nb_pixel_total : 28463 time to create 1 rle with old method : 0.03419017791748047 length of segment : 284 time for calcul the mask position with numpy : 0.0003325939178466797 nb_pixel_total : 6818 time to create 1 rle with old method : 0.008141517639160156 length of segment : 100 time for calcul the mask position with numpy : 0.001325845718383789 nb_pixel_total : 35753 time to create 1 rle with old method : 0.041501760482788086 length of segment : 181 time for calcul the mask position with numpy : 0.001249551773071289 nb_pixel_total : 26708 time to create 1 rle with old method : 0.030591726303100586 length of segment : 249 time for calcul the mask position with numpy : 0.0007927417755126953 nb_pixel_total : 17973 time to create 1 rle with old method : 0.02104926109313965 length of segment : 152 time for calcul the mask position with numpy : 0.0008094310760498047 nb_pixel_total : 19309 time to create 1 rle with old method : 0.02266979217529297 length of segment : 187 time for calcul the mask position with numpy : 0.0005946159362792969 nb_pixel_total : 13125 time to create 1 rle with old method : 0.015395879745483398 length of segment : 137 time for calcul the mask position with numpy : 0.0009455680847167969 nb_pixel_total : 19670 time to create 1 rle with old method : 0.02336740493774414 length of segment : 163 time for calcul the mask position with numpy : 0.0007193088531494141 nb_pixel_total : 16473 time to create 1 rle with old method : 0.019268512725830078 length of segment : 184 time for calcul the mask position with numpy : 0.0009438991546630859 nb_pixel_total : 16397 time to create 1 rle with old method : 0.028679847717285156 length of segment : 121 time for calcul the mask position with numpy : 0.0034809112548828125 nb_pixel_total : 75797 time to create 1 rle with old method : 0.09041762351989746 length of segment : 544 time for calcul the mask position with numpy : 0.0013117790222167969 nb_pixel_total : 3507 time to create 1 rle with old method : 0.004679679870605469 length of segment : 144 time for calcul the mask position with numpy : 0.004323244094848633 nb_pixel_total : 122997 time to create 1 rle with old method : 0.13853979110717773 length of segment : 425 time for calcul the mask position with numpy : 0.001422882080078125 nb_pixel_total : 40882 time to create 1 rle with old method : 0.04626297950744629 length of segment : 196 time for calcul the mask position with numpy : 0.0009326934814453125 nb_pixel_total : 17053 time to create 1 rle with old method : 0.01972222328186035 length of segment : 180 time for calcul the mask position with numpy : 0.0003790855407714844 nb_pixel_total : 7803 time to create 1 rle with old method : 0.009386301040649414 length of segment : 89 time for calcul the mask position with numpy : 0.0008726119995117188 nb_pixel_total : 14250 time to create 1 rle with old method : 0.01784038543701172 length of segment : 138 time for calcul the mask position with numpy : 0.0010619163513183594 nb_pixel_total : 24681 time to create 1 rle with old method : 0.02852630615234375 length of segment : 296 time for calcul the mask position with numpy : 0.0011219978332519531 nb_pixel_total : 30248 time to create 1 rle with old method : 0.034296512603759766 length of segment : 267 time for calcul the mask position with numpy : 0.0005285739898681641 nb_pixel_total : 7734 time to create 1 rle with old method : 0.009037256240844727 length of segment : 155 time for calcul the mask position with numpy : 0.004245281219482422 nb_pixel_total : 132297 time to create 1 rle with old method : 0.15372061729431152 length of segment : 434 time for calcul the mask position with numpy : 0.002532958984375 nb_pixel_total : 60848 time to create 1 rle with old method : 0.06989860534667969 length of segment : 597 time for calcul the mask position with numpy : 0.002454519271850586 nb_pixel_total : 64750 time to create 1 rle with old method : 0.07350683212280273 length of segment : 386 time for calcul the mask position with numpy : 0.0015337467193603516 nb_pixel_total : 30159 time to create 1 rle with old method : 0.03441500663757324 length of segment : 280 time for calcul the mask position with numpy : 0.0024192333221435547 nb_pixel_total : 84329 time to create 1 rle with old method : 0.09648799896240234 length of segment : 297 time for calcul the mask position with numpy : 0.0011479854583740234 nb_pixel_total : 31888 time to create 1 rle with old method : 0.03643989562988281 length of segment : 179 time for calcul the mask position with numpy : 0.0007517337799072266 nb_pixel_total : 21409 time to create 1 rle with old method : 0.024808883666992188 length of segment : 140 time for calcul the mask position with numpy : 0.0026099681854248047 nb_pixel_total : 83560 time to create 1 rle with old method : 0.0959322452545166 length of segment : 516 time for calcul the mask position with numpy : 0.0010886192321777344 nb_pixel_total : 32172 time to create 1 rle with old method : 0.03796124458312988 length of segment : 263 time for calcul the mask position with numpy : 0.0019083023071289062 nb_pixel_total : 51959 time to create 1 rle with old method : 0.059354543685913086 length of segment : 266 time for calcul the mask position with numpy : 0.002641916275024414 nb_pixel_total : 79147 time to create 1 rle with old method : 0.08882498741149902 length of segment : 371 time for calcul the mask position with numpy : 0.0015187263488769531 nb_pixel_total : 33948 time to create 1 rle with old method : 0.03897500038146973 length of segment : 233 time for calcul the mask position with numpy : 0.0009539127349853516 nb_pixel_total : 28268 time to create 1 rle with old method : 0.03201127052307129 length of segment : 155 time for calcul the mask position with numpy : 0.0015606880187988281 nb_pixel_total : 41345 time to create 1 rle with old method : 0.046193838119506836 length of segment : 195 time for calcul the mask position with numpy : 0.0009670257568359375 nb_pixel_total : 26229 time to create 1 rle with old method : 0.028807640075683594 length of segment : 201 time for calcul the mask position with numpy : 0.0016894340515136719 nb_pixel_total : 38912 time to create 1 rle with old method : 0.04512667655944824 length of segment : 266 time for calcul the mask position with numpy : 0.0002968311309814453 nb_pixel_total : 7172 time to create 1 rle with old method : 0.008263826370239258 length of segment : 95 time for calcul the mask position with numpy : 0.0014083385467529297 nb_pixel_total : 38656 time to create 1 rle with old method : 0.04258894920349121 length of segment : 203 time for calcul the mask position with numpy : 0.00022530555725097656 nb_pixel_total : 4447 time to create 1 rle with old method : 0.0053174495697021484 length of segment : 75 time for calcul the mask position with numpy : 0.001871347427368164 nb_pixel_total : 34571 time to create 1 rle with old method : 0.03961610794067383 length of segment : 396 time for calcul the mask position with numpy : 0.0012674331665039062 nb_pixel_total : 26427 time to create 1 rle with old method : 0.030613422393798828 length of segment : 262 time for calcul the mask position with numpy : 0.004152536392211914 nb_pixel_total : 103407 time to create 1 rle with old method : 0.11730504035949707 length of segment : 332 time for calcul the mask position with numpy : 0.0036149024963378906 nb_pixel_total : 111223 time to create 1 rle with old method : 0.1255178451538086 length of segment : 411 time for calcul the mask position with numpy : 0.001898050308227539 nb_pixel_total : 38132 time to create 1 rle with old method : 0.046854257583618164 length of segment : 223 time for calcul the mask position with numpy : 0.0006623268127441406 nb_pixel_total : 14761 time to create 1 rle with old method : 0.017175674438476562 length of segment : 204 time for calcul the mask position with numpy : 0.000762939453125 nb_pixel_total : 25342 time to create 1 rle with old method : 0.029876708984375 length of segment : 168 time for calcul the mask position with numpy : 0.0004086494445800781 nb_pixel_total : 5373 time to create 1 rle with old method : 0.006578922271728516 length of segment : 103 time for calcul the mask position with numpy : 0.0006699562072753906 nb_pixel_total : 9899 time to create 1 rle with old method : 0.01197052001953125 length of segment : 147 time for calcul the mask position with numpy : 0.0013663768768310547 nb_pixel_total : 19642 time to create 1 rle with old method : 0.0229947566986084 length of segment : 185 time for calcul the mask position with numpy : 0.004740238189697266 nb_pixel_total : 87621 time to create 1 rle with old method : 0.09984731674194336 length of segment : 416 time for calcul the mask position with numpy : 0.00128173828125 nb_pixel_total : 23962 time to create 1 rle with old method : 0.028255462646484375 length of segment : 234 time for calcul the mask position with numpy : 0.002515554428100586 nb_pixel_total : 74185 time to create 1 rle with old method : 0.08316779136657715 length of segment : 406 time for calcul the mask position with numpy : 0.002286672592163086 nb_pixel_total : 46275 time to create 1 rle with old method : 0.05255413055419922 length of segment : 376 time for calcul the mask position with numpy : 0.004160642623901367 nb_pixel_total : 131383 time to create 1 rle with old method : 0.14853787422180176 length of segment : 508 time for calcul the mask position with numpy : 0.0012433528900146484 nb_pixel_total : 27244 time to create 1 rle with old method : 0.03145790100097656 length of segment : 191 time for calcul the mask position with numpy : 0.0017020702362060547 nb_pixel_total : 38227 time to create 1 rle with old method : 0.04377865791320801 length of segment : 190 time for calcul the mask position with numpy : 0.0006358623504638672 nb_pixel_total : 19555 time to create 1 rle with old method : 0.022939443588256836 length of segment : 192 time for calcul the mask position with numpy : 0.0009071826934814453 nb_pixel_total : 27416 time to create 1 rle with old method : 0.03873634338378906 length of segment : 161 time for calcul the mask position with numpy : 0.0027294158935546875 nb_pixel_total : 56581 time to create 1 rle with old method : 0.07285261154174805 length of segment : 262 time for calcul the mask position with numpy : 0.0010902881622314453 nb_pixel_total : 32274 time to create 1 rle with old method : 0.037351131439208984 length of segment : 156 time for calcul the mask position with numpy : 0.002063274383544922 nb_pixel_total : 58973 time to create 1 rle with old method : 0.0693202018737793 length of segment : 212 time for calcul the mask position with numpy : 0.0013325214385986328 nb_pixel_total : 36950 time to create 1 rle with old method : 0.041872501373291016 length of segment : 270 time for calcul the mask position with numpy : 0.0006949901580810547 nb_pixel_total : 16417 time to create 1 rle with old method : 0.019074440002441406 length of segment : 171 time for calcul the mask position with numpy : 0.0008523464202880859 nb_pixel_total : 16650 time to create 1 rle with old method : 0.02198338508605957 length of segment : 91 time for calcul the mask position with numpy : 0.0007326602935791016 nb_pixel_total : 12121 time to create 1 rle with old method : 0.014854192733764648 length of segment : 115 time for calcul the mask position with numpy : 0.0006575584411621094 nb_pixel_total : 10543 time to create 1 rle with old method : 0.012738466262817383 length of segment : 116 time for calcul the mask position with numpy : 0.0018656253814697266 nb_pixel_total : 48440 time to create 1 rle with old method : 0.055999040603637695 length of segment : 249 time for calcul the mask position with numpy : 0.001306772232055664 nb_pixel_total : 29735 time to create 1 rle with old method : 0.034012556076049805 length of segment : 233 time for calcul the mask position with numpy : 0.0022208690643310547 nb_pixel_total : 57831 time to create 1 rle with old method : 0.06781268119812012 length of segment : 318 time for calcul the mask position with numpy : 0.0006754398345947266 nb_pixel_total : 13471 time to create 1 rle with old method : 0.015775680541992188 length of segment : 121 time for calcul the mask position with numpy : 0.0011737346649169922 nb_pixel_total : 27266 time to create 1 rle with old method : 0.03204822540283203 length of segment : 241 time for calcul the mask position with numpy : 0.0007212162017822266 nb_pixel_total : 16451 time to create 1 rle with old method : 0.019083023071289062 length of segment : 148 time for calcul the mask position with numpy : 0.0012323856353759766 nb_pixel_total : 19545 time to create 1 rle with old method : 0.02261495590209961 length of segment : 269 time for calcul the mask position with numpy : 0.0014352798461914062 nb_pixel_total : 35957 time to create 1 rle with old method : 0.04114985466003418 length of segment : 311 time for calcul the mask position with numpy : 0.0017652511596679688 nb_pixel_total : 36661 time to create 1 rle with old method : 0.04184436798095703 length of segment : 385 time for calcul the mask position with numpy : 0.004483938217163086 nb_pixel_total : 153848 time to create 1 rle with new method : 0.007787466049194336 length of segment : 466 time for calcul the mask position with numpy : 0.0011947154998779297 nb_pixel_total : 28383 time to create 1 rle with old method : 0.03225827217102051 length of segment : 221 time for calcul the mask position with numpy : 0.0006232261657714844 nb_pixel_total : 13697 time to create 1 rle with old method : 0.0159146785736084 length of segment : 123 time for calcul the mask position with numpy : 0.001779794692993164 nb_pixel_total : 28732 time to create 1 rle with old method : 0.03418922424316406 length of segment : 282 time for calcul the mask position with numpy : 0.0022568702697753906 nb_pixel_total : 67295 time to create 1 rle with old method : 0.0765984058380127 length of segment : 341 time for calcul the mask position with numpy : 0.001367807388305664 nb_pixel_total : 34798 time to create 1 rle with old method : 0.04062986373901367 length of segment : 336 time for calcul the mask position with numpy : 0.00025391578674316406 nb_pixel_total : 10645 time to create 1 rle with old method : 0.01303243637084961 length of segment : 145 time for calcul the mask position with numpy : 0.0018455982208251953 nb_pixel_total : 42295 time to create 1 rle with old method : 0.04822850227355957 length of segment : 308 time for calcul the mask position with numpy : 0.0018339157104492188 nb_pixel_total : 50226 time to create 1 rle with old method : 0.05721330642700195 length of segment : 225 time for calcul the mask position with numpy : 0.0008244514465332031 nb_pixel_total : 20601 time to create 1 rle with old method : 0.023880720138549805 length of segment : 174 time for calcul the mask position with numpy : 0.00041484832763671875 nb_pixel_total : 4851 time to create 1 rle with old method : 0.005962371826171875 length of segment : 110 time for calcul the mask position with numpy : 0.0004947185516357422 nb_pixel_total : 11391 time to create 1 rle with old method : 0.013506174087524414 length of segment : 129 time for calcul the mask position with numpy : 0.0004420280456542969 nb_pixel_total : 9567 time to create 1 rle with old method : 0.011586666107177734 length of segment : 103 time for calcul the mask position with numpy : 0.005684852600097656 nb_pixel_total : 225525 time to create 1 rle with new method : 0.012008905410766602 length of segment : 716 time for calcul the mask position with numpy : 0.0004987716674804688 nb_pixel_total : 11859 time to create 1 rle with old method : 0.013982772827148438 length of segment : 144 time for calcul the mask position with numpy : 0.0006854534149169922 nb_pixel_total : 18533 time to create 1 rle with old method : 0.021134138107299805 length of segment : 222 time for calcul the mask position with numpy : 0.0003783702850341797 nb_pixel_total : 6400 time to create 1 rle with old method : 0.0077397823333740234 length of segment : 168 time for calcul the mask position with numpy : 0.0003712177276611328 nb_pixel_total : 7355 time to create 1 rle with old method : 0.008744239807128906 length of segment : 116 time for calcul the mask position with numpy : 0.0013263225555419922 nb_pixel_total : 63074 time to create 1 rle with old method : 0.07216477394104004 length of segment : 173 time for calcul the mask position with numpy : 0.00063323974609375 nb_pixel_total : 11198 time to create 1 rle with old method : 0.013433694839477539 length of segment : 95 time for calcul the mask position with numpy : 0.0007278919219970703 nb_pixel_total : 13017 time to create 1 rle with old method : 0.015455007553100586 length of segment : 175 time for calcul the mask position with numpy : 0.0015881061553955078 nb_pixel_total : 35856 time to create 1 rle with old method : 0.04095864295959473 length of segment : 207 time for calcul the mask position with numpy : 0.001155853271484375 nb_pixel_total : 25456 time to create 1 rle with old method : 0.030655622482299805 length of segment : 146 time for calcul the mask position with numpy : 0.0014705657958984375 nb_pixel_total : 29660 time to create 1 rle with old method : 0.034897804260253906 length of segment : 229 time for calcul the mask position with numpy : 0.0010046958923339844 nb_pixel_total : 16915 time to create 1 rle with old method : 0.019893884658813477 length of segment : 170 time for calcul the mask position with numpy : 0.0020394325256347656 nb_pixel_total : 39521 time to create 1 rle with old method : 0.046122074127197266 length of segment : 232 time for calcul the mask position with numpy : 0.0031003952026367188 nb_pixel_total : 77864 time to create 1 rle with old method : 0.08787298202514648 length of segment : 519 time for calcul the mask position with numpy : 0.002611875534057617 nb_pixel_total : 66050 time to create 1 rle with old method : 0.0757596492767334 length of segment : 335 time for calcul the mask position with numpy : 0.002837657928466797 nb_pixel_total : 68578 time to create 1 rle with old method : 0.07951164245605469 length of segment : 289 time for calcul the mask position with numpy : 0.0003955364227294922 nb_pixel_total : 7675 time to create 1 rle with old method : 0.009003400802612305 length of segment : 141 time for calcul the mask position with numpy : 0.0005993843078613281 nb_pixel_total : 14636 time to create 1 rle with old method : 0.01782059669494629 length of segment : 117 time for calcul the mask position with numpy : 0.0025272369384765625 nb_pixel_total : 56171 time to create 1 rle with old method : 0.06480908393859863 length of segment : 521 time for calcul the mask position with numpy : 0.0007123947143554688 nb_pixel_total : 21580 time to create 1 rle with old method : 0.025037765502929688 length of segment : 204 time for calcul the mask position with numpy : 0.0014123916625976562 nb_pixel_total : 29825 time to create 1 rle with old method : 0.03413558006286621 length of segment : 220 time for calcul the mask position with numpy : 0.0012881755828857422 nb_pixel_total : 27965 time to create 1 rle with old method : 0.03232741355895996 length of segment : 209 time for calcul the mask position with numpy : 0.0006506443023681641 nb_pixel_total : 13539 time to create 1 rle with old method : 0.01584625244140625 length of segment : 107 time spent for convertir_results : 16.238651752471924 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 192 chid ids of type : 3594 Number RLEs to save : 49776 save missing photos in datou_result : time spend for datou_step_exec : 93.09558367729187 time spend to save output : 3.701803207397461 total time spend for step 1 : 96.79738688468933 step2:crop_condition Thu May 15 02:22:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 13 ! batch 1 Loaded 192 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 116 About to insert : list_path_to_insert length 116 new photo from crops ! About to upload 116 photos upload in portfolio : 3736932 init cache_photo without model_param we have 116 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747268551_1222436 we have uploaded 116 photos in the portfolio 3736932 time of upload the photos Elapsed time : 25.975944995880127 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 3736932 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747268583_1222436 we have uploaded 21 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.020107984542847 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747268591_1222436 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8382983207702637 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 50 About to insert : list_path_to_insert length 50 new photo from crops ! About to upload 50 photos upload in portfolio : 3736932 init cache_photo without model_param we have 50 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747268612_1222436 we have uploaded 50 photos in the portfolio 3736932 time of upload the photos Elapsed time : 12.658754587173462 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747268627_1222436 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0841014385223389 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1358317972, 1358317965, 1358317910, 1358317891, 1358317888, 1358317886, 1358317881, 1358315289, 1358315226, 1358315160, 1358315125, 1358315120, 1358315116] Looping around the photos to save general results len do output : 192 /1358398039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358398448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317972', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317965', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317910', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317891', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317888', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317886', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317881', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315289', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315226', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315160', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315125', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315120', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315116', None, None, None, None, None, '2856068') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 589 time used for this insertion : 0.06046915054321289 save_final save missing photos in datou_result : time spend for datou_step_exec : 100.32059621810913 time spend to save output : 0.16862273216247559 total time spend for step 2 : 100.4892189502716 step3:rle_unique_nms_with_priority Thu May 15 02:23:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 192 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 3.6638312339782715 time for calcul the mask position with numpy : 0.6557247638702393 nb_pixel_total : 6668287 time to create 1 rle with new method : 0.7537803649902344 time for calcul the mask position with numpy : 0.021509170532226562 nb_pixel_total : 10159 time to create 1 rle with old method : 0.011343002319335938 time for calcul the mask position with numpy : 0.0260012149810791 nb_pixel_total : 9756 time to create 1 rle with old method : 0.010898113250732422 time for calcul the mask position with numpy : 0.02355194091796875 nb_pixel_total : 11956 time to create 1 rle with old method : 0.013483285903930664 time for calcul the mask position with numpy : 0.02099919319152832 nb_pixel_total : 18287 time to create 1 rle with old method : 0.02048659324645996 time for calcul the mask position with numpy : 0.022797584533691406 nb_pixel_total : 99552 time to create 1 rle with old method : 0.10997462272644043 time for calcul the mask position with numpy : 0.021650314331054688 nb_pixel_total : 81533 time to create 1 rle with old method : 0.0928490161895752 time for calcul the mask position with numpy : 0.024563074111938477 nb_pixel_total : 49164 time to create 1 rle with old method : 0.05604672431945801 time for calcul the mask position with numpy : 0.026375770568847656 nb_pixel_total : 101546 time to create 1 rle with old method : 0.11950016021728516 create new chi : 2.0649380683898926 time to delete rle : 0.022154569625854492 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++Number RLEs to save : 6204 TO DO : save crop sub photo not yet done ! save time : 0.4788532257080078 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 5.423420667648315 time for calcul the mask position with numpy : 0.2616269588470459 nb_pixel_total : 5395461 time to create 1 rle with new method : 0.8696672916412354 time for calcul the mask position with numpy : 0.024870872497558594 nb_pixel_total : 134379 time to create 1 rle with old method : 0.16309738159179688 time for calcul the mask position with numpy : 0.030829429626464844 nb_pixel_total : 17557 time to create 1 rle with old method : 0.03256988525390625 time for calcul the mask position with numpy : 0.038098812103271484 nb_pixel_total : 268273 time to create 1 rle with new method : 0.7727935314178467 time for calcul the mask position with numpy : 0.022487163543701172 nb_pixel_total : 40004 time to create 1 rle with old method : 0.04469656944274902 time for calcul the mask position with numpy : 0.024304866790771484 nb_pixel_total : 210344 time to create 1 rle with new method : 0.6580569744110107 time for calcul the mask position with numpy : 0.02960062026977539 nb_pixel_total : 22229 time to create 1 rle with old method : 0.028268098831176758 time for calcul the mask position with numpy : 0.024988174438476562 nb_pixel_total : 69760 time to create 1 rle with old method : 0.07981348037719727 time for calcul the mask position with numpy : 0.022834062576293945 nb_pixel_total : 143209 time to create 1 rle with old method : 0.16104626655578613 time for calcul the mask position with numpy : 0.024399995803833008 nb_pixel_total : 164586 time to create 1 rle with new method : 0.7260937690734863 time for calcul the mask position with numpy : 0.02778482437133789 nb_pixel_total : 180944 time to create 1 rle with new method : 0.6563229560852051 time for calcul the mask position with numpy : 0.02554607391357422 nb_pixel_total : 383288 time to create 1 rle with new method : 1.2242507934570312 time for calcul the mask position with numpy : 0.021995067596435547 nb_pixel_total : 10561 time to create 1 rle with old method : 0.011785745620727539 time for calcul the mask position with numpy : 0.022122621536254883 nb_pixel_total : 9645 time to create 1 rle with old method : 0.010674715042114258 create new chi : 6.209633827209473 time to delete rle : 0.0016481876373291016 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 12696 TO DO : save crop sub photo not yet done ! save time : 1.0263924598693848 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 6.151751279830933 time for calcul the mask position with numpy : 0.6866693496704102 nb_pixel_total : 5613128 time to create 1 rle with new method : 0.6408891677856445 time for calcul the mask position with numpy : 0.023000478744506836 nb_pixel_total : 173194 time to create 1 rle with new method : 0.7078616619110107 time for calcul the mask position with numpy : 0.02367091178894043 nb_pixel_total : 80727 time to create 1 rle with old method : 0.09646034240722656 time for calcul the mask position with numpy : 0.023277759552001953 nb_pixel_total : 51049 time to create 1 rle with old method : 0.0571138858795166 time for calcul the mask position with numpy : 0.0238189697265625 nb_pixel_total : 30013 time to create 1 rle with old method : 0.03346085548400879 time for calcul the mask position with numpy : 0.024733781814575195 nb_pixel_total : 292517 time to create 1 rle with new method : 1.1380560398101807 time for calcul the mask position with numpy : 0.02359294891357422 nb_pixel_total : 122015 time to create 1 rle with old method : 0.1378929615020752 time for calcul the mask position with numpy : 0.02275824546813965 nb_pixel_total : 22087 time to create 1 rle with old method : 0.02451777458190918 time for calcul the mask position with numpy : 0.022742033004760742 nb_pixel_total : 248711 time to create 1 rle with new method : 0.38993144035339355 time for calcul the mask position with numpy : 0.02436542510986328 nb_pixel_total : 287201 time to create 1 rle with new method : 0.5684106349945068 time for calcul the mask position with numpy : 0.02313995361328125 nb_pixel_total : 46818 time to create 1 rle with old method : 0.05137276649475098 time for calcul the mask position with numpy : 0.021552562713623047 nb_pixel_total : 82780 time to create 1 rle with old method : 0.09042239189147949 create new chi : 5.017410755157471 time to delete rle : 0.0016033649444580078 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 12252 TO DO : save crop sub photo not yet done ! save time : 0.7844827175140381 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 5.550761938095093 time for calcul the mask position with numpy : 0.30608582496643066 nb_pixel_total : 6634164 time to create 1 rle with new method : 0.5655596256256104 time for calcul the mask position with numpy : 0.04557466506958008 nb_pixel_total : 29657 time to create 1 rle with old method : 0.03323245048522949 time for calcul the mask position with numpy : 0.03755521774291992 nb_pixel_total : 19243 time to create 1 rle with old method : 0.022393465042114258 time for calcul the mask position with numpy : 0.041367292404174805 nb_pixel_total : 24104 time to create 1 rle with old method : 0.03444695472717285 time for calcul the mask position with numpy : 0.03766012191772461 nb_pixel_total : 13958 time to create 1 rle with old method : 0.01625204086303711 time for calcul the mask position with numpy : 0.026535511016845703 nb_pixel_total : 10403 time to create 1 rle with old method : 0.011664390563964844 time for calcul the mask position with numpy : 0.025258302688598633 nb_pixel_total : 9258 time to create 1 rle with old method : 0.010390758514404297 time for calcul the mask position with numpy : 0.029258012771606445 nb_pixel_total : 72141 time to create 1 rle with old method : 0.16539931297302246 time for calcul the mask position with numpy : 0.04124903678894043 nb_pixel_total : 57631 time to create 1 rle with old method : 0.06944942474365234 time for calcul the mask position with numpy : 0.039318084716796875 nb_pixel_total : 94215 time to create 1 rle with old method : 0.1192924976348877 time for calcul the mask position with numpy : 0.041898250579833984 nb_pixel_total : 28613 time to create 1 rle with old method : 0.05117368698120117 time for calcul the mask position with numpy : 0.04325723648071289 nb_pixel_total : 38585 time to create 1 rle with old method : 0.04686570167541504 time for calcul the mask position with numpy : 0.030314922332763672 nb_pixel_total : 18268 time to create 1 rle with old method : 0.021912574768066406 create new chi : 1.9589476585388184 time to delete rle : 0.0015897750854492188 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7570 TO DO : save crop sub photo not yet done ! save time : 0.5218188762664795 nb_obj : 22 nb_hashtags : 3 time to prepare the origin masks : 9.865900993347168 time for calcul the mask position with numpy : 0.9701330661773682 nb_pixel_total : 6330545 time to create 1 rle with new method : 0.6569440364837646 time for calcul the mask position with numpy : 0.0373075008392334 nb_pixel_total : 7364 time to create 1 rle with old method : 0.008488655090332031 time for calcul the mask position with numpy : 0.03805732727050781 nb_pixel_total : 21414 time to create 1 rle with old method : 0.024535417556762695 time for calcul the mask position with numpy : 0.036414384841918945 nb_pixel_total : 22204 time to create 1 rle with old method : 0.024761438369750977 time for calcul the mask position with numpy : 0.035723209381103516 nb_pixel_total : 11756 time to create 1 rle with old method : 0.013402700424194336 time for calcul the mask position with numpy : 0.03755450248718262 nb_pixel_total : 16694 time to create 1 rle with old method : 0.02221083641052246 time for calcul the mask position with numpy : 0.04041337966918945 nb_pixel_total : 9521 time to create 1 rle with old method : 0.01230168342590332 time for calcul the mask position with numpy : 0.042945146560668945 nb_pixel_total : 47190 time to create 1 rle with old method : 0.05271577835083008 time for calcul the mask position with numpy : 0.02594280242919922 nb_pixel_total : 19717 time to create 1 rle with old method : 0.021007061004638672 time for calcul the mask position with numpy : 0.025787830352783203 nb_pixel_total : 44871 time to create 1 rle with old method : 0.0501399040222168 time for calcul the mask position with numpy : 0.024724245071411133 nb_pixel_total : 85405 time to create 1 rle with old method : 0.08840250968933105 time for calcul the mask position with numpy : 0.024768829345703125 nb_pixel_total : 42487 time to create 1 rle with old method : 0.0481419563293457 time for calcul the mask position with numpy : 0.025140762329101562 nb_pixel_total : 36953 time to create 1 rle with old method : 0.03972887992858887 time for calcul the mask position with numpy : 0.027192115783691406 nb_pixel_total : 22682 time to create 1 rle with old method : 0.024275541305541992 time for calcul the mask position with numpy : 0.024355411529541016 nb_pixel_total : 69133 time to create 1 rle with old method : 0.07332110404968262 time for calcul the mask position with numpy : 0.024260520935058594 nb_pixel_total : 68270 time to create 1 rle with old method : 0.07103562355041504 time for calcul the mask position with numpy : 0.02334880828857422 nb_pixel_total : 19470 time to create 1 rle with old method : 0.021759748458862305 time for calcul the mask position with numpy : 0.024411439895629883 nb_pixel_total : 10496 time to create 1 rle with old method : 0.011603832244873047 time for calcul the mask position with numpy : 0.02371835708618164 nb_pixel_total : 35128 time to create 1 rle with old method : 0.037937164306640625 time for calcul the mask position with numpy : 0.02383112907409668 nb_pixel_total : 14724 time to create 1 rle with old method : 0.01567244529724121 time for calcul the mask position with numpy : 0.025089502334594727 nb_pixel_total : 27181 time to create 1 rle with old method : 0.029465675354003906 time for calcul the mask position with numpy : 0.025678634643554688 nb_pixel_total : 59651 time to create 1 rle with old method : 0.06491565704345703 time for calcul the mask position with numpy : 0.024059057235717773 nb_pixel_total : 27384 time to create 1 rle with old method : 0.03002452850341797 create new chi : 3.094381332397461 time to delete rle : 0.0026950836181640625 batch 1 Loaded 45 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 12181 TO DO : save crop sub photo not yet done ! save time : 0.7531487941741943 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 8.434604167938232 time for calcul the mask position with numpy : 0.5969247817993164 nb_pixel_total : 6608410 time to create 1 rle with new method : 0.7172062397003174 time for calcul the mask position with numpy : 0.03607988357543945 nb_pixel_total : 6580 time to create 1 rle with old method : 0.0074656009674072266 time for calcul the mask position with numpy : 0.03766012191772461 nb_pixel_total : 28463 time to create 1 rle with old method : 0.03313040733337402 time for calcul the mask position with numpy : 0.03844475746154785 nb_pixel_total : 20889 time to create 1 rle with old method : 0.02446269989013672 time for calcul the mask position with numpy : 0.0410311222076416 nb_pixel_total : 10724 time to create 1 rle with old method : 0.013841867446899414 time for calcul the mask position with numpy : 0.040085554122924805 nb_pixel_total : 10607 time to create 1 rle with old method : 0.012897014617919922 time for calcul the mask position with numpy : 0.03294730186462402 nb_pixel_total : 3667 time to create 1 rle with old method : 0.004728555679321289 time for calcul the mask position with numpy : 0.027074575424194336 nb_pixel_total : 26647 time to create 1 rle with old method : 0.031651973724365234 time for calcul the mask position with numpy : 0.024352312088012695 nb_pixel_total : 64256 time to create 1 rle with old method : 0.07454514503479004 time for calcul the mask position with numpy : 0.025237083435058594 nb_pixel_total : 26385 time to create 1 rle with old method : 0.030625343322753906 time for calcul the mask position with numpy : 0.024358034133911133 nb_pixel_total : 5664 time to create 1 rle with old method : 0.006390094757080078 time for calcul the mask position with numpy : 0.023772239685058594 nb_pixel_total : 47027 time to create 1 rle with old method : 0.06173110008239746 time for calcul the mask position with numpy : 0.02557849884033203 nb_pixel_total : 19541 time to create 1 rle with old method : 0.022541284561157227 time for calcul the mask position with numpy : 0.035584449768066406 nb_pixel_total : 15462 time to create 1 rle with old method : 0.017483234405517578 time for calcul the mask position with numpy : 0.03038644790649414 nb_pixel_total : 16813 time to create 1 rle with old method : 0.018917083740234375 time for calcul the mask position with numpy : 0.03203916549682617 nb_pixel_total : 43203 time to create 1 rle with old method : 0.047922372817993164 time for calcul the mask position with numpy : 0.031175613403320312 nb_pixel_total : 20299 time to create 1 rle with old method : 0.02292013168334961 time for calcul the mask position with numpy : 0.023479938507080078 nb_pixel_total : 75603 time to create 1 rle with old method : 0.08885073661804199 create new chi : 2.427792549133301 time to delete rle : 0.001485586166381836 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 8917 TO DO : save crop sub photo not yet done ! save time : 0.5474057197570801 nb_obj : 16 nb_hashtags : 2 time to prepare the origin masks : 6.322362661361694 time for calcul the mask position with numpy : 0.3751564025878906 nb_pixel_total : 6579181 time to create 1 rle with new method : 0.5855107307434082 time for calcul the mask position with numpy : 0.021593809127807617 nb_pixel_total : 24681 time to create 1 rle with old method : 0.02859330177307129 time for calcul the mask position with numpy : 0.02322840690612793 nb_pixel_total : 14250 time to create 1 rle with old method : 0.016648054122924805 time for calcul the mask position with numpy : 0.023165225982666016 nb_pixel_total : 7803 time to create 1 rle with old method : 0.008676290512084961 time for calcul the mask position with numpy : 0.021811485290527344 nb_pixel_total : 17053 time to create 1 rle with old method : 0.01915287971496582 time for calcul the mask position with numpy : 0.02127671241760254 nb_pixel_total : 40882 time to create 1 rle with old method : 0.04601860046386719 time for calcul the mask position with numpy : 0.0271914005279541 nb_pixel_total : 122997 time to create 1 rle with old method : 0.1488018035888672 time for calcul the mask position with numpy : 0.022084951400756836 nb_pixel_total : 2188 time to create 1 rle with old method : 0.002826690673828125 time for calcul the mask position with numpy : 0.023913145065307617 nb_pixel_total : 75797 time to create 1 rle with old method : 0.08610272407531738 time for calcul the mask position with numpy : 0.02652454376220703 nb_pixel_total : 16397 time to create 1 rle with old method : 0.018450260162353516 time for calcul the mask position with numpy : 0.025002241134643555 nb_pixel_total : 16473 time to create 1 rle with old method : 0.01858830451965332 time for calcul the mask position with numpy : 0.02273869514465332 nb_pixel_total : 19670 time to create 1 rle with old method : 0.02208089828491211 time for calcul the mask position with numpy : 0.024062633514404297 nb_pixel_total : 13125 time to create 1 rle with old method : 0.014670610427856445 time for calcul the mask position with numpy : 0.023561477661132812 nb_pixel_total : 19309 time to create 1 rle with old method : 0.022274255752563477 time for calcul the mask position with numpy : 0.03272128105163574 nb_pixel_total : 17973 time to create 1 rle with old method : 0.020801782608032227 time for calcul the mask position with numpy : 0.03306865692138672 nb_pixel_total : 26708 time to create 1 rle with old method : 0.03036212921142578 time for calcul the mask position with numpy : 0.04226255416870117 nb_pixel_total : 35753 time to create 1 rle with old method : 0.04254889488220215 create new chi : 1.9641423225402832 time to delete rle : 0.0020368099212646484 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 8837 TO DO : save crop sub photo not yet done ! save time : 0.62461256980896 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 5.875804424285889 time for calcul the mask position with numpy : 0.38843727111816406 nb_pixel_total : 6470846 time to create 1 rle with new method : 0.6492383480072021 time for calcul the mask position with numpy : 0.03824782371520996 nb_pixel_total : 32172 time to create 1 rle with old method : 0.037483930587768555 time for calcul the mask position with numpy : 0.04024243354797363 nb_pixel_total : 83560 time to create 1 rle with old method : 0.09341716766357422 time for calcul the mask position with numpy : 0.03817629814147949 nb_pixel_total : 21409 time to create 1 rle with old method : 0.02426910400390625 time for calcul the mask position with numpy : 0.037160396575927734 nb_pixel_total : 31888 time to create 1 rle with old method : 0.03603315353393555 time for calcul the mask position with numpy : 0.03804945945739746 nb_pixel_total : 84329 time to create 1 rle with old method : 0.09603643417358398 time for calcul the mask position with numpy : 0.038091182708740234 nb_pixel_total : 30159 time to create 1 rle with old method : 0.03351759910583496 time for calcul the mask position with numpy : 0.023486614227294922 nb_pixel_total : 64750 time to create 1 rle with old method : 0.0739908218383789 time for calcul the mask position with numpy : 0.0227963924407959 nb_pixel_total : 60848 time to create 1 rle with old method : 0.06754183769226074 time for calcul the mask position with numpy : 0.023136615753173828 nb_pixel_total : 132297 time to create 1 rle with old method : 0.14912009239196777 time for calcul the mask position with numpy : 0.03410935401916504 nb_pixel_total : 7734 time to create 1 rle with old method : 0.008625268936157227 time for calcul the mask position with numpy : 0.03422141075134277 nb_pixel_total : 30248 time to create 1 rle with old method : 0.03430676460266113 create new chi : 2.103684425354004 time to delete rle : 0.0016629695892333984 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 9188 TO DO : save crop sub photo not yet done ! save time : 0.8910114765167236 nb_obj : 23 nb_hashtags : 4 time to prepare the origin masks : 10.344024181365967 time for calcul the mask position with numpy : 0.793144941329956 nb_pixel_total : 6126268 time to create 1 rle with new method : 0.7706575393676758 time for calcul the mask position with numpy : 0.03845977783203125 nb_pixel_total : 74185 time to create 1 rle with old method : 0.10186004638671875 time for calcul the mask position with numpy : 0.0324397087097168 nb_pixel_total : 23962 time to create 1 rle with old method : 0.026964426040649414 time for calcul the mask position with numpy : 0.03482317924499512 nb_pixel_total : 87621 time to create 1 rle with old method : 0.10049772262573242 time for calcul the mask position with numpy : 0.033850669860839844 nb_pixel_total : 19096 time to create 1 rle with old method : 0.02153182029724121 time for calcul the mask position with numpy : 0.02413344383239746 nb_pixel_total : 9899 time to create 1 rle with old method : 0.011260271072387695 time for calcul the mask position with numpy : 0.024194717407226562 nb_pixel_total : 5372 time to create 1 rle with old method : 0.006133317947387695 time for calcul the mask position with numpy : 0.02568650245666504 nb_pixel_total : 25233 time to create 1 rle with old method : 0.02866363525390625 time for calcul the mask position with numpy : 0.023504972457885742 nb_pixel_total : 14761 time to create 1 rle with old method : 0.01674365997314453 time for calcul the mask position with numpy : 0.02424335479736328 nb_pixel_total : 38132 time to create 1 rle with old method : 0.04262852668762207 time for calcul the mask position with numpy : 0.0277864933013916 nb_pixel_total : 111223 time to create 1 rle with old method : 0.12575674057006836 time for calcul the mask position with numpy : 0.022886991500854492 nb_pixel_total : 103407 time to create 1 rle with old method : 0.11537909507751465 time for calcul the mask position with numpy : 0.026172161102294922 nb_pixel_total : 26427 time to create 1 rle with old method : 0.029685258865356445 time for calcul the mask position with numpy : 0.025237321853637695 nb_pixel_total : 34571 time to create 1 rle with old method : 0.039046287536621094 time for calcul the mask position with numpy : 0.023773908615112305 nb_pixel_total : 4447 time to create 1 rle with old method : 0.005070686340332031 time for calcul the mask position with numpy : 0.036045074462890625 nb_pixel_total : 38656 time to create 1 rle with old method : 0.043025970458984375 time for calcul the mask position with numpy : 0.03623700141906738 nb_pixel_total : 7172 time to create 1 rle with old method : 0.008256673812866211 time for calcul the mask position with numpy : 0.03789877891540527 nb_pixel_total : 38912 time to create 1 rle with old method : 0.05296659469604492 time for calcul the mask position with numpy : 0.036777496337890625 nb_pixel_total : 26229 time to create 1 rle with old method : 0.02941155433654785 time for calcul the mask position with numpy : 0.02944660186767578 nb_pixel_total : 41345 time to create 1 rle with old method : 0.05179238319396973 time for calcul the mask position with numpy : 0.0237271785736084 nb_pixel_total : 28268 time to create 1 rle with old method : 0.03243207931518555 time for calcul the mask position with numpy : 0.025757551193237305 nb_pixel_total : 33948 time to create 1 rle with old method : 0.038219451904296875 time for calcul the mask position with numpy : 0.0310823917388916 nb_pixel_total : 79147 time to create 1 rle with old method : 0.0980374813079834 time for calcul the mask position with numpy : 0.025376319885253906 nb_pixel_total : 51959 time to create 1 rle with old method : 0.057351112365722656 create new chi : 3.368077278137207 time to delete rle : 0.0027413368225097656 batch 1 Loaded 47 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 13184 TO DO : save crop sub photo not yet done ! save time : 0.86509108543396 nb_obj : 19 nb_hashtags : 4 time to prepare the origin masks : 8.035703897476196 time for calcul the mask position with numpy : 0.4386923313140869 nb_pixel_total : 6342888 time to create 1 rle with new method : 0.666928768157959 time for calcul the mask position with numpy : 0.025946617126464844 nb_pixel_total : 27266 time to create 1 rle with old method : 0.03081798553466797 time for calcul the mask position with numpy : 0.022108078002929688 nb_pixel_total : 13471 time to create 1 rle with old method : 0.015352964401245117 time for calcul the mask position with numpy : 0.025790691375732422 nb_pixel_total : 57831 time to create 1 rle with old method : 0.06570792198181152 time for calcul the mask position with numpy : 0.02472519874572754 nb_pixel_total : 29735 time to create 1 rle with old method : 0.04308652877807617 time for calcul the mask position with numpy : 0.028823375701904297 nb_pixel_total : 48440 time to create 1 rle with old method : 0.055910587310791016 time for calcul the mask position with numpy : 0.02605748176574707 nb_pixel_total : 10543 time to create 1 rle with old method : 0.014533519744873047 time for calcul the mask position with numpy : 0.02812504768371582 nb_pixel_total : 12121 time to create 1 rle with old method : 0.018196582794189453 time for calcul the mask position with numpy : 0.028649091720581055 nb_pixel_total : 16650 time to create 1 rle with old method : 0.02725529670715332 time for calcul the mask position with numpy : 0.028021574020385742 nb_pixel_total : 16417 time to create 1 rle with old method : 0.01867532730102539 time for calcul the mask position with numpy : 0.023598194122314453 nb_pixel_total : 36950 time to create 1 rle with old method : 0.0633540153503418 time for calcul the mask position with numpy : 0.02523660659790039 nb_pixel_total : 58973 time to create 1 rle with old method : 0.06972718238830566 time for calcul the mask position with numpy : 0.023871660232543945 nb_pixel_total : 32274 time to create 1 rle with old method : 0.03606557846069336 time for calcul the mask position with numpy : 0.02422189712524414 nb_pixel_total : 56581 time to create 1 rle with old method : 0.0628199577331543 time for calcul the mask position with numpy : 0.025635719299316406 nb_pixel_total : 27416 time to create 1 rle with old method : 0.03557467460632324 time for calcul the mask position with numpy : 0.024929523468017578 nb_pixel_total : 19555 time to create 1 rle with old method : 0.023026704788208008 time for calcul the mask position with numpy : 0.023743391036987305 nb_pixel_total : 38227 time to create 1 rle with old method : 0.04244375228881836 time for calcul the mask position with numpy : 0.030858993530273438 nb_pixel_total : 27244 time to create 1 rle with old method : 0.03328704833984375 time for calcul the mask position with numpy : 0.023337602615356445 nb_pixel_total : 131383 time to create 1 rle with old method : 0.14879345893859863 time for calcul the mask position with numpy : 0.02432417869567871 nb_pixel_total : 46275 time to create 1 rle with old method : 0.05364036560058594 create new chi : 2.4991049766540527 time to delete rle : 0.001954793930053711 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 10506 TO DO : save crop sub photo not yet done ! save time : 0.9812972545623779 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 6.578839302062988 time for calcul the mask position with numpy : 0.49288511276245117 nb_pixel_total : 6470309 time to create 1 rle with new method : 0.38968873023986816 time for calcul the mask position with numpy : 0.02504277229309082 nb_pixel_total : 9567 time to create 1 rle with old method : 0.011806488037109375 time for calcul the mask position with numpy : 0.02170395851135254 nb_pixel_total : 11391 time to create 1 rle with old method : 0.012916088104248047 time for calcul the mask position with numpy : 0.02193927764892578 nb_pixel_total : 4851 time to create 1 rle with old method : 0.0056035518646240234 time for calcul the mask position with numpy : 0.02429509162902832 nb_pixel_total : 20601 time to create 1 rle with old method : 0.023290634155273438 time for calcul the mask position with numpy : 0.02460026741027832 nb_pixel_total : 50226 time to create 1 rle with old method : 0.06031084060668945 time for calcul the mask position with numpy : 0.022292375564575195 nb_pixel_total : 42295 time to create 1 rle with old method : 0.04852151870727539 time for calcul the mask position with numpy : 0.03016066551208496 nb_pixel_total : 5633 time to create 1 rle with old method : 0.006237983703613281 time for calcul the mask position with numpy : 0.02450728416442871 nb_pixel_total : 34798 time to create 1 rle with old method : 0.037204742431640625 time for calcul the mask position with numpy : 0.025338411331176758 nb_pixel_total : 67295 time to create 1 rle with old method : 0.07193398475646973 time for calcul the mask position with numpy : 0.030093908309936523 nb_pixel_total : 28732 time to create 1 rle with old method : 0.041475534439086914 time for calcul the mask position with numpy : 0.026549100875854492 nb_pixel_total : 13697 time to create 1 rle with old method : 0.01552128791809082 time for calcul the mask position with numpy : 0.022078752517700195 nb_pixel_total : 28383 time to create 1 rle with old method : 0.031926631927490234 time for calcul the mask position with numpy : 0.031790971755981445 nb_pixel_total : 153848 time to create 1 rle with new method : 0.9064865112304688 time for calcul the mask position with numpy : 0.04236888885498047 nb_pixel_total : 36661 time to create 1 rle with old method : 0.047859907150268555 time for calcul the mask position with numpy : 0.038936614990234375 nb_pixel_total : 35957 time to create 1 rle with old method : 0.053783416748046875 time for calcul the mask position with numpy : 0.035207271575927734 nb_pixel_total : 19545 time to create 1 rle with old method : 0.02246713638305664 time for calcul the mask position with numpy : 0.035854339599609375 nb_pixel_total : 16451 time to create 1 rle with old method : 0.018506288528442383 create new chi : 2.8473634719848633 time to delete rle : 0.001940011978149414 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 10181 TO DO : save crop sub photo not yet done ! save time : 2.110938310623169 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 5.791195392608643 time for calcul the mask position with numpy : 0.6802453994750977 nb_pixel_total : 6717494 time to create 1 rle with new method : 1.3323535919189453 time for calcul the mask position with numpy : 0.04176068305969238 nb_pixel_total : 63074 time to create 1 rle with old method : 0.09753108024597168 time for calcul the mask position with numpy : 0.03822779655456543 nb_pixel_total : 7355 time to create 1 rle with old method : 0.008347034454345703 time for calcul the mask position with numpy : 0.023221969604492188 nb_pixel_total : 6400 time to create 1 rle with old method : 0.007405757904052734 time for calcul the mask position with numpy : 0.03281736373901367 nb_pixel_total : 18533 time to create 1 rle with old method : 0.02118086814880371 time for calcul the mask position with numpy : 0.036360979080200195 nb_pixel_total : 11859 time to create 1 rle with old method : 0.013372182846069336 time for calcul the mask position with numpy : 0.03981328010559082 nb_pixel_total : 225525 time to create 1 rle with new method : 0.5155808925628662 create new chi : 2.964048147201538 time to delete rle : 0.001333475112915039 batch 1 Loaded 13 chid ids of type : 3594 +++++++++Number RLEs to save : 5238 TO DO : save crop sub photo not yet done ! save time : 0.47729039192199707 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 5.053496599197388 time for calcul the mask position with numpy : 0.3728001117706299 nb_pixel_total : 6494734 time to create 1 rle with new method : 0.9956326484680176 time for calcul the mask position with numpy : 0.023421525955200195 nb_pixel_total : 13539 time to create 1 rle with old method : 0.015961408615112305 time for calcul the mask position with numpy : 0.03227353096008301 nb_pixel_total : 27965 time to create 1 rle with old method : 0.04847264289855957 time for calcul the mask position with numpy : 0.04112100601196289 nb_pixel_total : 29825 time to create 1 rle with old method : 0.03579258918762207 time for calcul the mask position with numpy : 0.04233288764953613 nb_pixel_total : 21580 time to create 1 rle with old method : 0.02700352668762207 time for calcul the mask position with numpy : 0.037996768951416016 nb_pixel_total : 56171 time to create 1 rle with old method : 0.06720185279846191 time for calcul the mask position with numpy : 0.03569912910461426 nb_pixel_total : 14636 time to create 1 rle with old method : 0.0164334774017334 time for calcul the mask position with numpy : 0.03461313247680664 nb_pixel_total : 7675 time to create 1 rle with old method : 0.008659839630126953 time for calcul the mask position with numpy : 0.036284685134887695 nb_pixel_total : 68578 time to create 1 rle with old method : 0.0762033462524414 time for calcul the mask position with numpy : 0.03674674034118652 nb_pixel_total : 66050 time to create 1 rle with old method : 0.07388043403625488 time for calcul the mask position with numpy : 0.03586292266845703 nb_pixel_total : 77864 time to create 1 rle with old method : 0.08613252639770508 time for calcul the mask position with numpy : 0.0371091365814209 nb_pixel_total : 39521 time to create 1 rle with old method : 0.044428348541259766 time for calcul the mask position with numpy : 0.0406038761138916 nb_pixel_total : 16915 time to create 1 rle with old method : 0.019320011138916016 time for calcul the mask position with numpy : 0.040747880935668945 nb_pixel_total : 29660 time to create 1 rle with old method : 0.03503608703613281 time for calcul the mask position with numpy : 0.05505824089050293 nb_pixel_total : 25456 time to create 1 rle with old method : 0.049761056900024414 time for calcul the mask position with numpy : 0.025564193725585938 nb_pixel_total : 35856 time to create 1 rle with old method : 0.040639400482177734 time for calcul the mask position with numpy : 0.024933338165283203 nb_pixel_total : 13017 time to create 1 rle with old method : 0.017160892486572266 time for calcul the mask position with numpy : 0.029424190521240234 nb_pixel_total : 11198 time to create 1 rle with old method : 0.01291799545288086 create new chi : 2.7067630290985107 time to delete rle : 0.0028922557830810547 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 9992 TO DO : save crop sub photo not yet done ! save time : 0.6190271377563477 map_output_result : {1358317972: (0.0, 'Should be the crop_list due to order', 0), 1358317965: (0.0, 'Should be the crop_list due to order', 0), 1358317910: (0.0, 'Should be the crop_list due to order', 0), 1358317891: (0.0, 'Should be the crop_list due to order', 0), 1358317888: (0.0, 'Should be the crop_list due to order', 0), 1358317886: (0.0, 'Should be the crop_list due to order', 0), 1358317881: (0.0, 'Should be the crop_list due to order', 0), 1358315289: (0.0, 'Should be the crop_list due to order', 0), 1358315226: (0.0, 'Should be the crop_list due to order', 0), 1358315160: (0.0, 'Should be the crop_list due to order', 0), 1358315125: (0.0, 'Should be the crop_list due to order', 0), 1358315120: (0.0, 'Should be the crop_list due to order', 0), 1358315116: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1358317972, 1358317965, 1358317910, 1358317891, 1358317888, 1358317886, 1358317881, 1358315289, 1358315226, 1358315160, 1358315125, 1358315120, 1358315116] Looping around the photos to save general results len do output : 13 /1358317972.Didn't retrieve data . /1358317965.Didn't retrieve data . /1358317910.Didn't retrieve data . /1358317891.Didn't retrieve data . /1358317888.Didn't retrieve data . /1358317886.Didn't retrieve data . /1358317881.Didn't retrieve data . /1358315289.Didn't retrieve data . /1358315226.Didn't retrieve data . /1358315160.Didn't retrieve data . /1358315125.Didn't retrieve data . /1358315120.Didn't retrieve data . /1358315116.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317972', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317965', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317910', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317891', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317888', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317886', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317881', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315289', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315226', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315160', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315125', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315120', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315116', None, None, None, None, None, '2856068') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.013619422912597656 save_final save missing photos in datou_result : time spend for datou_step_exec : 139.21578097343445 time spend to save output : 0.024912357330322266 total time spend for step 3 : 139.24069333076477 step4:ventilate_hashtags_in_portfolio Thu May 15 02:26:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22989039 get user id for portfolio 22989039 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22989039 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pet_clair','pet_fonce','autre','pehd','papier','metal','mal_croppe','carton','environnement','background')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22989039 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pet_clair','pet_fonce','autre','pehd','papier','metal','mal_croppe','carton','environnement','background')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22989039 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pet_clair','pet_fonce','autre','pehd','papier','metal','mal_croppe','carton','environnement','background')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22989464,22989465,22989467,22989468,22989469,22989470,22989472,22989473,22989474,22989476,22989477?tags=flou,pet_clair,pet_fonce,autre,pehd,papier,metal,mal_croppe,carton,environnement,background Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1358317972, 1358317965, 1358317910, 1358317891, 1358317888, 1358317886, 1358317881, 1358315289, 1358315226, 1358315160, 1358315125, 1358315120, 1358315116] Looping around the photos to save general results len do output : 1 /22989039. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317972', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317965', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317910', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317891', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317888', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317886', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317881', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315289', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315226', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315160', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315125', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315120', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315116', None, None, None, None, None, '2856068') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.06612277030944824 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7432332038879395 time spend to save output : 0.06648898124694824 total time spend for step 4 : 1.8097221851348877 step5:final Thu May 15 02:26:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1358317972: ('0.10039380001466397',), 1358317965: ('0.10039380001466397',), 1358317910: ('0.10039380001466397',), 1358317891: ('0.10039380001466397',), 1358317888: ('0.10039380001466397',), 1358317886: ('0.10039380001466397',), 1358317881: ('0.10039380001466397',), 1358315289: ('0.10039380001466397',), 1358315226: ('0.10039380001466397',), 1358315160: ('0.10039380001466397',), 1358315125: ('0.10039380001466397',), 1358315120: ('0.10039380001466397',), 1358315116: ('0.10039380001466397',)} new output for save of step final : {1358317972: ('0.10039380001466397',), 1358317965: ('0.10039380001466397',), 1358317910: ('0.10039380001466397',), 1358317891: ('0.10039380001466397',), 1358317888: ('0.10039380001466397',), 1358317886: ('0.10039380001466397',), 1358317881: ('0.10039380001466397',), 1358315289: ('0.10039380001466397',), 1358315226: ('0.10039380001466397',), 1358315160: ('0.10039380001466397',), 1358315125: ('0.10039380001466397',), 1358315120: ('0.10039380001466397',), 1358315116: ('0.10039380001466397',)} [1358317972, 1358317965, 1358317910, 1358317891, 1358317888, 1358317886, 1358317881, 1358315289, 1358315226, 1358315160, 1358315125, 1358315120, 1358315116] Looping around the photos to save general results len do output : 13 /1358317972.Didn't retrieve data . /1358317965.Didn't retrieve data . /1358317910.Didn't retrieve data . /1358317891.Didn't retrieve data . /1358317888.Didn't retrieve data . /1358317886.Didn't retrieve data . /1358317881.Didn't retrieve data . /1358315289.Didn't retrieve data . /1358315226.Didn't retrieve data . /1358315160.Didn't retrieve data . /1358315125.Didn't retrieve data . /1358315120.Didn't retrieve data . /1358315116.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317972', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317965', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317910', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317891', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317888', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317886', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317881', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315289', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315226', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315160', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315125', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315120', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315116', None, None, None, None, None, '2856068') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.021827220916748047 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1377103328704834 time spend to save output : 0.022421598434448242 total time spend for step 5 : 0.16013193130493164 step6:blur_detection Thu May 15 02:26:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747268428_1222436_1358317972_af57f1d55fba6cd4f71e2a2c0041dfd6.jpg resize: (2160, 3264) 1358317972 -0.32804531453829433 treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb.jpg resize: (2160, 3264) 1358317965 -1.0538225367063034 treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9.jpg resize: (2160, 3264) 1358317910 -1.5916269499468778 treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55.jpg resize: (2160, 3264) 1358317891 -5.523407396334955 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66.jpg resize: (2160, 3264) 1358317888 -4.885002034289737 treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa.jpg resize: (2160, 3264) 1358317886 -1.1824490754314472 treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977.jpg resize: (2160, 3264) 1358317881 -1.9535191116406336 treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b.jpg resize: (2160, 3264) 1358315289 -2.639600268602066 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f.jpg resize: (2160, 3264) 1358315226 -2.8166260540776022 treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f.jpg resize: (2160, 3264) 1358315160 -2.8775828875436367 treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27.jpg resize: (2160, 3264) 1358315125 1.5931525680397884 treat image : temp/1747268428_1222436_1358315120_7b8000cb8138b54105034e2ba1aee20c.jpg resize: (2160, 3264) 1358315120 -2.040890816645877 treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f.jpg resize: (2160, 3264) 1358315116 -2.968037495311478 treat image : temp/1747268428_1222436_1358317972_af57f1d55fba6cd4f71e2a2c0041dfd6_rle_crop_3798439690_0.png resize: (428, 581) 1358398039 -0.5820795126927898 treat image : temp/1747268428_1222436_1358317972_af57f1d55fba6cd4f71e2a2c0041dfd6_rle_crop_3798439694_0.png resize: (83, 176) 1358398040 -0.7444659708925073 treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439696_0.png resize: (178, 68) 1358398041 8.580761139557726 treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439697_0.png resize: (714, 692) 1358398042 -2.04255228382668 treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439702_0.png resize: (130, 264) 1358398043 -1.285217408491626 treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9_rle_crop_3798439708_0.png resize: (449, 271) 1358398044 -1.9652321237298513 treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9_rle_crop_3798439709_0.png resize: (223, 335) 1358398045 -1.551521569464766 treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9_rle_crop_3798439713_0.png resize: (567, 646) 1358398046 -1.9674275397122096 treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9_rle_crop_3798439715_0.png resize: (177, 245) 1358398047 -2.483650456204943 treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9_rle_crop_3798439716_0.png resize: (239, 289) 1358398048 -1.495248881858494 treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439720_0.png resize: (237, 252) 1358398049 -3.573284090460971 treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439721_0.png resize: (232, 175) 1358398050 -1.3113108036575227 treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439723_0.png resize: (302, 277) 1358398051 -1.4474998579254303 treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439725_0.png resize: (89, 131) 1358398052 -0.885502938536266 treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439726_0.png resize: (139, 110) 1358398054 -0.966325456672848 treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439727_0.png resize: (145, 155) 1358398055 -1.7806665257270042 treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439728_0.png resize: (195, 169) 1358398056 -1.3127532803562942 treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439729_0.png resize: (258, 131) 1358398057 -2.800867802144256 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439731_0.png resize: (226, 183) 1358398058 -1.364383166912984 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439732_0.png resize: (304, 289) 1358398059 -0.325697527779517 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439735_0.png resize: (275, 271) 1358398060 -2.1186781476563783 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439736_0.png resize: (153, 106) 1358398061 -3.6891138613361423 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439740_0.png resize: (227, 132) 1358398062 -0.6905979402157364 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439742_0.png resize: (285, 224) 1358398063 -2.8747651331894266 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439746_0.png resize: (270, 246) 1358398064 -1.4035178414821539 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439747_0.png resize: (107, 126) 1358398065 -0.7792866165505614 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439748_0.png resize: (122, 250) 1358398066 -2.9906469598094776 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439749_0.png resize: (156, 116) 1358398067 -1.967365740123459 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439750_0.png resize: (196, 146) 1358398068 -0.4724471765341535 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439752_0.png resize: (120, 125) 1358398069 -2.580923837239208 treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439754_0.png resize: (216, 166) 1358398070 -2.0429009900123365 treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439755_0.png resize: (284, 218) 1358398071 -0.14561665548438937 treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439756_0.png resize: (195, 118) 1358398072 -1.350161233992388 treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439757_0.png resize: (173, 115) 1358398073 -1.0239425074043764 treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439760_0.png resize: (93, 103) 1358398074 -1.6472636006429093 treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439761_0.png resize: (189, 207) 1358398075 -1.3975470739791251 treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439762_0.png resize: (260, 314) 1358398076 -0.6919286847591907 treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439763_0.png resize: (157, 265) 1358398077 -1.6884054613000947 treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439764_0.png resize: (55, 90) 1358398078 0.9766797527182708 treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439765_0.png resize: (104, 117) 1358398079 1.867819084837641 treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439766_0.png resize: (118, 156) 1358398080 -2.112501724333774 treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439767_0.png resize: (160, 303) 1358398081 -1.6147581588743498 treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439768_0.png resize: (282, 151) 1358398082 -0.3761945330637344 treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439769_0.png resize: (100, 104) 1358398083 -1.0246449818280627 treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439770_0.png resize: (176, 293) 1358398084 -0.6241081736097182 treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439771_0.png resize: (248, 176) 1358398085 -0.9940813562146024 treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439772_0.png resize: (147, 179) 1358398086 -1.348067182311869 treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439773_0.png resize: (186, 133) 1358398087 0.4587443923856579 treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439774_0.png resize: (137, 112) 1358398088 0.7305453009181931 treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439775_0.png resize: (161, 153) 1358398089 0.3299346422439311 treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439776_0.png resize: (158, 147) 1358398090 -1.213091937686513 treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439777_0.png resize: (121, 187) 1358398091 -0.8521442053350458 treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439779_0.png resize: (191, 194) 1358398093 -0.8537533607372985 treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439780_0.png resize: (406, 379) 1358398094 -0.7254537541471863 treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439782_0.png resize: (180, 159) 1358398095 -0.6923603924170835 treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439784_0.png resize: (138, 138) 1358398096 -1.681363158664279 treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439785_0.png resize: (245, 146) 1358398097 -1.9002970976480655 treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b_rle_crop_3798439786_0.png resize: (254, 137) 1358398098 -1.1725684614097684 treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b_rle_crop_3798439787_0.png resize: (153, 89) 1358398099 -1.875328681873768 treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b_rle_crop_3798439788_0.png resize: (426, 485) 1358398100 -2.3437436533591725 treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b_rle_crop_3798439789_0.png resize: (495, 183) 1358398101 -1.5332519943148224 treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b_rle_crop_3798439790_0.png resize: (365, 302) 1358398102 -1.7941655948425246 treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b_rle_crop_3798439795_0.png resize: (504, 228) 1358398103 -0.8771212414235577 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439799_0.png resize: (201, 289) 1358398104 -1.674741025652311 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439802_0.png resize: (201, 203) 1358398105 -1.492556681272393 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439803_0.png resize: (265, 254) 1358398107 -0.687444322175576 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439804_0.png resize: (95, 111) 1358398108 -1.2203009602312838 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439807_0.png resize: (235, 273) 1358398109 -3.1522565835629197 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439808_0.png resize: (191, 204) 1358398110 -2.242042548845421 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439809_0.png resize: (303, 492) 1358398111 -0.7575615347242248 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439810_0.png resize: (384, 444) 1358398112 -0.03443178623722654 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439813_0.png resize: (168, 216) 1358398113 -2.4947227619072243 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439814_0.png resize: (102, 98) 1358398114 -2.2857104038045173 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439815_0.png resize: (147, 102) 1358398115 -1.501095896609571 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439817_0.png resize: (340, 527) 1358398116 -2.426667423335895 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439818_0.png resize: (143, 320) 1358398117 -2.5116510188493226 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439819_0.png resize: (309, 356) 1358398118 -2.2260539121692324 treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439820_0.png resize: (353, 262) 1358398119 -1.7164448335660385 treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439821_0.png resize: (506, 360) 1358398120 -0.7570270308445622 treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439822_0.png resize: (186, 299) 1358398122 -1.3570803365839617 treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439824_0.png resize: (179, 163) 1358398123 -1.2613441477580518 treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439825_0.png resize: (160, 241) 1358398124 -1.1349084455371634 treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439827_0.png resize: (155, 324) 1358398125 -1.5013973225826052 treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439831_0.png resize: (91, 276) 1358398126 -1.0484104572362856 treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439832_0.png resize: (115, 151) 1358398127 -1.7234913169085075 treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439833_0.png resize: (116, 120) 1358398128 -1.4432974596912787 treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439834_0.png resize: (240, 278) 1358398129 -0.6776360577026338 treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439836_0.png resize: (265, 385) 1358398130 -1.2744945666031775 treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439838_0.png resize: (241, 148) 1358398131 -0.2543759022730251 treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439839_0.png resize: (148, 153) 1358398132 -1.4247143437219267 treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439840_0.png resize: (230, 160) 1358398133 -2.0164132254789635 treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439841_0.png resize: (311, 173) 1358398134 -1.456295998781307 treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439842_0.png resize: (382, 160) 1358398136 -0.700086516039636 treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439843_0.png resize: (454, 429) 1358398137 0.2965600733539077 treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439844_0.png resize: (221, 169) 1358398138 -0.4029815655394234 treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439845_0.png resize: (123, 171) 1358398140 -1.803306159569277 treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439846_0.png resize: (166, 339) 1358398141 0.11749987403223902 treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439848_0.png resize: (289, 209) 1358398142 -1.1408022104463127 treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439849_0.png resize: (136, 117) 1358398145 0.8019335333160501 treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439852_0.png resize: (163, 174) 1358398146 0.683593876766454 treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439853_0.png resize: (110, 63) 1358398147 -0.02902732162976167 treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439854_0.png resize: (127, 120) 1358398148 -0.563831941792408 treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439855_0.png resize: (83, 172) 1358398150 -0.7913489572681764 treat image : temp/1747268428_1222436_1358315120_7b8000cb8138b54105034e2ba1aee20c_rle_crop_3798439857_0.png resize: (143, 138) 1358398151 -0.7382746203384255 treat image : temp/1747268428_1222436_1358315120_7b8000cb8138b54105034e2ba1aee20c_rle_crop_3798439859_0.png resize: (122, 113) 1358398152 1.7641137656501384 treat image : temp/1747268428_1222436_1358315120_7b8000cb8138b54105034e2ba1aee20c_rle_crop_3798439860_0.png resize: (116, 99) 1358398154 -1.6053526984652442 treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439862_0.png resize: (95, 197) 1358398155 -1.8766743297937218 treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439863_0.png resize: (175, 132) 1358398156 -0.8494932506417818 treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439865_0.png resize: (142, 237) 1358398158 -0.7518419472026823 treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439867_0.png resize: (170, 201) 1358398159 -2.006909798986545 treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439869_0.png resize: (484, 250) 1358398160 -2.3873739565644754 treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439870_0.png resize: (288, 329) 1358398162 -1.733896527620918 treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439872_0.png resize: (137, 75) 1358398163 -0.5757994628797275 treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439873_0.png resize: (117, 154) 1358398164 -0.2735780075224603 treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439877_0.png resize: (208, 201) 1358398166 -2.4938901800707614 treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439878_0.png resize: (106, 164) 1358398167 -0.2165696235891366 treat image : temp/1747268428_1222436_1358317972_af57f1d55fba6cd4f71e2a2c0041dfd6_rle_crop_3798439691_0.png resize: (229, 117) 1358398189 -0.6779285922531887 treat image : temp/1747268428_1222436_1358317972_af57f1d55fba6cd4f71e2a2c0041dfd6_rle_crop_3798439692_0.png resize: (142, 160) 1358398190 -1.5212460972622317 treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439699_0.png resize: (762, 523) 1358398191 0.8152277255068503 treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439701_0.png resize: (264, 433) 1358398192 -1.3264619938380258 treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9_rle_crop_3798439712_0.png resize: (351, 295) 1358398193 -1.9957725719764638 treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439719_0.png resize: (134, 208) 1358398194 -1.7945157713197921 treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439730_0.png resize: (220, 172) 1358398195 -1.1025153572933208 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439734_0.png resize: (138, 182) 1358398196 -1.6791324056452224 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439737_0.png resize: (139, 222) 1358398197 -1.8457507878082322 treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439758_0.png resize: (191, 136) 1358398198 -0.8222950248384272 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439811_0.png resize: (223, 318) 1358398199 -1.0239114752878398 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439812_0.png resize: (204, 108) 1358398200 -0.7058035985519571 treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439826_0.png resize: (262, 437) 1358398201 -1.6597625516238428 treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439835_0.png resize: (229, 198) 1358398202 -0.908186616104939 treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439837_0.png resize: (121, 156) 1358398203 -1.5852522203955872 treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439850_0.png resize: (232, 368) 1358398205 -1.6756036578434086 treat image : temp/1747268428_1222436_1358315120_7b8000cb8138b54105034e2ba1aee20c_rle_crop_3798439856_0.png resize: (716, 512) 1358398206 0.06601723512169239 treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439864_0.png resize: (207, 241) 1358398207 -0.7829199817560119 treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439866_0.png resize: (229, 202) 1358398209 -1.9294474212545027 treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439875_0.png resize: (167, 175) 1358398210 -1.4518590503245754 treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439876_0.png resize: (220, 220) 1358398211 -0.3838662301009696 treat image : temp/1747268428_1222436_1358317972_af57f1d55fba6cd4f71e2a2c0041dfd6_rle_crop_3798439693_0.png resize: (123, 119) 1358398222 -2.19738971396565 treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439830_0.png resize: (169, 122) 1358398223 -0.030641374251982326 treat image : temp/1747268428_1222436_1358317972_af57f1d55fba6cd4f71e2a2c0041dfd6_rle_crop_3798439687_0.png resize: (256, 621) 1358398355 -1.7424375438051543 treat image : temp/1747268428_1222436_1358317972_af57f1d55fba6cd4f71e2a2c0041dfd6_rle_crop_3798439688_0.png resize: (224, 324) 1358398356 -1.5466151832713788 treat image : temp/1747268428_1222436_1358317972_af57f1d55fba6cd4f71e2a2c0041dfd6_rle_crop_3798439689_0.png resize: (296, 406) 1358398358 0.23634838735068156 treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439695_0.png resize: (90, 134) 1358398359 -0.586189123706064 treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439698_0.png resize: (597, 524) 1358398360 -0.9913523224315546 treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439700_0.png resize: (630, 327) 1358398362 -0.7871760556410662 treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439703_0.png resize: (294, 887) 1358398363 -0.137071297619974 treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439704_0.png resize: (177, 299) 1358398364 -0.9296099959194424 treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439705_0.png resize: (731, 510) 1358398366 -0.7664576811823443 treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439706_0.png resize: (182, 245) 1358398368 -0.9889658551618103 treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439707_0.png resize: (458, 361) 1358398369 -0.880508878019269 treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9_rle_crop_3798439710_0.png resize: (323, 1267) 1358398371 0.12245229969313343 treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9_rle_crop_3798439711_0.png resize: (729, 593) 1358398372 -3.5957827409575853 treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9_rle_crop_3798439714_0.png resize: (691, 850) 1358398373 -1.7989201733202886 treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9_rle_crop_3798439717_0.png resize: (341, 395) 1358398375 -1.2821773022381417 treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9_rle_crop_3798439718_0.png resize: (670, 437) 1358398376 -0.8723754218267653 treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439722_0.png resize: (435, 325) 1358398377 -4.741175105280091 treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439724_0.png resize: (266, 392) 1358398379 -1.7156297581108741 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439733_0.png resize: (186, 210) 1358398380 -4.464096743872907 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439738_0.png resize: (456, 194) 1358398381 -1.746328364589807 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439739_0.png resize: (418, 241) 1358398383 -3.250979804203316 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439741_0.png resize: (206, 262) 1358398384 -3.9964147290475314 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439743_0.png resize: (266, 479) 1358398386 -2.1194980501415626 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439744_0.png resize: (235, 270) 1358398387 -2.3177793973765297 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439745_0.png resize: (172, 152) 1358398388 -3.5768729940957114 treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439751_0.png resize: (106, 267) 1358398390 -3.5227926286054605 treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439753_0.png resize: (352, 426) 1358398391 -1.0712523402412417 treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439759_0.png resize: (251, 243) 1358398392 -1.7363454832826573 treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439778_0.png resize: (538, 201) 1358398394 -2.4384237301583425 treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439781_0.png resize: (185, 278) 1358398395 -0.6142345265476656 treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439783_0.png resize: (86, 125) 1358398396 -2.8223897684095576 treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b_rle_crop_3798439791_0.png resize: (251, 204) 1358398397 -2.890782581154427 treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b_rle_crop_3798439792_0.png resize: (297, 372) 1358398399 -2.3080868642260706 treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b_rle_crop_3798439793_0.png resize: (178, 263) 1358398400 -2.035940999462065 treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b_rle_crop_3798439796_0.png resize: (256, 150) 1358398401 -1.9197261496753546 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439797_0.png resize: (259, 297) 1358398403 -1.0687094704534372 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439798_0.png resize: (367, 250) 1358398404 -2.518109354192912 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439800_0.png resize: (155, 232) 1358398406 -1.9491179461652852 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439801_0.png resize: (173, 326) 1358398407 -2.2082081770501674 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439805_0.png resize: (201, 244) 1358398408 -1.4834847312717028 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439816_0.png resize: (174, 186) 1358398410 -1.4394068407875973 treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439823_0.png resize: (164, 384) 1358398411 -2.391615391545 treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439828_0.png resize: (179, 496) 1358398412 -3.645194477259988 treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439829_0.png resize: (228, 238) 1358398414 -3.175483837676201 treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439847_0.png resize: (299, 292) 1358398415 -1.4994048375755895 treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439851_0.png resize: (219, 319) 1358398416 -0.5381018778885206 treat image : temp/1747268428_1222436_1358315120_7b8000cb8138b54105034e2ba1aee20c_rle_crop_3798439861_0.png resize: (154, 522) 1358398418 -1.656835125888552 treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439868_0.png resize: (206, 345) 1358398419 -2.4609076201821556 treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439871_0.png resize: (282, 395) 1358398420 -1.6937220040909904 treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439874_0.png resize: (517, 127) 1358398422 -1.6772076703900813 treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b_rle_crop_3798439794_0.png resize: (135, 234) 1358398444 -2.035614392011132 treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439806_0.png resize: (75, 71) 1358398447 3.301895238859025 treat image : temp/1747268428_1222436_1358315120_7b8000cb8138b54105034e2ba1aee20c_rle_crop_3798439858_0.png resize: (222, 117) 1358398448 -0.6919834417179171 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 205 time used for this insertion : 0.026027202606201172 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 205 time used for this insertion : 0.05544400215148926 save missing photos in datou_result : time spend for datou_step_exec : 53.559356689453125 time spend to save output : 0.08725428581237793 total time spend for step 6 : 53.6466109752655 step7:brightness Thu May 15 02:27:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747268428_1222436_1358317972_af57f1d55fba6cd4f71e2a2c0041dfd6.jpg treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb.jpg treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9.jpg treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55.jpg treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66.jpg treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa.jpg treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977.jpg treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b.jpg treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f.jpg treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f.jpg treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27.jpg treat image : temp/1747268428_1222436_1358315120_7b8000cb8138b54105034e2ba1aee20c.jpg treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f.jpg treat image : temp/1747268428_1222436_1358317972_af57f1d55fba6cd4f71e2a2c0041dfd6_rle_crop_3798439690_0.png treat image : temp/1747268428_1222436_1358317972_af57f1d55fba6cd4f71e2a2c0041dfd6_rle_crop_3798439694_0.png treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439696_0.png treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439697_0.png treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439702_0.png treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9_rle_crop_3798439708_0.png treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9_rle_crop_3798439709_0.png treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9_rle_crop_3798439713_0.png treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9_rle_crop_3798439715_0.png treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9_rle_crop_3798439716_0.png treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439720_0.png treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439721_0.png treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439723_0.png treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439725_0.png treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439726_0.png treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439727_0.png treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439728_0.png treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439729_0.png treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439731_0.png treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439732_0.png treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439735_0.png treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439736_0.png treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439740_0.png treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439742_0.png treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439746_0.png treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439747_0.png treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439748_0.png treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439749_0.png treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439750_0.png treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439752_0.png treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439754_0.png treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439755_0.png treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439756_0.png treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439757_0.png treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439760_0.png treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439761_0.png treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439762_0.png treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439763_0.png treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439764_0.png treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439765_0.png treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439766_0.png treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439767_0.png treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439768_0.png treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439769_0.png treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439770_0.png treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439771_0.png treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439772_0.png treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439773_0.png treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439774_0.png treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439775_0.png treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439776_0.png treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439777_0.png treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439779_0.png treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439780_0.png treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439782_0.png treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439784_0.png treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439785_0.png treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b_rle_crop_3798439786_0.png treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b_rle_crop_3798439787_0.png treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b_rle_crop_3798439788_0.png treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b_rle_crop_3798439789_0.png treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b_rle_crop_3798439790_0.png treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b_rle_crop_3798439795_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439799_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439802_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439803_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439804_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439807_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439808_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439809_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439810_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439813_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439814_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439815_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439817_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439818_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439819_0.png treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439820_0.png treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439821_0.png treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439822_0.png treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439824_0.png treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439825_0.png treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439827_0.png treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439831_0.png treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439832_0.png treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439833_0.png treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439834_0.png treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439836_0.png treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439838_0.png treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439839_0.png treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439840_0.png treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439841_0.png treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439842_0.png treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439843_0.png treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439844_0.png treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439845_0.png treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439846_0.png treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439848_0.png treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439849_0.png treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439852_0.png treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439853_0.png treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439854_0.png treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439855_0.png treat image : temp/1747268428_1222436_1358315120_7b8000cb8138b54105034e2ba1aee20c_rle_crop_3798439857_0.png treat image : temp/1747268428_1222436_1358315120_7b8000cb8138b54105034e2ba1aee20c_rle_crop_3798439859_0.png treat image : temp/1747268428_1222436_1358315120_7b8000cb8138b54105034e2ba1aee20c_rle_crop_3798439860_0.png treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439862_0.png treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439863_0.png treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439865_0.png treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439867_0.png treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439869_0.png treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439870_0.png treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439872_0.png treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439873_0.png treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439877_0.png treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439878_0.png treat image : temp/1747268428_1222436_1358317972_af57f1d55fba6cd4f71e2a2c0041dfd6_rle_crop_3798439691_0.png treat image : temp/1747268428_1222436_1358317972_af57f1d55fba6cd4f71e2a2c0041dfd6_rle_crop_3798439692_0.png treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439699_0.png treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439701_0.png treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9_rle_crop_3798439712_0.png treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439719_0.png treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439730_0.png treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439734_0.png treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439737_0.png treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439758_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439811_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439812_0.png treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439826_0.png treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439835_0.png treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439837_0.png treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439850_0.png treat image : temp/1747268428_1222436_1358315120_7b8000cb8138b54105034e2ba1aee20c_rle_crop_3798439856_0.png treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439864_0.png treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439866_0.png treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439875_0.png treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439876_0.png treat image : temp/1747268428_1222436_1358317972_af57f1d55fba6cd4f71e2a2c0041dfd6_rle_crop_3798439693_0.png treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439830_0.png treat image : temp/1747268428_1222436_1358317972_af57f1d55fba6cd4f71e2a2c0041dfd6_rle_crop_3798439687_0.png treat image : temp/1747268428_1222436_1358317972_af57f1d55fba6cd4f71e2a2c0041dfd6_rle_crop_3798439688_0.png treat image : temp/1747268428_1222436_1358317972_af57f1d55fba6cd4f71e2a2c0041dfd6_rle_crop_3798439689_0.png treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439695_0.png treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439698_0.png treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439700_0.png treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439703_0.png treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439704_0.png treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439705_0.png treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439706_0.png treat image : temp/1747268428_1222436_1358317965_f7b252ba5e8e645e3ac60426a425f3fb_rle_crop_3798439707_0.png treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9_rle_crop_3798439710_0.png treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9_rle_crop_3798439711_0.png treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9_rle_crop_3798439714_0.png treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9_rle_crop_3798439717_0.png treat image : temp/1747268428_1222436_1358317910_4bd83e8acba61195b770e7ed6fd69fa9_rle_crop_3798439718_0.png treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439722_0.png treat image : temp/1747268428_1222436_1358317891_dc155b49009553f103e21058e05fbb55_rle_crop_3798439724_0.png treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439733_0.png treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439738_0.png treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439739_0.png treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439741_0.png treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439743_0.png treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439744_0.png treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439745_0.png treat image : temp/1747268428_1222436_1358317888_11e44e3af8e1f441ac11e823f36d3f66_rle_crop_3798439751_0.png treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439753_0.png treat image : temp/1747268428_1222436_1358317886_381b4b10f8e79b309300c589dafe2aaa_rle_crop_3798439759_0.png treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439778_0.png treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439781_0.png treat image : temp/1747268428_1222436_1358317881_dfdb342b1b3ef1db898fb9ee85068977_rle_crop_3798439783_0.png treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b_rle_crop_3798439791_0.png treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b_rle_crop_3798439792_0.png treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b_rle_crop_3798439793_0.png treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b_rle_crop_3798439796_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439797_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439798_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439800_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439801_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439805_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439816_0.png treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439823_0.png treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439828_0.png treat image : temp/1747268428_1222436_1358315160_90ea371e4cea2fcd1179d9c8a5f54e3f_rle_crop_3798439829_0.png treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439847_0.png treat image : temp/1747268428_1222436_1358315125_9e72cd61a1543f2052a69363e49bfd27_rle_crop_3798439851_0.png treat image : temp/1747268428_1222436_1358315120_7b8000cb8138b54105034e2ba1aee20c_rle_crop_3798439861_0.png treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439868_0.png treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439871_0.png treat image : temp/1747268428_1222436_1358315116_f3afe51dbd7a8e94cc42a821904aba7f_rle_crop_3798439874_0.png treat image : temp/1747268428_1222436_1358315289_8f469f8004733b3f75c5e336f850d97b_rle_crop_3798439794_0.png treat image : temp/1747268428_1222436_1358315226_0fb440a248eb95048758bc82df73f84f_rle_crop_3798439806_0.png treat image : temp/1747268428_1222436_1358315120_7b8000cb8138b54105034e2ba1aee20c_rle_crop_3798439858_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 205 time used for this insertion : 0.023413896560668945 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 205 time used for this insertion : 0.07553958892822266 save missing photos in datou_result : time spend for datou_step_exec : 16.20289158821106 time spend to save output : 0.10480332374572754 total time spend for step 7 : 16.307694911956787 step8:velours_tree Thu May 15 02:27:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.40752720832824707 time spend to save output : 3.719329833984375e-05 total time spend for step 8 : 0.4075644016265869 step9:send_mail_cod Thu May 15 02:27:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22989039_15-05-2025_02_27_19.pdf 22989464 imagette229894641747268839 22989465 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229894651747268839 22989467 imagette229894671747268841 22989468 change filename to text .change filename to text .change filename to text .imagette229894681747268841 22989469 imagette229894691747268841 22989470 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229894701747268841 22989472 change filename to text .change filename to text .imagette229894721747268842 22989473 imagette229894731747268842 22989474 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229894741747268842 22989477 imagette229894771747268844 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22989039 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22989464,22989465,22989467,22989468,22989469,22989470,22989472,22989473,22989474,22989476,22989477?tags=flou,pet_clair,pet_fonce,autre,pehd,papier,metal,mal_croppe,carton,environnement,background args[1358317972] : ((1358317972, -0.32804531453829433, 492688767), (1358317972, 0.4120251811458476, 2107752395), '0.10039380001466397') We are sending mail with results at report@fotonower.com args[1358317965] : ((1358317965, -1.0538225367063034, 492688767), (1358317965, 0.5393354476842146, 2107752395), '0.10039380001466397') We are sending mail with results at report@fotonower.com args[1358317910] : ((1358317910, -1.5916269499468778, 492688767), (1358317910, -0.0917910078237593, 496442774), '0.10039380001466397') We are sending mail with results at report@fotonower.com args[1358317891] : ((1358317891, -5.523407396334955, 492609224), (1358317891, 0.163772482967848, 2107752395), '0.10039380001466397') We are sending mail with results at report@fotonower.com args[1358317888] : ((1358317888, -4.885002034289737, 492609224), (1358317888, 0.1697254823635579, 2107752395), '0.10039380001466397') We are sending mail with results at report@fotonower.com args[1358317886] : ((1358317886, -1.1824490754314472, 492688767), (1358317886, 0.038347021263503395, 2107752395), '0.10039380001466397') We are sending mail with results at report@fotonower.com args[1358317881] : ((1358317881, -1.9535191116406336, 492688767), (1358317881, -0.09104933985421582, 496442774), '0.10039380001466397') We are sending mail with results at report@fotonower.com args[1358315289] : ((1358315289, -2.639600268602066, 492609224), (1358315289, 0.1461327946238262, 2107752395), '0.10039380001466397') We are sending mail with results at report@fotonower.com args[1358315226] : ((1358315226, -2.8166260540776022, 492609224), (1358315226, 0.17620820233470535, 2107752395), '0.10039380001466397') We are sending mail with results at report@fotonower.com args[1358315160] : ((1358315160, -2.8775828875436367, 492609224), (1358315160, -0.0624762517690544, 2107752395), '0.10039380001466397') We are sending mail with results at report@fotonower.com args[1358315125] : ((1358315125, 1.5931525680397884, 492688767), (1358315125, -0.022123065672299574, 2107752395), '0.10039380001466397') We are sending mail with results at report@fotonower.com args[1358315120] : ((1358315120, -2.040890816645877, 492609224), (1358315120, 0.42499857856444234, 2107752395), '0.10039380001466397') We are sending mail with results at report@fotonower.com args[1358315116] : ((1358315116, -2.968037495311478, 492609224), (1358315116, 0.20121381332327873, 2107752395), '0.10039380001466397') We are sending mail with results at report@fotonower.com refus_total : 0.10039380001466397 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22989039 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22989039_15-05-2025_02_27_19.pdf results_Auto_P22989039_15-05-2025_02_27_19.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22989039_15-05-2025_02_27_19.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22989039','results_Auto_P22989039_15-05-2025_02_27_19.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22989039_15-05-2025_02_27_19.pdf','pdf','','0.71','0.10039380001466397') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22989039

https://www.fotonower.com/image?json=false&list_photos_id=1358317972
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358317965
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358317910
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358317891
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358317888
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358317886
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358317881
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358315289
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358315226
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358315160
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358315125
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.5931525680397884)
https://www.fotonower.com/image?json=false&list_photos_id=1358315120
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358315116
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 10.04%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/22989465?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22989468?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22989470?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/22989472?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22989474?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22989039_15-05-2025_02_27_19.pdf.

Lien vers velours :https://www.fotonower.com/velours/22989464,22989465,22989467,22989468,22989469,22989470,22989472,22989473,22989474,22989476,22989477?tags=flou,pet_clair,pet_fonce,autre,pehd,papier,metal,mal_croppe,carton,environnement,background.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 15 May 2025 00:27:27 GMT Content-Length: 0 Connection: close X-Message-Id: LutoL3d6Tiu5e0-m5jiNsA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1358317972, 1358317965, 1358317910, 1358317891, 1358317888, 1358317886, 1358317881, 1358315289, 1358315226, 1358315160, 1358315125, 1358315120, 1358315116] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317972', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317965', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317910', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317891', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317888', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317886', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317881', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315289', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315226', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315160', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315125', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315120', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315116', None, None, None, None, None, '2856068') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.013442516326904297 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.094204187393188 time spend to save output : 0.013830900192260742 total time spend for step 9 : 8.10803508758545 step10:split_time_score Thu May 15 02:27:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 13),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 14052025 22989039 Nombre de photos uploadées : 13 / 23040 (0%) 14052025 22989039 Nombre de photos taguées (types de déchets): 0 / 13 (0%) 14052025 22989039 Nombre de photos taguées (volume) : 0 / 13 (0%) elapsed_time : load_data_split_time_score 4.0531158447265625e-06 elapsed_time : order_list_meta_photo_and_scores 1.3828277587890625e-05 ????????????? elapsed_time : fill_and_build_computed_from_old_data 0.000782012939453125 elapsed_time : insert_dashboard_record_day_entry 0.024724721908569336 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22988944 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22988945 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22988947 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22988950 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22988966 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22988983 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22988984 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22988986 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22988989 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22988991 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22989000 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22989002 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22989004 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22989010 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22989012 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22989015 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22989016 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22989027 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22989033 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22989035 order by id desc limit 1 Qualite : 0.10039380001466397 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22989039_15-05-2025_02_27_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22989039 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22989039 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'14052025': {'nb_upload': 13, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1358317972, 1358317965, 1358317910, 1358317891, 1358317888, 1358317886, 1358317881, 1358315289, 1358315226, 1358315160, 1358315125, 1358315120, 1358315116] Looping around the photos to save general results len do output : 1 /22989039Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317972', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317965', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317910', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317891', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317888', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317886', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358317881', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315289', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315226', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315160', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315125', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315120', None, None, None, None, None, '2856068') ('3318', None, None, None, None, None, None, None, '2856068') ('3318', '22989039', '1358315116', None, None, None, None, None, '2856068') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.01488351821899414 save_final save missing photos in datou_result : time spend for datou_step_exec : 18.889404296875 time spend to save output : 0.03638482093811035 total time spend for step 10 : 18.92578911781311 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 13 set_done_treatment 176.50user 187.05system 7:21.46elapsed 82%CPU (0avgtext+0avgdata 5667180maxresident)k 771824inputs+100584outputs (10003major+17870760minor)pagefaults 0swaps